Sensitivity of measuring the progress in financial risk protection to survey design and its socioeconomic and demographic determinants: A case study in Rwanda

Chunling Lu, Kai Liu, Lingling Li, Yuhong Yang

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Reliable and comparable information on households with catastrophic health expenditure (HCHE) is crucial for monitoring and evaluating our progress towards achieving universal financial risk protection. This study aims to investigate the sensitivity of measuring the progress in financial risk protection to survey design and its socioeconomic and demographic determinants. Using the Rwanda Integrated Living Conditions Survey in 2005 and 2010/2011, we derived the level and trend of the percentage of the HCHE using out-of-pocket health spending data derived from (1) a health module with a two-week recall period and six (2005)/seven (2010/2011) survey questions (Method 1) and (2) a consumption module with a four-week/ten-/12-month recall period and 11(2005)/24 (2010/2011) questions (Method 2). Using multilevel logistic regression analysis, we investigated the household socioeconomic and demographic characteristics that affected the sensitivity of estimating the HCHE to survey design. We found that Method 1 generated a significantly higher HCHE estimate (9.2%, 95% confidence interval 8.4%–10.0%) than Method2 (7.4%, 6.6%–8.1%) in 2005 and lower estimate (5.6%, 5.2%–6.1%) than Method 2 (8.2%, 7.6%–8.7%) in 2010/2011. The estimated trends of the HCHE using the two methods were not consistent between the two years. A household's size, its income quintile, having no under-five children, and educational level of its head were positively associated with the consistency of its HCHE status when using the two survey methods. Estimates of the progress in financial risk protection, especially among the most vulnerable households, are sensitive to survey design. These results are robust to various thresholds of catastrophic health spending. Future work must focus on mitigating survey effects through the development of statistical tools.

Original languageEnglish (US)
Pages (from-to)11-18
Number of pages8
JournalSocial Science and Medicine
Volume178
DOIs
StatePublished - Apr 1 2017

Fingerprint

Rwanda
Health Expenditures
Demography
determinants
expenditures
health
Health
Surveys and Questionnaires
Demographics
Household
household size
Social Conditions
trend
living conditions
Health Status
Expenditure
regression analysis
Logistic Models
confidence
logistics

Keywords

  • Developing countries
  • Financial risk protection
  • Measuring catastrophic health expenditure
  • Measuring out-of-pocket health expenditure
  • Rural Rwanda
  • Survey design
  • Survey instruments

Cite this

@article{f8cf39c8be26407aaf1d3977cab4a9d6,
title = "Sensitivity of measuring the progress in financial risk protection to survey design and its socioeconomic and demographic determinants: A case study in Rwanda",
abstract = "Reliable and comparable information on households with catastrophic health expenditure (HCHE) is crucial for monitoring and evaluating our progress towards achieving universal financial risk protection. This study aims to investigate the sensitivity of measuring the progress in financial risk protection to survey design and its socioeconomic and demographic determinants. Using the Rwanda Integrated Living Conditions Survey in 2005 and 2010/2011, we derived the level and trend of the percentage of the HCHE using out-of-pocket health spending data derived from (1) a health module with a two-week recall period and six (2005)/seven (2010/2011) survey questions (Method 1) and (2) a consumption module with a four-week/ten-/12-month recall period and 11(2005)/24 (2010/2011) questions (Method 2). Using multilevel logistic regression analysis, we investigated the household socioeconomic and demographic characteristics that affected the sensitivity of estimating the HCHE to survey design. We found that Method 1 generated a significantly higher HCHE estimate (9.2{\%}, 95{\%} confidence interval 8.4{\%}–10.0{\%}) than Method2 (7.4{\%}, 6.6{\%}–8.1{\%}) in 2005 and lower estimate (5.6{\%}, 5.2{\%}–6.1{\%}) than Method 2 (8.2{\%}, 7.6{\%}–8.7{\%}) in 2010/2011. The estimated trends of the HCHE using the two methods were not consistent between the two years. A household's size, its income quintile, having no under-five children, and educational level of its head were positively associated with the consistency of its HCHE status when using the two survey methods. Estimates of the progress in financial risk protection, especially among the most vulnerable households, are sensitive to survey design. These results are robust to various thresholds of catastrophic health spending. Future work must focus on mitigating survey effects through the development of statistical tools.",
keywords = "Developing countries, Financial risk protection, Measuring catastrophic health expenditure, Measuring out-of-pocket health expenditure, Rural Rwanda, Survey design, Survey instruments",
author = "Chunling Lu and Kai Liu and Lingling Li and Yuhong Yang",
year = "2017",
month = "4",
day = "1",
doi = "10.1016/j.socscimed.2017.02.001",
language = "English (US)",
volume = "178",
pages = "11--18",
journal = "Social Science and Medicine",
issn = "0277-9536",
publisher = "Elsevier Ltd",

}

TY - JOUR

T1 - Sensitivity of measuring the progress in financial risk protection to survey design and its socioeconomic and demographic determinants

T2 - A case study in Rwanda

AU - Lu, Chunling

AU - Liu, Kai

AU - Li, Lingling

AU - Yang, Yuhong

PY - 2017/4/1

Y1 - 2017/4/1

N2 - Reliable and comparable information on households with catastrophic health expenditure (HCHE) is crucial for monitoring and evaluating our progress towards achieving universal financial risk protection. This study aims to investigate the sensitivity of measuring the progress in financial risk protection to survey design and its socioeconomic and demographic determinants. Using the Rwanda Integrated Living Conditions Survey in 2005 and 2010/2011, we derived the level and trend of the percentage of the HCHE using out-of-pocket health spending data derived from (1) a health module with a two-week recall period and six (2005)/seven (2010/2011) survey questions (Method 1) and (2) a consumption module with a four-week/ten-/12-month recall period and 11(2005)/24 (2010/2011) questions (Method 2). Using multilevel logistic regression analysis, we investigated the household socioeconomic and demographic characteristics that affected the sensitivity of estimating the HCHE to survey design. We found that Method 1 generated a significantly higher HCHE estimate (9.2%, 95% confidence interval 8.4%–10.0%) than Method2 (7.4%, 6.6%–8.1%) in 2005 and lower estimate (5.6%, 5.2%–6.1%) than Method 2 (8.2%, 7.6%–8.7%) in 2010/2011. The estimated trends of the HCHE using the two methods were not consistent between the two years. A household's size, its income quintile, having no under-five children, and educational level of its head were positively associated with the consistency of its HCHE status when using the two survey methods. Estimates of the progress in financial risk protection, especially among the most vulnerable households, are sensitive to survey design. These results are robust to various thresholds of catastrophic health spending. Future work must focus on mitigating survey effects through the development of statistical tools.

AB - Reliable and comparable information on households with catastrophic health expenditure (HCHE) is crucial for monitoring and evaluating our progress towards achieving universal financial risk protection. This study aims to investigate the sensitivity of measuring the progress in financial risk protection to survey design and its socioeconomic and demographic determinants. Using the Rwanda Integrated Living Conditions Survey in 2005 and 2010/2011, we derived the level and trend of the percentage of the HCHE using out-of-pocket health spending data derived from (1) a health module with a two-week recall period and six (2005)/seven (2010/2011) survey questions (Method 1) and (2) a consumption module with a four-week/ten-/12-month recall period and 11(2005)/24 (2010/2011) questions (Method 2). Using multilevel logistic regression analysis, we investigated the household socioeconomic and demographic characteristics that affected the sensitivity of estimating the HCHE to survey design. We found that Method 1 generated a significantly higher HCHE estimate (9.2%, 95% confidence interval 8.4%–10.0%) than Method2 (7.4%, 6.6%–8.1%) in 2005 and lower estimate (5.6%, 5.2%–6.1%) than Method 2 (8.2%, 7.6%–8.7%) in 2010/2011. The estimated trends of the HCHE using the two methods were not consistent between the two years. A household's size, its income quintile, having no under-five children, and educational level of its head were positively associated with the consistency of its HCHE status when using the two survey methods. Estimates of the progress in financial risk protection, especially among the most vulnerable households, are sensitive to survey design. These results are robust to various thresholds of catastrophic health spending. Future work must focus on mitigating survey effects through the development of statistical tools.

KW - Developing countries

KW - Financial risk protection

KW - Measuring catastrophic health expenditure

KW - Measuring out-of-pocket health expenditure

KW - Rural Rwanda

KW - Survey design

KW - Survey instruments

UR - http://www.scopus.com/inward/record.url?scp=85011928611&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85011928611&partnerID=8YFLogxK

U2 - 10.1016/j.socscimed.2017.02.001

DO - 10.1016/j.socscimed.2017.02.001

M3 - Article

C2 - 28189819

AN - SCOPUS:85011928611

VL - 178

SP - 11

EP - 18

JO - Social Science and Medicine

JF - Social Science and Medicine

SN - 0277-9536

ER -