Objectives: Although Internet-based surveys are becoming more common, little is known about agreement between administrative claims data and Internet-based survey self- and proxy-reported health care resource utilization (HCRU) data. This analysis evaluated the level of agreement between self- and proxy-reported HCRU data, as recorded through an Internet-based survey, and administrative claims-based HCRU data. Methods: The Child and Household Influenza-Illness and Employee Function study collected self- and proxy-reported HCRU data monthly between November 2007 and May 2008. Data included the occurrence and number of visits to hospitals, emergency departments, urgent care centers, and outpatient offices for a respondent's and his or her household members' care. Administrative claims data from the MarketScan® Databases were assessed during the same time and evaluated relative to survey-based metrics. Only data for individuals with employer-sponsored health care coverage linkable to claims were included. The Kappa (κ) statistic was used to evaluate visit concordance, and the intraclass correlation coefficient was used to describe frequency consistency. Results: Agreement for presence of a health care visit and the number of visits were similar for self- and proxy-reported HCRU data. There was moderate to substantial agreement related to health care visit occurrence between survey-based and claims-based HCRU data for inpatient, emergency department, and office visits (κ: 0.47-0.77). There was less agreement on health care visit frequencies, with intraclass correlation coefficient values ranging from 0.14 to 0.71. Conclusions: This study's agreement values suggest that Internet-based surveys are an effective method to collect self- and proxy-reported HCRU data. These results should increase confidence in the use of the Internet for evaluating disease burden.
Bibliographical noteFunding Information:
The authors acknowledge the contributions of Chris Gregory, who served as the primary SAS programmer for the CHIEF study. The authors thank Dr. Chris Ambrose and Ms. Kellie Ryan for their comments and feedback on earlier versions of the manuscript. Editorial support in the form of manuscript formatting was provided by Complete Healthcare Communications, Inc. (Chadds Ford, PA) and was funded by MedImmune.
Source of Financial Support: The study was sponsored by MedImmune, LLC. The analysis for this study was conducted primarily at Thomson Reuters. Thomson Reuters provides custom consulting services to all major pharmaceutical companies. As part of a consulting agreement with Thomson Reuters, MedImmune provided funding to Thomson Reuters to support protocol development, data analysis, and manuscript development activities associated with this study. Dr. Palmer and Dr. Chu and Mr. Johnston are employees of Thomson Reuters; Dr. Rousculp and Dr. Mahadevia are employees of MedImmune. Dr. Nichol has received research funding from GSK and Sanofi Pasteur and has served as a consultant to and on advisory boards for GSK, Sanofi Pasteur, MedImmune, Merck, and Novartis.
- administrative claims
- health care utilization