Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer

Elmer V. Bernstam, Muhammad F. Walji, Smitha Sagaram, Deepak Sagaram, Craig W. Johnson, Funda Meric-Bernstam

Research output: Contribution to journalArticle

66 Citations (Scopus)

Abstract

BACKGROUND. Consumers increasingly consult the Internet for breast cancer information. Concerned about accuracy, multiple organizations developed quality criteria for online content. However, the effectiveness of these tools is unknown. The authors determined whether existing quality criteria can identify inaccurate breast cancer information online. METHODS. The authors identified 343 unique webpages by using 15 breast cancer-related queries on 5 popular web search-engines. Each page was assessed for 15 quality criteria and 3 website characteristics, link type (sponsored or not), search engine used to find the page, and domain extension. Two clinician-reviewers independently assessed accuracy and topics covered. The authors then determined whether quality criteria, website characteristics, and topics were associated with the presence of inaccurate statements. RESULTS. The authors found 41 inaccurate statements on 18 webpages (5.2%). No quality criteria or website characteristic, singly or in combination, reliably identified inaccurate information. The total number of quality criteria met by a website accounted for a small fraction of the variability in the presence of inaccuracies (point biserial r = -0.128; df = 341; P = .018; r2 = 0.016). However, webpages containing information on complementary and alternative medicine (CAM) were significantly more likely to contain inaccuracies compared with pages without CAM information (odds ratio [OR], 15.6; P < .001). CONCLUSIONS. Most breast cancer information that consumers are likely to encounter online is accurate. However, commonly cited quality criteria do not identify inaccurate information. Webpages that contain information about CAM are relatively likely to contain inaccurate statements. Consumers searching for health information online should still consult a clinician before taking action.

Original languageEnglish (US)
Pages (from-to)1206-1213
Number of pages8
JournalCancer
Volume112
Issue number6
DOIs
StatePublished - Mar 15 2008

Fingerprint

Complementary Therapies
Breast Neoplasms
Search Engine
Consumer Health Information
Internet
Odds Ratio

Keywords

  • (MeSH)
  • Breast neoplasms
  • Complementary therapies/*standards/trends
  • Health education/methods
  • Information services/*standards/utilization
  • Internet/*standards/statistics & numerical data/trends
  • Internet/*standards/utilization

Cite this

Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer. / Bernstam, Elmer V.; Walji, Muhammad F.; Sagaram, Smitha; Sagaram, Deepak; Johnson, Craig W.; Meric-Bernstam, Funda.

In: Cancer, Vol. 112, No. 6, 15.03.2008, p. 1206-1213.

Research output: Contribution to journalArticle

Bernstam, Elmer V. ; Walji, Muhammad F. ; Sagaram, Smitha ; Sagaram, Deepak ; Johnson, Craig W. ; Meric-Bernstam, Funda. / Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer. In: Cancer. 2008 ; Vol. 112, No. 6. pp. 1206-1213.
@article{9f02b456f9634aef9635b586589bd699,
title = "Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer",
abstract = "BACKGROUND. Consumers increasingly consult the Internet for breast cancer information. Concerned about accuracy, multiple organizations developed quality criteria for online content. However, the effectiveness of these tools is unknown. The authors determined whether existing quality criteria can identify inaccurate breast cancer information online. METHODS. The authors identified 343 unique webpages by using 15 breast cancer-related queries on 5 popular web search-engines. Each page was assessed for 15 quality criteria and 3 website characteristics, link type (sponsored or not), search engine used to find the page, and domain extension. Two clinician-reviewers independently assessed accuracy and topics covered. The authors then determined whether quality criteria, website characteristics, and topics were associated with the presence of inaccurate statements. RESULTS. The authors found 41 inaccurate statements on 18 webpages (5.2{\%}). No quality criteria or website characteristic, singly or in combination, reliably identified inaccurate information. The total number of quality criteria met by a website accounted for a small fraction of the variability in the presence of inaccuracies (point biserial r = -0.128; df = 341; P = .018; r2 = 0.016). However, webpages containing information on complementary and alternative medicine (CAM) were significantly more likely to contain inaccuracies compared with pages without CAM information (odds ratio [OR], 15.6; P < .001). CONCLUSIONS. Most breast cancer information that consumers are likely to encounter online is accurate. However, commonly cited quality criteria do not identify inaccurate information. Webpages that contain information about CAM are relatively likely to contain inaccurate statements. Consumers searching for health information online should still consult a clinician before taking action.",
keywords = "(MeSH), Breast neoplasms, Complementary therapies/*standards/trends, Health education/methods, Information services/*standards/utilization, Internet/*standards/statistics & numerical data/trends, Internet/*standards/utilization",
author = "Bernstam, {Elmer V.} and Walji, {Muhammad F.} and Smitha Sagaram and Deepak Sagaram and Johnson, {Craig W.} and Funda Meric-Bernstam",
year = "2008",
month = "3",
day = "15",
doi = "10.1002/cncr.23308",
language = "English (US)",
volume = "112",
pages = "1206--1213",
journal = "Cancer",
issn = "0008-543X",
publisher = "John Wiley and Sons Inc.",
number = "6",

}

TY - JOUR

T1 - Commonly cited website quality criteria are not effective at identifying inaccurate online information about breast cancer

AU - Bernstam, Elmer V.

AU - Walji, Muhammad F.

AU - Sagaram, Smitha

AU - Sagaram, Deepak

AU - Johnson, Craig W.

AU - Meric-Bernstam, Funda

PY - 2008/3/15

Y1 - 2008/3/15

N2 - BACKGROUND. Consumers increasingly consult the Internet for breast cancer information. Concerned about accuracy, multiple organizations developed quality criteria for online content. However, the effectiveness of these tools is unknown. The authors determined whether existing quality criteria can identify inaccurate breast cancer information online. METHODS. The authors identified 343 unique webpages by using 15 breast cancer-related queries on 5 popular web search-engines. Each page was assessed for 15 quality criteria and 3 website characteristics, link type (sponsored or not), search engine used to find the page, and domain extension. Two clinician-reviewers independently assessed accuracy and topics covered. The authors then determined whether quality criteria, website characteristics, and topics were associated with the presence of inaccurate statements. RESULTS. The authors found 41 inaccurate statements on 18 webpages (5.2%). No quality criteria or website characteristic, singly or in combination, reliably identified inaccurate information. The total number of quality criteria met by a website accounted for a small fraction of the variability in the presence of inaccuracies (point biserial r = -0.128; df = 341; P = .018; r2 = 0.016). However, webpages containing information on complementary and alternative medicine (CAM) were significantly more likely to contain inaccuracies compared with pages without CAM information (odds ratio [OR], 15.6; P < .001). CONCLUSIONS. Most breast cancer information that consumers are likely to encounter online is accurate. However, commonly cited quality criteria do not identify inaccurate information. Webpages that contain information about CAM are relatively likely to contain inaccurate statements. Consumers searching for health information online should still consult a clinician before taking action.

AB - BACKGROUND. Consumers increasingly consult the Internet for breast cancer information. Concerned about accuracy, multiple organizations developed quality criteria for online content. However, the effectiveness of these tools is unknown. The authors determined whether existing quality criteria can identify inaccurate breast cancer information online. METHODS. The authors identified 343 unique webpages by using 15 breast cancer-related queries on 5 popular web search-engines. Each page was assessed for 15 quality criteria and 3 website characteristics, link type (sponsored or not), search engine used to find the page, and domain extension. Two clinician-reviewers independently assessed accuracy and topics covered. The authors then determined whether quality criteria, website characteristics, and topics were associated with the presence of inaccurate statements. RESULTS. The authors found 41 inaccurate statements on 18 webpages (5.2%). No quality criteria or website characteristic, singly or in combination, reliably identified inaccurate information. The total number of quality criteria met by a website accounted for a small fraction of the variability in the presence of inaccuracies (point biserial r = -0.128; df = 341; P = .018; r2 = 0.016). However, webpages containing information on complementary and alternative medicine (CAM) were significantly more likely to contain inaccuracies compared with pages without CAM information (odds ratio [OR], 15.6; P < .001). CONCLUSIONS. Most breast cancer information that consumers are likely to encounter online is accurate. However, commonly cited quality criteria do not identify inaccurate information. Webpages that contain information about CAM are relatively likely to contain inaccurate statements. Consumers searching for health information online should still consult a clinician before taking action.

KW - (MeSH)

KW - Breast neoplasms

KW - Complementary therapies/standards/trends

KW - Health education/methods

KW - Information services/standards/utilization

KW - Internet/standards/statistics & numerical data/trends

KW - Internet/standards/utilization

UR - http://www.scopus.com/inward/record.url?scp=41149124429&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=41149124429&partnerID=8YFLogxK

U2 - 10.1002/cncr.23308

DO - 10.1002/cncr.23308

M3 - Article

C2 - 18266210

AN - SCOPUS:41149124429

VL - 112

SP - 1206

EP - 1213

JO - Cancer

JF - Cancer

SN - 0008-543X

IS - 6

ER -