Establishing survey validity and reliability for American Indians through "think aloud" and test-retest methods

Cindy Horst Hauge; Jacque Jacobs-Knight; Jamie L. Jensen; Katherine M. Burgess; Susan E. Puumala; Georgiana Wilton; Jessica D. Hanson

doi:10.1177/1049732315582010

Establishing survey validity and reliability for American Indians through "think aloud" and test-retest methods

Cindy Horst Hauge, Jacque Jacobs-Knight, Jamie L. Jensen, Katherine M. Burgess, Susan E. Puumala, Georgiana Wilton, Jessica D. Hanson

Research output: Contribution to journal › Article › peer-review

13 Scopus citations

Abstract

The purpose of this study was to use a mixed-methods approach to determine the validity and reliability of measurements used within an alcohol-exposed pregnancy prevention program for American Indian women. To develop validity, content experts provided input into the survey measures, and a "think aloud" methodology was conducted with 23 American Indian women. After revising the measurements based on this input, a test-retest was conducted with 79 American Indian women who were randomized to complete either the original measurements or the new, modified measurements. The test-retest revealed that some of the questions performed better for the modified version, whereas others appeared to be more reliable for the original version. The mixed-methods approach was a useful methodology for gathering feedback on survey measurements from American Indian participants and in indicating specific survey questions that needed to be modified for this population.

Original language	English (US)
Pages (from-to)	820-830
Number of pages	11
Journal	Qualitative Health Research
Volume	25
Issue number	6
DOIs	https://doi.org/10.1177/1049732315582010
State	Published - Jun 6 2015
Externally published	Yes

Bibliographical note

Funding Information:
The authors disclosed receipt of the following financial support for the research, authorship, and publication of this article. This project is supported by the National Center on Minority Health and Health Disparities of the National Institutes of Health under Award U54MD008164.

Publisher Copyright:
© The Author(s) 2015.

Keywords

aboriginal people, North America
alcohol/alcoholism
contraception
qualitative
reliability
validity

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Publisher link

10.1177/1049732315582010

Find It

Find It at U of M Libraries

Cite this

@article{e1a165a3621b4d39945a1786712e22a6,

title = "Establishing survey validity and reliability for American Indians through {"}think aloud{"} and test-retest methods",

abstract = "The purpose of this study was to use a mixed-methods approach to determine the validity and reliability of measurements used within an alcohol-exposed pregnancy prevention program for American Indian women. To develop validity, content experts provided input into the survey measures, and a {"}think aloud{"} methodology was conducted with 23 American Indian women. After revising the measurements based on this input, a test-retest was conducted with 79 American Indian women who were randomized to complete either the original measurements or the new, modified measurements. The test-retest revealed that some of the questions performed better for the modified version, whereas others appeared to be more reliable for the original version. The mixed-methods approach was a useful methodology for gathering feedback on survey measurements from American Indian participants and in indicating specific survey questions that needed to be modified for this population.",

keywords = "aboriginal people, North America, alcohol/alcoholism, contraception, qualitative, reliability, validity",

author = "Hauge, {Cindy Horst} and Jacque Jacobs-Knight and Jensen, {Jamie L.} and Burgess, {Katherine M.} and Puumala, {Susan E.} and Georgiana Wilton and Hanson, {Jessica D.}",

note = "Funding Information: The authors disclosed receipt of the following financial support for the research, authorship, and publication of this article. This project is supported by the National Center on Minority Health and Health Disparities of the National Institutes of Health under Award U54MD008164. Publisher Copyright: {\textcopyright} The Author(s) 2015.",

year = "2015",

month = jun,

day = "6",

doi = "10.1177/1049732315582010",

language = "English (US)",

volume = "25",

pages = "820--830",

journal = "Qualitative Health Research",

issn = "1049-7323",

publisher = "SAGE Publications Inc.",

number = "6",

}

TY - JOUR

T1 - Establishing survey validity and reliability for American Indians through "think aloud" and test-retest methods

AU - Hauge, Cindy Horst

AU - Jacobs-Knight, Jacque

AU - Jensen, Jamie L.

AU - Burgess, Katherine M.

AU - Puumala, Susan E.

AU - Wilton, Georgiana

AU - Hanson, Jessica D.

N1 - Funding Information: The authors disclosed receipt of the following financial support for the research, authorship, and publication of this article. This project is supported by the National Center on Minority Health and Health Disparities of the National Institutes of Health under Award U54MD008164. Publisher Copyright: © The Author(s) 2015.

PY - 2015/6/6

Y1 - 2015/6/6

N2 - The purpose of this study was to use a mixed-methods approach to determine the validity and reliability of measurements used within an alcohol-exposed pregnancy prevention program for American Indian women. To develop validity, content experts provided input into the survey measures, and a "think aloud" methodology was conducted with 23 American Indian women. After revising the measurements based on this input, a test-retest was conducted with 79 American Indian women who were randomized to complete either the original measurements or the new, modified measurements. The test-retest revealed that some of the questions performed better for the modified version, whereas others appeared to be more reliable for the original version. The mixed-methods approach was a useful methodology for gathering feedback on survey measurements from American Indian participants and in indicating specific survey questions that needed to be modified for this population.

AB - The purpose of this study was to use a mixed-methods approach to determine the validity and reliability of measurements used within an alcohol-exposed pregnancy prevention program for American Indian women. To develop validity, content experts provided input into the survey measures, and a "think aloud" methodology was conducted with 23 American Indian women. After revising the measurements based on this input, a test-retest was conducted with 79 American Indian women who were randomized to complete either the original measurements or the new, modified measurements. The test-retest revealed that some of the questions performed better for the modified version, whereas others appeared to be more reliable for the original version. The mixed-methods approach was a useful methodology for gathering feedback on survey measurements from American Indian participants and in indicating specific survey questions that needed to be modified for this population.

KW - aboriginal people, North America

KW - alcohol/alcoholism

KW - contraception

KW - qualitative

KW - reliability

KW - validity

UR - http://www.scopus.com/inward/record.url?scp=84930443674&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930443674&partnerID=8YFLogxK

U2 - 10.1177/1049732315582010

DO - 10.1177/1049732315582010

M3 - Article

C2 - 25888693

AN - SCOPUS:84930443674

SN - 1049-7323

VL - 25

SP - 820

EP - 830

JO - Qualitative Health Research

JF - Qualitative Health Research

IS - 6

ER -

Establishing survey validity and reliability for American Indians through "think aloud" and test-retest methods

Abstract

Bibliographical note

Keywords

UN SDGs

Publisher link

Find It

Other files and links

Fingerprint

Cite this