You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation

Jason T. Kerwin; Natalia Ordaz Reynoso

doi:10.1215/00703370-8932274

You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation

Jason T. Kerwin, Natalia Ordaz Reynoso

Applied Economics

Research output: Contribution to journal › Article › peer-review

Abstract

Directly eliciting individuals' subjective beliefs via surveys is increasingly popular in social science research, but doing so via face-to-face surveys has an important downside: the interviewer's knowledge of the topic may spill over onto the respondent's recorded beliefs. Using a randomized experiment that used interviewers to implement an information treatment, we show that reported beliefs are significantly shifted by interviewer knowledge. Trained interviewers primed respondents to use the exact numbers used in the training, nudging them away from higher answers; recorded responses decreased by about 0.3 standard deviations of the initial belief distribution. Furthermore, respondents with stronger prior beliefs were less affected by interviewer knowledge. We suggest corrections for this issue from the perspectives of interviewer recruitment, survey design, and experiment setup.

Original language	English (US)
Pages (from-to)	1-29
Number of pages	29
Journal	Demography
Volume	58
Issue number	1
DOIs	https://doi.org/10.1215/00703370-8932274
State	Published - Feb 1 2021

Bibliographical note

Funding Information:
Acknowledgments We thank Adeline Delavande, Audrey Dorélien, Jennifer Johnson-Hanks, Maxwell Mkondiwa, Stacy Pancratz, Rebecca Thornton, Emilia Tjernström, Jenny Trinitapoli, Susan Watkins, Rob Warren, Bob Willis, Elizabeth Wrigley-Field, and four anonymous reviewers for their helpful comments and suggestions. This research was supported in part by an NIA training grant to the Population Studies Center at the University of Michigan (T32 AG000221). The authors gratefully acknowledge support from the Minnesota Population Center (P2C HD041023) funded through a grant from the Eunice Kennedy Shriver National Institute for Child Health and Human Development (NICHD). All errors and omissions are our own.

Publisher Copyright:
© 2021 The Authors.

Keywords

Interviewer effects
Risk beliefs
Spillovers
Subjective expectations
Survey methodology

PubMed: MeSH publication types

Journal Article
Research Support, N.I.H., Extramural
Randomized Controlled Trial

Publisher link

10.1215/00703370-8932274

https://doi.org/10.1215/00703370-8932274

Find It

Find It at U of M Libraries

Cite this

@article{1a68e0e9118445efa1f1a7ef1ef39792,

title = "You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation",

abstract = "Directly eliciting individuals' subjective beliefs via surveys is increasingly popular in social science research, but doing so via face-to-face surveys has an important downside: the interviewer's knowledge of the topic may spill over onto the respondent's recorded beliefs. Using a randomized experiment that used interviewers to implement an information treatment, we show that reported beliefs are significantly shifted by interviewer knowledge. Trained interviewers primed respondents to use the exact numbers used in the training, nudging them away from higher answers; recorded responses decreased by about 0.3 standard deviations of the initial belief distribution. Furthermore, respondents with stronger prior beliefs were less affected by interviewer knowledge. We suggest corrections for this issue from the perspectives of interviewer recruitment, survey design, and experiment setup.",

keywords = "Interviewer effects, Risk beliefs, Spillovers, Subjective expectations, Survey methodology",

author = "Kerwin, {Jason T.} and {Ordaz Reynoso}, Natalia",

note = "Funding Information: Acknowledgments We thank Adeline Delavande, Audrey Dor{\'e}lien, Jennifer Johnson-Hanks, Maxwell Mkondiwa, Stacy Pancratz, Rebecca Thornton, Emilia Tjernstr{\"o}m, Jenny Trinitapoli, Susan Watkins, Rob Warren, Bob Willis, Elizabeth Wrigley-Field, and four anonymous reviewers for their helpful comments and suggestions. This research was supported in part by an NIA training grant to the Population Studies Center at the University of Michigan (T32 AG000221). The authors gratefully acknowledge support from the Minnesota Population Center (P2C HD041023) funded through a grant from the Eunice Kennedy Shriver National Institute for Child Health and Human Development (NICHD). All errors and omissions are our own. Publisher Copyright: {\textcopyright} 2021 The Authors.",

year = "2021",

month = feb,

day = "1",

doi = "10.1215/00703370-8932274",

language = "English (US)",

volume = "58",

pages = "1--29",

journal = "Demography",

issn = "0070-3370",

publisher = "Springer New York",

number = "1",

}

TY - JOUR

T1 - You Know What I Know

T2 - Interviewer Knowledge Effects in Subjective Expectation Elicitation

AU - Kerwin, Jason T.

AU - Ordaz Reynoso, Natalia

N1 - Funding Information: Acknowledgments We thank Adeline Delavande, Audrey Dorélien, Jennifer Johnson-Hanks, Maxwell Mkondiwa, Stacy Pancratz, Rebecca Thornton, Emilia Tjernström, Jenny Trinitapoli, Susan Watkins, Rob Warren, Bob Willis, Elizabeth Wrigley-Field, and four anonymous reviewers for their helpful comments and suggestions. This research was supported in part by an NIA training grant to the Population Studies Center at the University of Michigan (T32 AG000221). The authors gratefully acknowledge support from the Minnesota Population Center (P2C HD041023) funded through a grant from the Eunice Kennedy Shriver National Institute for Child Health and Human Development (NICHD). All errors and omissions are our own. Publisher Copyright: © 2021 The Authors.

PY - 2021/2/1

Y1 - 2021/2/1

N2 - Directly eliciting individuals' subjective beliefs via surveys is increasingly popular in social science research, but doing so via face-to-face surveys has an important downside: the interviewer's knowledge of the topic may spill over onto the respondent's recorded beliefs. Using a randomized experiment that used interviewers to implement an information treatment, we show that reported beliefs are significantly shifted by interviewer knowledge. Trained interviewers primed respondents to use the exact numbers used in the training, nudging them away from higher answers; recorded responses decreased by about 0.3 standard deviations of the initial belief distribution. Furthermore, respondents with stronger prior beliefs were less affected by interviewer knowledge. We suggest corrections for this issue from the perspectives of interviewer recruitment, survey design, and experiment setup.

AB - Directly eliciting individuals' subjective beliefs via surveys is increasingly popular in social science research, but doing so via face-to-face surveys has an important downside: the interviewer's knowledge of the topic may spill over onto the respondent's recorded beliefs. Using a randomized experiment that used interviewers to implement an information treatment, we show that reported beliefs are significantly shifted by interviewer knowledge. Trained interviewers primed respondents to use the exact numbers used in the training, nudging them away from higher answers; recorded responses decreased by about 0.3 standard deviations of the initial belief distribution. Furthermore, respondents with stronger prior beliefs were less affected by interviewer knowledge. We suggest corrections for this issue from the perspectives of interviewer recruitment, survey design, and experiment setup.

KW - Interviewer effects

KW - Risk beliefs

KW - Spillovers

KW - Subjective expectations

KW - Survey methodology

UR - http://www.scopus.com/inward/record.url?scp=85104168488&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85104168488&partnerID=8YFLogxK

U2 - 10.1215/00703370-8932274

DO - 10.1215/00703370-8932274

M3 - Article

C2 - 33834250

VL - 58

SP - 1

EP - 29

JO - Demography

JF - Demography

SN - 0070-3370

IS - 1

ER -

You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation

Abstract

Bibliographical note

Keywords

PubMed: MeSH publication types

Publisher link

Find It

Other files and links

Fingerprint

Cite this