Improving Test-Taking Effort in Low-Stakes Group-Based Educational Testing: A Meta-Analysis of Interventions

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

Four decades of research have shown that students’ low test-taking effort is a serious threat to the validity of score-based inferences from low-stakes, group-based educational assessments. This meta-analysis sought to identify effective interventions for improving students’ test-taking effort in such contexts. Included studies (a) used a treatment-control group design; (b) administered a low-stakes group-based educational assessment; (c) employed an intervention to improve test-taking motivation; and (d) evaluated test-taking effort and/or test performance as outcomes. The analysis included 53 studies (N = 59,096) that produced 60 and 105 effect sizes of test-taking effort and test performance, respectively. On average, interventions were found to improve test-taking effort and test performance by 0.13 standard deviations (SD) each. The largest gains in test-taking effort were observed when providing external incentives followed by increasing test relevance, while no significant differences were found between these two intervention types in improving test performance. Furthermore, negligible impact was detected on both dependent variables for interventions that modified assessment design or promised feedback. Recommendations for future research and practice are discussed.

Original languageEnglish (US)
Pages (from-to)85-106
Number of pages22
JournalApplied Measurement in Education
Volume34
Issue number2
DOIs
StatePublished - 2021

Bibliographical note

Funding Information:
The author would like to thank Blair Lehman, Lydia Liu, Jennifer Bochenek, Elizabeth Stone, Brent Bridgeman, and Cristina Anguiano Carrasco from the Educational Testing Service for their comments on an earlier draft as well as Bradley Hartwyk from the University of Minnesota for his assistance with coding.

Publisher Copyright:
© 2021 Taylor & Francis Group, LLC.

Fingerprint

Dive into the research topics of 'Improving Test-Taking Effort in Low-Stakes Group-Based Educational Testing: A Meta-Analysis of Interventions'. Together they form a unique fingerprint.

Cite this