A New Procedure for Detection of Students’ Rapid Guessing Responses Using Response Time

Hongwen Guo, Joseph Rios, Shelby Haberman, Ou Lydia Liu, Jing Wang, Insu Paek

Research output: Contribution to journalArticlepeer-review

55 Scopus citations

Abstract

Unmotivated test takers using rapid guessing in item responses can affect validity studies and teacher and institution performance evaluation negatively, making it critical to identify these test takers. The authors propose a new nonparametric method for finding response-time thresholds for flagging item responses that result from rapid-guessing behavior. Using data from a low-stakes assessment of college-level academic skills as an illustration, the authors evaluate and compare model fit and score estimation based on data sets cleaned by both new and existing methods. Flagging rapid-guessing responses is found to generally improve model fit, item parameter estimation, and score estimation, as in the literature. This new method, based on both response time and response accuracy, shows promise in detecting rapid guessing and in improving efficiency of the flagging process when built into data analysis.

Original languageEnglish (US)
Pages (from-to)173-183
Number of pages11
JournalApplied Measurement in Education
Volume29
Issue number3
DOIs
StatePublished - Jul 2 2016
Externally publishedYes

Fingerprint

Dive into the research topics of 'A New Procedure for Detection of Students’ Rapid Guessing Responses Using Response Time'. Together they form a unique fingerprint.

Cite this