TY - JOUR
T1 - A New Procedure for Detection of Students’ Rapid Guessing Responses Using Response Time
AU - Guo, Hongwen
AU - Rios, Joseph
AU - Haberman, Shelby
AU - Liu, Ou Lydia
AU - Wang, Jing
AU - Paek, Insu
PY - 2016/7/2
Y1 - 2016/7/2
N2 - Unmotivated test takers using rapid guessing in item responses can affect validity studies and teacher and institution performance evaluation negatively, making it critical to identify these test takers. The authors propose a new nonparametric method for finding response-time thresholds for flagging item responses that result from rapid-guessing behavior. Using data from a low-stakes assessment of college-level academic skills as an illustration, the authors evaluate and compare model fit and score estimation based on data sets cleaned by both new and existing methods. Flagging rapid-guessing responses is found to generally improve model fit, item parameter estimation, and score estimation, as in the literature. This new method, based on both response time and response accuracy, shows promise in detecting rapid guessing and in improving efficiency of the flagging process when built into data analysis.
AB - Unmotivated test takers using rapid guessing in item responses can affect validity studies and teacher and institution performance evaluation negatively, making it critical to identify these test takers. The authors propose a new nonparametric method for finding response-time thresholds for flagging item responses that result from rapid-guessing behavior. Using data from a low-stakes assessment of college-level academic skills as an illustration, the authors evaluate and compare model fit and score estimation based on data sets cleaned by both new and existing methods. Flagging rapid-guessing responses is found to generally improve model fit, item parameter estimation, and score estimation, as in the literature. This new method, based on both response time and response accuracy, shows promise in detecting rapid guessing and in improving efficiency of the flagging process when built into data analysis.
UR - http://www.scopus.com/inward/record.url?scp=84975704339&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84975704339&partnerID=8YFLogxK
U2 - 10.1080/08957347.2016.1171766
DO - 10.1080/08957347.2016.1171766
M3 - Article
AN - SCOPUS:84975704339
SN - 0895-7347
VL - 29
SP - 173
EP - 183
JO - Applied Measurement in Education
JF - Applied Measurement in Education
IS - 3
ER -