Abstract
Some previous studies suggest that response times (RTs) on rating scale items can be informative about the content trait, but a more recent study suggests they may also be reflective of response styles. The latter result raises questions about the possible consideration of RTs for content trait estimation, as response styles are generally viewed as nuisance dimensions in the measurement of noncognitive constructs. In this article, we extend previous work exploring the simultaneous relevance of content and response style traits on RTs in self-report rating scale measurement by examining psychometric differences related to fast versus slow item responses. Following a parallel methodology applied with cognitive measures, we provide empirical illustrations of how RTs appear to be simultaneously reflective of both content and response style traits. Our results demonstrate that respondents may exhibit different response behaviors for fast versus slow responses and that both the content trait and response styles are relevant to such heterogeneity. These findings suggest that using RTs as a basis for improving the estimation of noncognitive constructs likely requires simultaneously attending to the effects of response styles.
Original language | English (US) |
---|---|
Pages (from-to) | 565-594 |
Number of pages | 30 |
Journal | Journal of Educational and Behavioral Statistics |
Volume | 49 |
Issue number | 4 |
DOIs | |
State | Published - Aug 2024 |
Bibliographical note
Publisher Copyright:© 2023 AERA.
Keywords
- Likert-type rating scales
- multidimensional nominal response model
- noncognitive assessments
- response styles
- response times