On the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived From Response Times Collected in Computerized Testing

Mark L. Davison; Robert Semmes; Lan Huang; Catherine N. Close

doi:10.1177/0013164411408412

On the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived From Response Times Collected in Computerized Testing

Mark L. Davison, Robert Semmes, Lan Huang, Catherine N. Close

Educational Psychology

Research output: Contribution to journal › Article › peer-review

15 Scopus citations

Abstract

Data from 181 college students were used to assess whether math reasoning item response times in computerized testing can provide valid and reliable measures of a speed dimension. The alternate forms reliability of the speed dimension was. 85. A two-dimensional structural equation model suggests that the speed dimension is related to the accuracy of speeded responses. Speed factor scores were significantly correlated with performance on the ACT math scale. Results suggest that the speed dimension underlying response times can be reliably measured and that the dimension is related to the accuracy of performance under the pressure of time limits.

Original language	English (US)
Pages (from-to)	245-263
Number of pages	19
Journal	Educational and Psychological Measurement
Volume	72
Issue number	2
DOIs	https://doi.org/10.1177/0013164411408412
State	Published - Apr 2012

Bibliographical note

Funding Information:
The author(s) received financial support for the research, authorship, and/or publication of this article from a United States Army Research Institute for the Behavioral and Social Sciences contract award number 1435-04-03-CT-74083 (Mark L. Davison) and by Grant No. R305C050059 from the Institute of Education Sciences in the U.S. Department of Education.

Keywords

item response theory
mathematical reasoning
reasoning speed
reliability
response latencies
structural equation model

Publisher link

10.1177/0013164411408412

Find It

Find It at U of M Libraries

Cite this

@article{82e9f7872aed4ca789cfd8b9f9dcb407,

title = "On the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived From Response Times Collected in Computerized Testing",

abstract = "Data from 181 college students were used to assess whether math reasoning item response times in computerized testing can provide valid and reliable measures of a speed dimension. The alternate forms reliability of the speed dimension was. 85. A two-dimensional structural equation model suggests that the speed dimension is related to the accuracy of speeded responses. Speed factor scores were significantly correlated with performance on the ACT math scale. Results suggest that the speed dimension underlying response times can be reliably measured and that the dimension is related to the accuracy of performance under the pressure of time limits.",

keywords = "item response theory, mathematical reasoning, reasoning speed, reliability, response latencies, structural equation model",

author = "Davison, {Mark L.} and Robert Semmes and Lan Huang and Close, {Catherine N.}",

note = "Funding Information: The author(s) received financial support for the research, authorship, and/or publication of this article from a United States Army Research Institute for the Behavioral and Social Sciences contract award number 1435-04-03-CT-74083 (Mark L. Davison) and by Grant No. R305C050059 from the Institute of Education Sciences in the U.S. Department of Education.",

year = "2012",

month = apr,

doi = "10.1177/0013164411408412",

language = "English (US)",

volume = "72",

pages = "245--263",

journal = "Educational and Psychological Measurement",

issn = "0013-1644",

publisher = "SAGE Publications Inc.",

number = "2",

}

TY - JOUR

T1 - On the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived From Response Times Collected in Computerized Testing

AU - Davison, Mark L.

AU - Semmes, Robert

AU - Huang, Lan

AU - Close, Catherine N.

N1 - Funding Information: The author(s) received financial support for the research, authorship, and/or publication of this article from a United States Army Research Institute for the Behavioral and Social Sciences contract award number 1435-04-03-CT-74083 (Mark L. Davison) and by Grant No. R305C050059 from the Institute of Education Sciences in the U.S. Department of Education.

PY - 2012/4

Y1 - 2012/4

N2 - Data from 181 college students were used to assess whether math reasoning item response times in computerized testing can provide valid and reliable measures of a speed dimension. The alternate forms reliability of the speed dimension was. 85. A two-dimensional structural equation model suggests that the speed dimension is related to the accuracy of speeded responses. Speed factor scores were significantly correlated with performance on the ACT math scale. Results suggest that the speed dimension underlying response times can be reliably measured and that the dimension is related to the accuracy of performance under the pressure of time limits.

AB - Data from 181 college students were used to assess whether math reasoning item response times in computerized testing can provide valid and reliable measures of a speed dimension. The alternate forms reliability of the speed dimension was. 85. A two-dimensional structural equation model suggests that the speed dimension is related to the accuracy of speeded responses. Speed factor scores were significantly correlated with performance on the ACT math scale. Results suggest that the speed dimension underlying response times can be reliably measured and that the dimension is related to the accuracy of performance under the pressure of time limits.

KW - item response theory

KW - mathematical reasoning

KW - reasoning speed

KW - reliability

KW - response latencies

KW - structural equation model

UR - http://www.scopus.com/inward/record.url?scp=84859067241&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84859067241&partnerID=8YFLogxK

U2 - 10.1177/0013164411408412

DO - 10.1177/0013164411408412

M3 - Article

AN - SCOPUS:84859067241

SN - 0013-1644

VL - 72

SP - 245

EP - 263

JO - Educational and Psychological Measurement

JF - Educational and Psychological Measurement

IS - 2

ER -

On the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived From Response Times Collected in Computerized Testing

Abstract

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this