Modeling Examinee Heterogeneity inÂ Discrete Option Multiple Choice Items

Nana Kim; Daniel M. Bolt; James Wollack; Yiqin Pan; Carol Eckerly; John Sowles

doi:10.1007/978-3-030-01310-3_33

Modeling Examinee Heterogeneity inÂ Discrete Option Multiple Choice Items

Nana Kim, Daniel M. Bolt, James Wollack, Yiqin Pan, Carol Eckerly, John Sowles

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

A new format for computer-based administration of multiple- choice items, the discrete option multiple choice (DOMC) item, is receiving growing attention due to potential advantages related both to item security and control of testwiseness. A unique feature of the DOMC format is the potential for an examinee to respond incorrectly to an item for different reasons—either failure to select a correct response, or selection of a distractor response. This feature motivates consideration of a new item response model that introduces an individual differences trait related to general proclivity to select response options. Using empirical data from an actual DOMC test, we validate the model by demonstrating the statistical presence of such a trait and discuss its implications for test equity in DOMC tests and the potential value for added item administration constraints.

Original language	English (US)
Title of host publication	Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018
Editors	Rianne Janssen, Jorge González, Marie Wiberg, Steven Culpepper, Dylan Molenaar
Publisher	Springer New York LLC
Pages	383-392
Number of pages	10
ISBN (Print)	9783030013097
DOIs	https://doi.org/10.1007/978-3-030-01310-3_33
State	Published - 2019
Externally published	Yes
Event	83rd Annual meeting of the Psychometric Society, 2018 - New York, United States Duration: Jul 9 2018 → Jul 13 2018

Publication series

Name	Springer Proceedings in Mathematics and Statistics
Volume	265
ISSN (Print)	2194-1009
ISSN (Electronic)	2194-1017

Conference

Conference	83rd Annual meeting of the Psychometric Society, 2018
Country/Territory	United States
City	New York
Period	7/9/18 → 7/13/18

Bibliographical note

Publisher Copyright:
© 2019, Springer Nature Switzerland AG.

Keywords

Computer-based testing
Discrete option multiple-choice items
Item response model

Publisher link

10.1007/978-3-030-01310-3_33

Find It

Find It at U of M Libraries

Cite this

Kim, N., Bolt, D. M., Wollack, J., Pan, Y., Eckerly, C., & Sowles, J. (2019). Modeling Examinee Heterogeneity inÂ Discrete Option Multiple Choice Items. In R. Janssen, J. González, M. Wiberg, S. Culpepper, & D. Molenaar (Eds.), Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018 (pp. 383-392). (Springer Proceedings in Mathematics and Statistics; Vol. 265). Springer New York LLC. https://doi.org/10.1007/978-3-030-01310-3_33

Modeling Examinee Heterogeneity inÂ Discrete Option Multiple Choice Items. / Kim, Nana; Bolt, Daniel M.; Wollack, James et al.
Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. ed. / Rianne Janssen; Jorge González; Marie Wiberg; Steven Culpepper; Dylan Molenaar. Springer New York LLC, 2019. p. 383-392 (Springer Proceedings in Mathematics and Statistics; Vol. 265).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kim, N, Bolt, DM, Wollack, J, Pan, Y, Eckerly, C & Sowles, J 2019, Modeling Examinee Heterogeneity inÂ Discrete Option Multiple Choice Items. in R Janssen, J González, M Wiberg, S Culpepper & D Molenaar (eds), Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. Springer Proceedings in Mathematics and Statistics, vol. 265, Springer New York LLC, pp. 383-392, 83rd Annual meeting of the Psychometric Society, 2018, New York, United States, 7/9/18. https://doi.org/10.1007/978-3-030-01310-3_33

Kim N, Bolt DM, Wollack J, Pan Y, Eckerly C, Sowles J. Modeling Examinee Heterogeneity inÂ Discrete Option Multiple Choice Items. In Janssen R, González J, Wiberg M, Culpepper S, Molenaar D, editors, Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. Springer New York LLC. 2019. p. 383-392. (Springer Proceedings in Mathematics and Statistics). doi: 10.1007/978-3-030-01310-3_33

Kim, Nana ; Bolt, Daniel M. ; Wollack, James et al. / Modeling Examinee Heterogeneity inÂ Discrete Option Multiple Choice Items. Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018. editor / Rianne Janssen ; Jorge González ; Marie Wiberg ; Steven Culpepper ; Dylan Molenaar. Springer New York LLC, 2019. pp. 383-392 (Springer Proceedings in Mathematics and Statistics).

@inproceedings{f6119befc15f408f83c6b1172deae7e2,

title = "Modeling Examinee Heterogeneity in{\^A} Discrete Option Multiple Choice Items",

abstract = "A new format for computer-based administration of multiple- choice items, the discrete option multiple choice (DOMC) item, is receiving growing attention due to potential advantages related both to item security and control of testwiseness. A unique feature of the DOMC format is the potential for an examinee to respond incorrectly to an item for different reasons—either failure to select a correct response, or selection of a distractor response. This feature motivates consideration of a new item response model that introduces an individual differences trait related to general proclivity to select response options. Using empirical data from an actual DOMC test, we validate the model by demonstrating the statistical presence of such a trait and discuss its implications for test equity in DOMC tests and the potential value for added item administration constraints.",

keywords = "Computer-based testing, Discrete option multiple-choice items, Item response model",

author = "Nana Kim and Bolt, {Daniel M.} and James Wollack and Yiqin Pan and Carol Eckerly and John Sowles",

note = "Publisher Copyright: {\textcopyright} 2019, Springer Nature Switzerland AG.; 83rd Annual meeting of the Psychometric Society, 2018 ; Conference date: 09-07-2018 Through 13-07-2018",

year = "2019",

doi = "10.1007/978-3-030-01310-3_33",

language = "English (US)",

isbn = "9783030013097",

series = "Springer Proceedings in Mathematics and Statistics",

publisher = "Springer New York LLC",

pages = "383--392",

editor = "Rianne Janssen and Jorge Gonz{\'a}lez and Marie Wiberg and Steven Culpepper and Dylan Molenaar",

booktitle = "Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018",

}

TY - GEN

T1 - Modeling Examinee Heterogeneity inÂ Discrete Option Multiple Choice Items

AU - Kim, Nana

AU - Bolt, Daniel M.

AU - Wollack, James

AU - Pan, Yiqin

AU - Eckerly, Carol

AU - Sowles, John

PY - 2019

Y1 - 2019

N2 - A new format for computer-based administration of multiple- choice items, the discrete option multiple choice (DOMC) item, is receiving growing attention due to potential advantages related both to item security and control of testwiseness. A unique feature of the DOMC format is the potential for an examinee to respond incorrectly to an item for different reasons—either failure to select a correct response, or selection of a distractor response. This feature motivates consideration of a new item response model that introduces an individual differences trait related to general proclivity to select response options. Using empirical data from an actual DOMC test, we validate the model by demonstrating the statistical presence of such a trait and discuss its implications for test equity in DOMC tests and the potential value for added item administration constraints.

AB - A new format for computer-based administration of multiple- choice items, the discrete option multiple choice (DOMC) item, is receiving growing attention due to potential advantages related both to item security and control of testwiseness. A unique feature of the DOMC format is the potential for an examinee to respond incorrectly to an item for different reasons—either failure to select a correct response, or selection of a distractor response. This feature motivates consideration of a new item response model that introduces an individual differences trait related to general proclivity to select response options. Using empirical data from an actual DOMC test, we validate the model by demonstrating the statistical presence of such a trait and discuss its implications for test equity in DOMC tests and the potential value for added item administration constraints.

KW - Computer-based testing

KW - Discrete option multiple-choice items

KW - Item response model

UR - http://www.scopus.com/inward/record.url?scp=85066110194&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066110194&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01310-3_33

DO - 10.1007/978-3-030-01310-3_33

M3 - Conference contribution

AN - SCOPUS:85066110194

SN - 9783030013097

T3 - Springer Proceedings in Mathematics and Statistics

SP - 383

EP - 392

BT - Quantitative Psychology - 83rd Annual Meeting of the Psychometric Society, 2018

A2 - Janssen, Rianne

A2 - González, Jorge

A2 - Wiberg, Marie

A2 - Culpepper, Steven

A2 - Molenaar, Dylan

PB - Springer New York LLC

T2 - 83rd Annual meeting of the Psychometric Society, 2018

Y2 - 9 July 2018 through 13 July 2018

ER -