Termination Criteria for Grid Multiclassification Adaptive Testing With Multidimensional Polytomous Items

Zhuoran Wang; Chun Wang; David J. Weiss

doi:10.1177/01466216221108383

Termination Criteria for Grid Multiclassification Adaptive Testing With Multidimensional Polytomous Items

Zhuoran Wang, Chun Wang, David J. Weiss

Psychology (Twin Cities)

Research output: Contribution to journal › Article › peer-review

Abstract

Adaptive classification testing (ACT) is a variation of computerized adaptive testing (CAT) that is developed to efficiently classify examinees into multiple groups based on predetermined cutoffs. In multidimensional multiclassification (i.e., more than two categories exist along each dimension), grid classification is proposed to classify each examinee into one of the grids encircled by cutoffs (lines/surfaces) along different dimensions so as to provide clearer information regarding an examinee’s relative standing along each dimension and facilitate subsequent treatment and intervention. In this article, the sequential probability ratio test (SPRT) and confidence interval method were implemented in the grid multiclassification ACT. In addition, two new termination criteria, the grid classification generalized likelihood ratio (GGLR) and simplified grid classification generalized likelihood ratio were proposed for grid multiclassification ACT. Simulation studies, using a simulated item bank, and a real item bank with polytomous multidimensional items, show that grid multiclassification ACT is more efficient than classification based on measurement CAT that focuses on trait estimate precision. In the context of a high-quality bank, GGLR was found to most efficiently terminate the grid multiclassification ACT and classify examinees.

Original language	English (US)
Pages (from-to)	551-570
Number of pages	20
Journal	Applied Psychological Measurement
Volume	46
Issue number	7
DOIs	https://doi.org/10.1177/01466216221108383
State	Published - Oct 2022

Bibliographical note

Funding Information:
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by Institute of Education Sciences under Award Number R305D200015 to the University of Washington and the Eunice Kennedy Shriver National Institutes of Child Health and Human Development of the National Institutes of Health under Award Number R01HD079439 to the Mayo Clinic in Rochester Minnesota through subcontracts to the University of Minnesota and the University of Washington. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Publisher Copyright:
© The Author(s) 2022.

Keywords

adaptive classification testing
computerized adaptive testing
grid multiclassification
polytomous items
sequential probability ratio test, termination criteria

PubMed: MeSH publication types

Journal Article

Publisher link

10.1177/01466216221108383

Find It

Find It at U of M Libraries

Cite this

@article{cf81bba214cd47b6a368317dda0219f3,

title = "Termination Criteria for Grid Multiclassification Adaptive Testing With Multidimensional Polytomous Items",

abstract = "Adaptive classification testing (ACT) is a variation of computerized adaptive testing (CAT) that is developed to efficiently classify examinees into multiple groups based on predetermined cutoffs. In multidimensional multiclassification (i.e., more than two categories exist along each dimension), grid classification is proposed to classify each examinee into one of the grids encircled by cutoffs (lines/surfaces) along different dimensions so as to provide clearer information regarding an examinee{\textquoteright}s relative standing along each dimension and facilitate subsequent treatment and intervention. In this article, the sequential probability ratio test (SPRT) and confidence interval method were implemented in the grid multiclassification ACT. In addition, two new termination criteria, the grid classification generalized likelihood ratio (GGLR) and simplified grid classification generalized likelihood ratio were proposed for grid multiclassification ACT. Simulation studies, using a simulated item bank, and a real item bank with polytomous multidimensional items, show that grid multiclassification ACT is more efficient than classification based on measurement CAT that focuses on trait estimate precision. In the context of a high-quality bank, GGLR was found to most efficiently terminate the grid multiclassification ACT and classify examinees.",

keywords = "adaptive classification testing, computerized adaptive testing, grid multiclassification, polytomous items, sequential probability ratio test, termination criteria",

author = "Zhuoran Wang and Chun Wang and Weiss, {David J.}",

note = "Funding Information: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by Institute of Education Sciences under Award Number R305D200015 to the University of Washington and the Eunice Kennedy Shriver National Institutes of Child Health and Human Development of the National Institutes of Health under Award Number R01HD079439 to the Mayo Clinic in Rochester Minnesota through subcontracts to the University of Minnesota and the University of Washington. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Publisher Copyright: {\textcopyright} The Author(s) 2022.",

year = "2022",

month = oct,

doi = "10.1177/01466216221108383",

language = "English (US)",

volume = "46",

pages = "551--570",

journal = "Applied Psychological Measurement",

issn = "0146-6216",

publisher = "Sage Publications Sage CA: Los Angeles, CA",

number = "7",

}

TY - JOUR

T1 - Termination Criteria for Grid Multiclassification Adaptive Testing With Multidimensional Polytomous Items

AU - Wang, Zhuoran

AU - Wang, Chun

AU - Weiss, David J.

N1 - Funding Information: The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by Institute of Education Sciences under Award Number R305D200015 to the University of Washington and the Eunice Kennedy Shriver National Institutes of Child Health and Human Development of the National Institutes of Health under Award Number R01HD079439 to the Mayo Clinic in Rochester Minnesota through subcontracts to the University of Minnesota and the University of Washington. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Publisher Copyright: © The Author(s) 2022.

PY - 2022/10

Y1 - 2022/10

N2 - Adaptive classification testing (ACT) is a variation of computerized adaptive testing (CAT) that is developed to efficiently classify examinees into multiple groups based on predetermined cutoffs. In multidimensional multiclassification (i.e., more than two categories exist along each dimension), grid classification is proposed to classify each examinee into one of the grids encircled by cutoffs (lines/surfaces) along different dimensions so as to provide clearer information regarding an examinee’s relative standing along each dimension and facilitate subsequent treatment and intervention. In this article, the sequential probability ratio test (SPRT) and confidence interval method were implemented in the grid multiclassification ACT. In addition, two new termination criteria, the grid classification generalized likelihood ratio (GGLR) and simplified grid classification generalized likelihood ratio were proposed for grid multiclassification ACT. Simulation studies, using a simulated item bank, and a real item bank with polytomous multidimensional items, show that grid multiclassification ACT is more efficient than classification based on measurement CAT that focuses on trait estimate precision. In the context of a high-quality bank, GGLR was found to most efficiently terminate the grid multiclassification ACT and classify examinees.

AB - Adaptive classification testing (ACT) is a variation of computerized adaptive testing (CAT) that is developed to efficiently classify examinees into multiple groups based on predetermined cutoffs. In multidimensional multiclassification (i.e., more than two categories exist along each dimension), grid classification is proposed to classify each examinee into one of the grids encircled by cutoffs (lines/surfaces) along different dimensions so as to provide clearer information regarding an examinee’s relative standing along each dimension and facilitate subsequent treatment and intervention. In this article, the sequential probability ratio test (SPRT) and confidence interval method were implemented in the grid multiclassification ACT. In addition, two new termination criteria, the grid classification generalized likelihood ratio (GGLR) and simplified grid classification generalized likelihood ratio were proposed for grid multiclassification ACT. Simulation studies, using a simulated item bank, and a real item bank with polytomous multidimensional items, show that grid multiclassification ACT is more efficient than classification based on measurement CAT that focuses on trait estimate precision. In the context of a high-quality bank, GGLR was found to most efficiently terminate the grid multiclassification ACT and classify examinees.

KW - adaptive classification testing

KW - computerized adaptive testing

KW - grid multiclassification

KW - polytomous items

KW - sequential probability ratio test, termination criteria

UR - http://www.scopus.com/inward/record.url?scp=85132420755&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85132420755&partnerID=8YFLogxK

U2 - 10.1177/01466216221108383

DO - 10.1177/01466216221108383

M3 - Article

C2 - 36131841

AN - SCOPUS:85132420755

SN - 0146-6216

VL - 46

SP - 551

EP - 570

JO - Applied Psychological Measurement

JF - Applied Psychological Measurement

IS - 7

ER -

Termination Criteria for Grid Multiclassification Adaptive Testing With Multidimensional Polytomous Items

Abstract

Bibliographical note

Keywords

PubMed: MeSH publication types

Publisher link

Find It

Other files and links

Fingerprint

Cite this