Abstract
Cognitive diagnosis models (CDMs) have been used as psychometric tools in educational assessments to estimate students' strengths and weaknesses in terms of cognitive skills learned and skills that need study. In practice, it is not uncommon that questions can often be solved using more than one strategy, which requires CDMs capable of accommodating multiple strategies. However, existing parametric multi-strategy CDMs need a large sample size to produce a reliable estimation of item parameters and examinees' proficiency class memberships, which obstructs their practical applications. This article proposes a general nonparametric multi-strategy classification method with promising classification accuracy in small samples for dichotomous response data. The method can accommodate different strategy selection approaches and different condensation rules. Simulation studies showed that the proposed method outperformed the parametric CDMs when sample sizes were small. A set of real data was analyzed as well to illustrate the application of the proposed method in practice.
Original language | English (US) |
---|---|
Pages (from-to) | 723-735 |
Number of pages | 13 |
Journal | Behavior Research Methods |
Volume | 56 |
Issue number | 2 |
DOIs | |
State | Published - Feb 2024 |
Externally published | Yes |
Bibliographical note
Publisher Copyright:© 2023, The Psychonomic Society, Inc.
Keywords
- Cognitive diagnosis models
- Cognitive diagnostic assessment
- General nonparametric classification method
- Multiple strategies
- Strategy selection approaches
PubMed: MeSH publication types
- Journal Article
- Research Support, Non-U.S. Gov't