Short forms of psychometric scales have been commonly used in educational and psychological research to reduce the burden of test administration. However, it is challenging to select items for a short form that preserve the validity and reliability of the scores of the original scale. This paper presents and evaluates multiple automated methods for scale short form creation based on metaheuristic optimization algorithms that incorporate validity criteria based on internal structure and relationships with other variables. The ant colony optimization (ACO) algorithm, tabu search (TS), simulated annealing (SA) and genetic algorithm (GA) are examined using confirmatory factor analysis (CFA) of scales with one factor, three factor, and bi-factor factorial structure. The results indicate that SA created short forms with best model fit for scales with one and three factor structures, but ACO was able to obtain highest reliability. For scales with bi-factor structure, SA provide short forms with best model fit, but TS obtained highest reliability. Overall, the SA algorithm is recommended because it produced consistently best model fit and reliability that was only slightly lower than the ACO or TS algorithms.
|Original language||English (US)|
|Title of host publication||EDM 2019 - Proceedings of the 12th International Conference on Educational Data Mining|
|Editors||Collin F. Lynch, Agathe Merceron, Michel Desmarais, Roger Nkambou|
|Publisher||International Educational Data Mining Society|
|Number of pages||6|
|State||Published - 2019|
|Event||12th International Conference on Educational Data Mining, EDM 2019 - Montreal, Canada|
Duration: Jul 2 2019 → Jul 5 2019
|Name||EDM 2019 - Proceedings of the 12th International Conference on Educational Data Mining|
|Conference||12th International Conference on Educational Data Mining, EDM 2019|
|Period||7/2/19 → 7/5/19|
Bibliographical notePublisher Copyright:
© EDM 2019 - Proceedings of the 12th International Conference on Educational Data Mining. All rights reserved.
Copyright 2020 Elsevier B.V., All rights reserved.
- Ant colony optimization
- Confirmatory factor analysis
- Genetic algorithm
- Metaheuristic algorithms
- Short form development
- Simulated annealing
- Tabu search