We present a psychometric evaluation of the Cybersecurity Curriculum Assessment (CCA), completed by 193 students from seven colleges and universities. The CCA builds on our prior work developing and validating a Cybersecurity Concept Inventory (CCI), which measures students' conceptual understanding of cybersecurity after a first course in the area. The CCA deepens the conceptual complexity and technical depth expectations, assessing conceptual knowledge of students who had completed multiple courses in cybersecurity. We review our development of the CCA and present our evaluation of the instrument using Classical Test Theory and Item-Response Theory. The CCA is a difficult assessment, providing reliable measurements of student knowledge and deeper information about high-performing students.
|Original language||English (US)|
|Title of host publication||SIGCSE 2023 - Proceedings of the 54th ACM Technical Symposium on Computer Science Education|
|Publisher||Association for Computing Machinery, Inc|
|Number of pages||7|
|State||Published - Mar 2 2023|
|Event||54th ACM Technical Symposium on Computer Science Education, SIGCSE 2023 - Toronto, Canada|
Duration: Mar 15 2023 → Mar 18 2023
|Name||SIGCSE 2023 - Proceedings of the 54th ACM Technical Symposium on Computer Science Education|
|Conference||54th ACM Technical Symposium on Computer Science Education, SIGCSE 2023|
|Period||3/15/23 → 3/18/23|
Bibliographical noteFunding Information:
We thank the many people who contributed to the CATS project as Delphi experts, interview subjects, Hackathon participants, expert reviewers, student subjects, and former team members, including Michael Neary, Spencer Offenberger, Geet Parekh, Konstantinos Patsourakos, Dhananjay Phatak, and Julia Thompson. Support for this research was provided in part by the U.S. Department of Defense under CAE-R grants H98230-15-1-0294, H98230-15-1-0273, H98230-17-1-0349, H98230-17-1-0347; and by the National Science Foundation under UMBC SFS grants DGE-1241576, 1753681, and SFS Capacity Grants DGE-1819521, 1820531.
© 2023 ACM.
- classical test theory
- concept inventories
- cybersecurity assessment tools (cats)
- cybersecurity curriculum assessment
- cybersecurity education
- item response theory