All Validities are Not Created Equal: Determinants of Variation in SAT Validity Across Schools

Winny Shen, Paul R Sackett, Nathan R Kuncel, Adam S. Beatty, Jana L. Rigdon, Thomas B. Kiger

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

Previous research has demonstrated that cognitive test validities are generalizable and predictive of academic performance across situations. However, even after accounting for statistical artifacts (e.g., sampling error, range restriction, criterion reliability), substantial variability often remains around estimates of cognitive test-performance relationships suggesting the presence of additional moderators. In the present study, we examine the sources of institutional variation in Scholastic Aptitude Test (SAT) validity across a sample of 110 institutions. Institutional characteristics moderated the size of SAT validities, such that more selective schools and schools that emphasize traditional assessment techniques (i.e., school records, standardized tests) showed higher SAT validities while schools that were larger and where students demonstrated more financial need, schools that emphasized the usage of alternative assessment techniques (i.e., essays, letters of recommendations, extracurricular activities), and schools that enrolled higher percentages of historically disadvantaged minority students generally exhibited lower SAT validities. Future directions in the understanding of situational influences on SAT-grade point average validities are discussed.

Original languageEnglish (US)
Pages (from-to)197-219
Number of pages23
JournalApplied Measurement in Education
Volume25
Issue number3
DOIs
StatePublished - Jul 2012

Bibliographical note

Funding Information:
This research was supported by a grant from The College Board to Paul Sackett and Nathan Kuncell, and was derived from data provided by The College Board. The data are copyright © 2006–2008 from The College Board.

Copyright:
Copyright 2012 Elsevier B.V., All rights reserved.

Fingerprint Dive into the research topics of 'All Validities are Not Created Equal: Determinants of Variation in SAT Validity Across Schools'. Together they form a unique fingerprint.

Cite this