TY - JOUR
T1 - On reconciling conflicting meta-analytic findings regarding integrity test validity
AU - Sackett, Paul R.
AU - Schmitt, Neal
PY - 2012/12/1
Y1 - 2012/12/1
N2 - We react to the Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012a) meta-analysis of the relationship between integrity test scores and work-related criteria, the earlier Ones, Viswesvaran, and Schmidt (1993) meta-analysis of those relationships, the Harris et al. (2012) and Ones, Viswesvaran, and Schmidt (2012) responses, and the Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012b) rebuttal. We highlight differences between the findings of the 2 meta-analyses by focusing on studies that used predictive designs, applicant samples, and non-self-report criteria. We conclude that study exclusion criteria, correction for artifacts, and second order sampling error are not likely explanations for the differences in findings. The lack of detailed documentation of all effect size estimates used in either meta-analysis makes it impossible to ascertain the bases for the differences in findings. We call for increased detail in meta-analytic reporting and for better information sharing among the parties producing and meta-analytically integrating validity evidence.
AB - We react to the Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012a) meta-analysis of the relationship between integrity test scores and work-related criteria, the earlier Ones, Viswesvaran, and Schmidt (1993) meta-analysis of those relationships, the Harris et al. (2012) and Ones, Viswesvaran, and Schmidt (2012) responses, and the Van Iddekinge, Roth, Raymark, and Odle-Dusseau (2012b) rebuttal. We highlight differences between the findings of the 2 meta-analyses by focusing on studies that used predictive designs, applicant samples, and non-self-report criteria. We conclude that study exclusion criteria, correction for artifacts, and second order sampling error are not likely explanations for the differences in findings. The lack of detailed documentation of all effect size estimates used in either meta-analysis makes it impossible to ascertain the bases for the differences in findings. We call for increased detail in meta-analytic reporting and for better information sharing among the parties producing and meta-analytically integrating validity evidence.
KW - Counterproductive work behavior
KW - Integrity testing
KW - Job performance
KW - Meta-analysis
UR - http://www.scopus.com/inward/record.url?scp=84867071442&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84867071442&partnerID=8YFLogxK
U2 - 10.1037/a0028167
DO - 10.1037/a0028167
M3 - Article
C2 - 22582730
AN - SCOPUS:84867071442
SN - 0021-9010
VL - 97
SP - 550
EP - 556
JO - Journal of Applied Psychology
JF - Journal of Applied Psychology
IS - 3
ER -