TY - JOUR
T1 - Comparative analysis of the reliability of job performance ratings
AU - Viswesvaran, Chockalingam
AU - Ones, Deniz S.
AU - Schmidt, Frank L.
PY - 1996/10
Y1 - 1996/10
N2 - This study used meta-analytic methods to compare the interrater and intrarater reliabilities of ratings of 10 dimensions of job performance used in the literature; ratings of overall job performance were also examined. There was mixed support for the notion that some dimensions are rated more reliably than others. Supervisory ratings appear to have higher interrater reliability than peer ratings. Consistent with H. R. Rothstein (1990), mean interrater reliability of supervisory ratings of overall job performance was found to be .52. In all cases, interrater reliability is lower than intrarater reliability, indicating that the inappropriate use of intrarater reliability estimates to correct for biases from measurement error leads to biased research results. These findings have important implications for both research and practice.
AB - This study used meta-analytic methods to compare the interrater and intrarater reliabilities of ratings of 10 dimensions of job performance used in the literature; ratings of overall job performance were also examined. There was mixed support for the notion that some dimensions are rated more reliably than others. Supervisory ratings appear to have higher interrater reliability than peer ratings. Consistent with H. R. Rothstein (1990), mean interrater reliability of supervisory ratings of overall job performance was found to be .52. In all cases, interrater reliability is lower than intrarater reliability, indicating that the inappropriate use of intrarater reliability estimates to correct for biases from measurement error leads to biased research results. These findings have important implications for both research and practice.
UR - http://www.scopus.com/inward/record.url?scp=0030487832&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0030487832&partnerID=8YFLogxK
U2 - 10.1037/0021-9010.81.5.557
DO - 10.1037/0021-9010.81.5.557
M3 - Review article
AN - SCOPUS:0030487832
SN - 0021-9010
VL - 81
SP - 557
EP - 574
JO - Journal of Applied Psychology
JF - Journal of Applied Psychology
IS - 5
ER -