TY - JOUR
T1 - The other side of method bias
T2 - The perils of distinct source research designs
AU - Kammeyer-Mueller, John
AU - Steel, Piers D.G.
AU - Rubenstein, Alex
PY - 2010/3
Y1 - 2010/3
N2 - Common source bias has been the focus of much attention. To minimize the problem, researchers have sometimes been advised to take measurements of predictors from one observer and measurements of outcomes from another observer or to use separate occasions of measurement. We propose that these efforts to eliminate biases due to common source variance create serious problems. To demonstrate the problems of using what we term the "distinct sources" measurement design, we provide an integrative review of the literature regarding both contamination and deficiency of measures. Building on this theme, the article uses simulated data to demonstrate how using data from distinct observers or occasions of measurement can distort estimates of predictor importance at least as much as common source variance. Alternative multisource designs are advocated and examined for tractability by simulating various numbers of observations and sources in the research design.
AB - Common source bias has been the focus of much attention. To minimize the problem, researchers have sometimes been advised to take measurements of predictors from one observer and measurements of outcomes from another observer or to use separate occasions of measurement. We propose that these efforts to eliminate biases due to common source variance create serious problems. To demonstrate the problems of using what we term the "distinct sources" measurement design, we provide an integrative review of the literature regarding both contamination and deficiency of measures. Building on this theme, the article uses simulated data to demonstrate how using data from distinct observers or occasions of measurement can distort estimates of predictor importance at least as much as common source variance. Alternative multisource designs are advocated and examined for tractability by simulating various numbers of observations and sources in the research design.
UR - http://www.scopus.com/inward/record.url?scp=77953660789&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77953660789&partnerID=8YFLogxK
U2 - 10.1080/00273171003680278
DO - 10.1080/00273171003680278
M3 - Article
AN - SCOPUS:77953660789
SN - 0027-3171
VL - 45
SP - 294
EP - 321
JO - Multivariate Behavioral Research
JF - Multivariate Behavioral Research
IS - 2
ER -