Balancing Treatment and Control Groups in Quasi-Experiments: An Introduction to Propensity Scoring

Brian S. Connelly, Paul R. Sackett, Shonna D. Waters

Research output: Contribution to journalArticle

  • 5 Citations

Abstract

Organizational and applied sciences have long struggled with improving causal inference in quasi-experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in a quasi-experiment have been assigned to conditions in order to estimate treatment effects among individuals with approximately equal probabilities of receiving the treatment. If propensity scores are created from relevant covariates, matching on the propensity score makes treatment assignment ignorable and approximates a true experimental design. We illustrate how matching on the propensity score can be applied by using 2 examples: examining the effects of online instruction and estimating the benefits of preparatory coaching for the SAT. In both cases, propensity-scoring methods effectively reduced inequivalence between treatment and control groups on many variables. Propensity scoring stands out as a valuable technique capable of improving causal inference from many of organizational research's quasi-experiments.

LanguageEnglish (US)
Pages407-442
Number of pages36
JournalPersonnel Psychology
Volume66
Issue number2
DOIs
StatePublished - Jun 1 2013

Fingerprint

Propensity Score
Control Groups
Research Design
Research Personnel
Research
Propensity
Quasi-experiment
Scoring
Propensity score
Causal inference

Cite this

Balancing Treatment and Control Groups in Quasi-Experiments : An Introduction to Propensity Scoring. / Connelly, Brian S.; Sackett, Paul R.; Waters, Shonna D.

In: Personnel Psychology, Vol. 66, No. 2, 01.06.2013, p. 407-442.

Research output: Contribution to journalArticle

@article{7d2a876ce1164eada643e09b00cc972c,
title = "Balancing Treatment and Control Groups in Quasi-Experiments: An Introduction to Propensity Scoring",
abstract = "Organizational and applied sciences have long struggled with improving causal inference in quasi-experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in a quasi-experiment have been assigned to conditions in order to estimate treatment effects among individuals with approximately equal probabilities of receiving the treatment. If propensity scores are created from relevant covariates, matching on the propensity score makes treatment assignment ignorable and approximates a true experimental design. We illustrate how matching on the propensity score can be applied by using 2 examples: examining the effects of online instruction and estimating the benefits of preparatory coaching for the SAT. In both cases, propensity-scoring methods effectively reduced inequivalence between treatment and control groups on many variables. Propensity scoring stands out as a valuable technique capable of improving causal inference from many of organizational research's quasi-experiments.",
author = "Connelly, {Brian S.} and Sackett, {Paul R.} and Waters, {Shonna D.}",
year = "2013",
month = "6",
day = "1",
doi = "10.1111/peps.12020",
language = "English (US)",
volume = "66",
pages = "407--442",
journal = "Personnel Psychology",
issn = "0031-5826",
publisher = "Wiley-Blackwell",
number = "2",

}

TY - JOUR

T1 - Balancing Treatment and Control Groups in Quasi-Experiments

T2 - Personnel Psychology

AU - Connelly,Brian S.

AU - Sackett,Paul R.

AU - Waters,Shonna D.

PY - 2013/6/1

Y1 - 2013/6/1

N2 - Organizational and applied sciences have long struggled with improving causal inference in quasi-experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in a quasi-experiment have been assigned to conditions in order to estimate treatment effects among individuals with approximately equal probabilities of receiving the treatment. If propensity scores are created from relevant covariates, matching on the propensity score makes treatment assignment ignorable and approximates a true experimental design. We illustrate how matching on the propensity score can be applied by using 2 examples: examining the effects of online instruction and estimating the benefits of preparatory coaching for the SAT. In both cases, propensity-scoring methods effectively reduced inequivalence between treatment and control groups on many variables. Propensity scoring stands out as a valuable technique capable of improving causal inference from many of organizational research's quasi-experiments.

AB - Organizational and applied sciences have long struggled with improving causal inference in quasi-experiments. We introduce organizational researchers to propensity scoring, a statistical technique that has become popular in other applied sciences as a means for improving internal validity. Propensity scoring statistically models how individuals in a quasi-experiment have been assigned to conditions in order to estimate treatment effects among individuals with approximately equal probabilities of receiving the treatment. If propensity scores are created from relevant covariates, matching on the propensity score makes treatment assignment ignorable and approximates a true experimental design. We illustrate how matching on the propensity score can be applied by using 2 examples: examining the effects of online instruction and estimating the benefits of preparatory coaching for the SAT. In both cases, propensity-scoring methods effectively reduced inequivalence between treatment and control groups on many variables. Propensity scoring stands out as a valuable technique capable of improving causal inference from many of organizational research's quasi-experiments.

UR - http://www.scopus.com/inward/record.url?scp=84878136041&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84878136041&partnerID=8YFLogxK

U2 - 10.1111/peps.12020

DO - 10.1111/peps.12020

M3 - Article

VL - 66

SP - 407

EP - 442

JO - Personnel Psychology

JF - Personnel Psychology

SN - 0031-5826

IS - 2

ER -