Video-based versus written situational judgment tests: A comparison in terms of predictive validity

Filip Lievens, Paul R. Sackett

Research output: Contribution to journalArticlepeer-review

107 Scopus citations

Abstract

In this study, the authors examined whether video-based situational judgment tests (SJTs) have higher predictive validity than written SJTs (keeping verbal content constant). The samples consisted of 1,159 students who completed a video-based version of an SJT and 1,750 students who completed the same SJT in a written format. The study was conducted in a high stakes testing context. The video-based version of an interpersonally oriented SJT had a lower correlation with cognitive ability than did the written version. It also had higher predictive and incremental validity for predicting interpersonally oriented criteria than did the written version. In this high stakes context, applicants also reacted relatively favorably to the SJTs, although there was no significant difference in face validity between the formats. These findings suggest that SJT format changes be made with caution and that validation evidence is needed when changes are proposed.

Original languageEnglish (US)
Pages (from-to)1181-1188
Number of pages8
JournalJournal of Applied Psychology
Volume91
Issue number5
DOIs
StatePublished - Sep 2006

Keywords

  • Predictive validity
  • Situational judgment test
  • Video

Fingerprint Dive into the research topics of 'Video-based versus written situational judgment tests: A comparison in terms of predictive validity'. Together they form a unique fingerprint.

Cite this