Generalizability of scaling gradients on direct behavior ratings

Sandra M. Chafouleas, Theodore J. Christ, T. Chris Riley-Tillman

Research output: Contribution to journalArticlepeer-review

26 Scopus citations

Abstract

Generalizability theory is used to examine the impact of scaling gradients on a single-item Direct Behavior Rating (DBR). A DBR refers to a type of rating scale used to efficiently record target behavior(s) following an observation occasion. Variance components associated with scale gradients are estimated using a random effects design for persons (p) by raters (r) by occasions (o). Data from 106 undergraduate student participants are used in the analysis. Each participant viewed and rated video clips of six elementary-aged students who were engaged in a difficult task. Participant ratings are collected three times for each of two behaviors within three scale gradient conditions (6-, 10-, 14-point scale). Scale gradient does not substantially contribute to the magnitude of observed score variances. In contrast, the largest proportions of variance are attributed to rater and error across all scale gradient conditions. Implications, limitations, and future research considerations are discussed.

Original languageEnglish (US)
Pages (from-to)157-173
Number of pages17
JournalEducational and Psychological Measurement
Volume69
Issue number1
DOIs
StatePublished - Feb 2009

Keywords

  • Dependability
  • Direct Behavior Rating
  • Generalizability
  • Rating scale
  • Scale gradients

Fingerprint

Dive into the research topics of 'Generalizability of scaling gradients on direct behavior ratings'. Together they form a unique fingerprint.

Cite this