Direct Behavior Rating Instrumentation: Evaluating the Impact of Scale Formats

Wendy M. Reinke, Keith C. Herman, Faith G Miller, T. Chris Riley-Tillman, Sandra M. Chafouleas, Alyssa A. Schardt

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

The purpose of this study was to investigate the impact of two different Direct Behavior Rating-Single Item Scale (DBR-SIS) formats on rating accuracy. A total of 119 undergraduate students participated in one of two study conditions, each utilizing a different DBR-SIS scale format: one that included percentage of time anchors on the DBR-SIS scale and an explicit reference to duration of the target behavior (percent group) and one that did not include percentage anchors nor a reference to duration of the target behavior (no percent group). Participants viewed nine brief video clips and rated student behavior using one of the two DBR-SIS formats. Rating accuracy was determined by calculating the absolute difference between participant ratings and two criterion measures: systematic direct observation scores and DBR-SIS expert ratings. Statistically significant differences between groups were found on only two occasions, pertaining to ratings of academically engaged behavior. Limitations and directions for future research are discussed.

Original languageEnglish (US)
Pages (from-to)119-126
Number of pages8
JournalAssessment for Effective Intervention
Volume42
Issue number2
DOIs
StatePublished - Mar 1 2017

Fingerprint

rating
Students
Surgical Instruments
Observation
study conditions
video clip
Group
student
Direction compound
expert

Keywords

  • accuracy
  • assessment
  • behavior
  • direct behavior ratings

Cite this

Reinke, W. M., Herman, K. C., Miller, F. G., Riley-Tillman, T. C., Chafouleas, S. M., & Schardt, A. A. (2017). Direct Behavior Rating Instrumentation: Evaluating the Impact of Scale Formats. Assessment for Effective Intervention, 42(2), 119-126. https://doi.org/10.1177/1534508416658007

Direct Behavior Rating Instrumentation : Evaluating the Impact of Scale Formats. / Reinke, Wendy M.; Herman, Keith C.; Miller, Faith G; Riley-Tillman, T. Chris; Chafouleas, Sandra M.; Schardt, Alyssa A.

In: Assessment for Effective Intervention, Vol. 42, No. 2, 01.03.2017, p. 119-126.

Research output: Contribution to journalArticle

Reinke, WM, Herman, KC, Miller, FG, Riley-Tillman, TC, Chafouleas, SM & Schardt, AA 2017, 'Direct Behavior Rating Instrumentation: Evaluating the Impact of Scale Formats', Assessment for Effective Intervention, vol. 42, no. 2, pp. 119-126. https://doi.org/10.1177/1534508416658007
Reinke, Wendy M. ; Herman, Keith C. ; Miller, Faith G ; Riley-Tillman, T. Chris ; Chafouleas, Sandra M. ; Schardt, Alyssa A. / Direct Behavior Rating Instrumentation : Evaluating the Impact of Scale Formats. In: Assessment for Effective Intervention. 2017 ; Vol. 42, No. 2. pp. 119-126.
@article{d90ffc6c093a4448b8e11df85f406de2,
title = "Direct Behavior Rating Instrumentation: Evaluating the Impact of Scale Formats",
abstract = "The purpose of this study was to investigate the impact of two different Direct Behavior Rating-Single Item Scale (DBR-SIS) formats on rating accuracy. A total of 119 undergraduate students participated in one of two study conditions, each utilizing a different DBR-SIS scale format: one that included percentage of time anchors on the DBR-SIS scale and an explicit reference to duration of the target behavior (percent group) and one that did not include percentage anchors nor a reference to duration of the target behavior (no percent group). Participants viewed nine brief video clips and rated student behavior using one of the two DBR-SIS formats. Rating accuracy was determined by calculating the absolute difference between participant ratings and two criterion measures: systematic direct observation scores and DBR-SIS expert ratings. Statistically significant differences between groups were found on only two occasions, pertaining to ratings of academically engaged behavior. Limitations and directions for future research are discussed.",
keywords = "accuracy, assessment, behavior, direct behavior ratings",
author = "Reinke, {Wendy M.} and Herman, {Keith C.} and Miller, {Faith G} and Riley-Tillman, {T. Chris} and Chafouleas, {Sandra M.} and Schardt, {Alyssa A.}",
year = "2017",
month = "3",
day = "1",
doi = "10.1177/1534508416658007",
language = "English (US)",
volume = "42",
pages = "119--126",
journal = "Assessment for Effective Intervention",
issn = "1534-5084",
publisher = "Council for Exceptional Children, Council for Educational Diagnostic Services",
number = "2",

}

TY - JOUR

T1 - Direct Behavior Rating Instrumentation

T2 - Evaluating the Impact of Scale Formats

AU - Reinke, Wendy M.

AU - Herman, Keith C.

AU - Miller, Faith G

AU - Riley-Tillman, T. Chris

AU - Chafouleas, Sandra M.

AU - Schardt, Alyssa A.

PY - 2017/3/1

Y1 - 2017/3/1

N2 - The purpose of this study was to investigate the impact of two different Direct Behavior Rating-Single Item Scale (DBR-SIS) formats on rating accuracy. A total of 119 undergraduate students participated in one of two study conditions, each utilizing a different DBR-SIS scale format: one that included percentage of time anchors on the DBR-SIS scale and an explicit reference to duration of the target behavior (percent group) and one that did not include percentage anchors nor a reference to duration of the target behavior (no percent group). Participants viewed nine brief video clips and rated student behavior using one of the two DBR-SIS formats. Rating accuracy was determined by calculating the absolute difference between participant ratings and two criterion measures: systematic direct observation scores and DBR-SIS expert ratings. Statistically significant differences between groups were found on only two occasions, pertaining to ratings of academically engaged behavior. Limitations and directions for future research are discussed.

AB - The purpose of this study was to investigate the impact of two different Direct Behavior Rating-Single Item Scale (DBR-SIS) formats on rating accuracy. A total of 119 undergraduate students participated in one of two study conditions, each utilizing a different DBR-SIS scale format: one that included percentage of time anchors on the DBR-SIS scale and an explicit reference to duration of the target behavior (percent group) and one that did not include percentage anchors nor a reference to duration of the target behavior (no percent group). Participants viewed nine brief video clips and rated student behavior using one of the two DBR-SIS formats. Rating accuracy was determined by calculating the absolute difference between participant ratings and two criterion measures: systematic direct observation scores and DBR-SIS expert ratings. Statistically significant differences between groups were found on only two occasions, pertaining to ratings of academically engaged behavior. Limitations and directions for future research are discussed.

KW - accuracy

KW - assessment

KW - behavior

KW - direct behavior ratings

UR - http://www.scopus.com/inward/record.url?scp=85011797667&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85011797667&partnerID=8YFLogxK

U2 - 10.1177/1534508416658007

DO - 10.1177/1534508416658007

M3 - Article

AN - SCOPUS:85011797667

VL - 42

SP - 119

EP - 126

JO - Assessment for Effective Intervention

JF - Assessment for Effective Intervention

SN - 1534-5084

IS - 2

ER -