Preliminary Investigation of the Impact of a Web-Based Module on Direct Behavior Rating Accuracy

Sandra M. Chafouleas, T. Chris Riley-Tillman, Rose Jaffery, Faith G Miller, Sayward E. Harrison

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

The purpose of this study was to provide initial evaluation of a web-based training module on rating accuracy when using Direct Behavior Rating (DBR). Components of the training module included (a) an overview familiarizing users with assessing student behavior with this method, (b) modeling that includes frame-of-reference training, and (c) multiple opportunities to practice and receive immediate corrective feedback. Participants included 90 undergraduate students assigned to one of six sessions (three experimental and three control). Rating accuracy served as the outcome measure defined as the difference between the rater score and a comparison derived from an expert DBR or systematic direct observation (SDO) score. Rating targets included academically engaged, disruptive, and respectful behavior. Completion of the DBR training module generally yielded ratings that more closely compared with the scores obtained via DBR experts and SDO, yet specific results were mixed across type of rating (i.e., behavior target and duration) and comparison (i.e., DBR expert and SDO). Limitations, future research directions, and implications for practice are discussed.

Original languageEnglish (US)
Pages (from-to)92-104
Number of pages13
JournalSchool Mental Health
Volume7
Issue number2
DOIs
StatePublished - Jun 1 2015

Fingerprint

rating
Observation
expert
Students
Outcome Assessment (Health Care)
student
evaluation

Keywords

  • Behavior assessment
  • Direct Behavior Rating
  • Rater accuracy
  • Teacher training

Cite this

Preliminary Investigation of the Impact of a Web-Based Module on Direct Behavior Rating Accuracy. / Chafouleas, Sandra M.; Riley-Tillman, T. Chris; Jaffery, Rose; Miller, Faith G; Harrison, Sayward E.

In: School Mental Health, Vol. 7, No. 2, 01.06.2015, p. 92-104.

Research output: Contribution to journalArticle

Chafouleas, Sandra M. ; Riley-Tillman, T. Chris ; Jaffery, Rose ; Miller, Faith G ; Harrison, Sayward E. / Preliminary Investigation of the Impact of a Web-Based Module on Direct Behavior Rating Accuracy. In: School Mental Health. 2015 ; Vol. 7, No. 2. pp. 92-104.
@article{5d3530108c75477caf1beee185da010c,
title = "Preliminary Investigation of the Impact of a Web-Based Module on Direct Behavior Rating Accuracy",
abstract = "The purpose of this study was to provide initial evaluation of a web-based training module on rating accuracy when using Direct Behavior Rating (DBR). Components of the training module included (a) an overview familiarizing users with assessing student behavior with this method, (b) modeling that includes frame-of-reference training, and (c) multiple opportunities to practice and receive immediate corrective feedback. Participants included 90 undergraduate students assigned to one of six sessions (three experimental and three control). Rating accuracy served as the outcome measure defined as the difference between the rater score and a comparison derived from an expert DBR or systematic direct observation (SDO) score. Rating targets included academically engaged, disruptive, and respectful behavior. Completion of the DBR training module generally yielded ratings that more closely compared with the scores obtained via DBR experts and SDO, yet specific results were mixed across type of rating (i.e., behavior target and duration) and comparison (i.e., DBR expert and SDO). Limitations, future research directions, and implications for practice are discussed.",
keywords = "Behavior assessment, Direct Behavior Rating, Rater accuracy, Teacher training",
author = "Chafouleas, {Sandra M.} and Riley-Tillman, {T. Chris} and Rose Jaffery and Miller, {Faith G} and Harrison, {Sayward E.}",
year = "2015",
month = "6",
day = "1",
doi = "10.1007/s12310-014-9130-z",
language = "English (US)",
volume = "7",
pages = "92--104",
journal = "School Mental Health",
issn = "1866-2625",
publisher = "Springer New York",
number = "2",

}

TY - JOUR

T1 - Preliminary Investigation of the Impact of a Web-Based Module on Direct Behavior Rating Accuracy

AU - Chafouleas, Sandra M.

AU - Riley-Tillman, T. Chris

AU - Jaffery, Rose

AU - Miller, Faith G

AU - Harrison, Sayward E.

PY - 2015/6/1

Y1 - 2015/6/1

N2 - The purpose of this study was to provide initial evaluation of a web-based training module on rating accuracy when using Direct Behavior Rating (DBR). Components of the training module included (a) an overview familiarizing users with assessing student behavior with this method, (b) modeling that includes frame-of-reference training, and (c) multiple opportunities to practice and receive immediate corrective feedback. Participants included 90 undergraduate students assigned to one of six sessions (three experimental and three control). Rating accuracy served as the outcome measure defined as the difference between the rater score and a comparison derived from an expert DBR or systematic direct observation (SDO) score. Rating targets included academically engaged, disruptive, and respectful behavior. Completion of the DBR training module generally yielded ratings that more closely compared with the scores obtained via DBR experts and SDO, yet specific results were mixed across type of rating (i.e., behavior target and duration) and comparison (i.e., DBR expert and SDO). Limitations, future research directions, and implications for practice are discussed.

AB - The purpose of this study was to provide initial evaluation of a web-based training module on rating accuracy when using Direct Behavior Rating (DBR). Components of the training module included (a) an overview familiarizing users with assessing student behavior with this method, (b) modeling that includes frame-of-reference training, and (c) multiple opportunities to practice and receive immediate corrective feedback. Participants included 90 undergraduate students assigned to one of six sessions (three experimental and three control). Rating accuracy served as the outcome measure defined as the difference between the rater score and a comparison derived from an expert DBR or systematic direct observation (SDO) score. Rating targets included academically engaged, disruptive, and respectful behavior. Completion of the DBR training module generally yielded ratings that more closely compared with the scores obtained via DBR experts and SDO, yet specific results were mixed across type of rating (i.e., behavior target and duration) and comparison (i.e., DBR expert and SDO). Limitations, future research directions, and implications for practice are discussed.

KW - Behavior assessment

KW - Direct Behavior Rating

KW - Rater accuracy

KW - Teacher training

UR - http://www.scopus.com/inward/record.url?scp=84977171729&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84977171729&partnerID=8YFLogxK

U2 - 10.1007/s12310-014-9130-z

DO - 10.1007/s12310-014-9130-z

M3 - Article

AN - SCOPUS:84977171729

VL - 7

SP - 92

EP - 104

JO - School Mental Health

JF - School Mental Health

SN - 1866-2625

IS - 2

ER -