An exploration of the interrater agreement of visual analysis with and without context

Andrea L.B. Ford, Brenna N. Rudolph, Brittany Pennington, Breanne J. Byiers

Research output: Contribution to journalArticlepeer-review

14 Scopus citations


Visual analysis is integral to the analysis of single-case experimental design (SCED) data. Previous studies have shown that many factors may influence the interrater agreement (IRA) of visual analysis. One factor that has received little direct attention is the impact of contextual information. In the current study, authors of recently published SCED studies were asked to make judgments regarding functional relations based on published datasets that met criteria for design quality. Respondents were randomly assigned to view graphs with or without contextual information and the degree of interrater agreement was compared. Results revealed that contextual information had no impact on IRA for decisions of a functional relation. IRA was high across both groups for 6 of the 7 datasets examined. Implications and recommendations based on these results are discussed.

Original languageEnglish (US)
Pages (from-to)572-583
Number of pages12
JournalJournal of applied behavior analysis
Issue number1
StatePublished - Jan 1 2020

Bibliographical note

Publisher Copyright:
© 2019 Society for the Experimental Analysis of Behavior


  • data analysis
  • interrater agreement
  • reliability
  • single-subject design
  • visual inspection


Dive into the research topics of 'An exploration of the interrater agreement of visual analysis with and without context'. Together they form a unique fingerprint.

Cite this