Intra-rater and inter-rater reliability of the rapid entire body assessment (REBA) tool

Adam H. Schwartz, Thomas J. Albin, Susan G Gerberich

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Background: Ergonomics researchers and practitioners use many techniques to assess risk. The Rapid Entire Body Assessment (REBA) is a common tool used to facilitate the measurement and evaluation of the risks associated with working postures as a part of ergonomic workload. However, little work has been reported regarding the reliability of REBA reporting. Objective: This study assesses the reliability of this commonly used tool for research and practice. Methods: The study was conducted as part of the larger Safe Workload Ergonomic Exposure Project (SWEEP), which is a University of Minnesota research initiative for custodians. For this effort, a secondary data analysis was conducted on data collected during a study of custodians’ exposures to risks of musculoskeletal disorders. Eight observers used the REBA tool to sequentially evaluate tasks performed two times in succession by the same individual. Results: This study reports high intra-rater reliability (ICC = 0.925) for REBA raw scores and moderate inter-rater reliability (IRR) (Fleiss kappa = 0.54) for a categorical scoring of REBA. Conclusion: A moderate amount of IRR was found, and a standardized training and calibration protocol is proposed as a potential means to improve intra- and inter-rater reliability.

Original languageEnglish (US)
Pages (from-to)111-116
Number of pages6
JournalInternational Journal of Industrial Ergonomics
Volume71
DOIs
StatePublished - May 1 2019

Fingerprint

Human Engineering
Workload
Ergonomics
ergonomics
Posture
Research
workload
Calibration
Research Personnel
secondary analysis
data analysis
evaluation

Keywords

  • Assessment
  • Inter-rater reliability
  • Intra-rater reliability
  • REBA

Cite this

Intra-rater and inter-rater reliability of the rapid entire body assessment (REBA) tool. / Schwartz, Adam H.; Albin, Thomas J.; Gerberich, Susan G.

In: International Journal of Industrial Ergonomics, Vol. 71, 01.05.2019, p. 111-116.

Research output: Contribution to journalArticle

@article{b12d0384ae7743a1bb59eedc162b6055,
title = "Intra-rater and inter-rater reliability of the rapid entire body assessment (REBA) tool",
abstract = "Background: Ergonomics researchers and practitioners use many techniques to assess risk. The Rapid Entire Body Assessment (REBA) is a common tool used to facilitate the measurement and evaluation of the risks associated with working postures as a part of ergonomic workload. However, little work has been reported regarding the reliability of REBA reporting. Objective: This study assesses the reliability of this commonly used tool for research and practice. Methods: The study was conducted as part of the larger Safe Workload Ergonomic Exposure Project (SWEEP), which is a University of Minnesota research initiative for custodians. For this effort, a secondary data analysis was conducted on data collected during a study of custodians’ exposures to risks of musculoskeletal disorders. Eight observers used the REBA tool to sequentially evaluate tasks performed two times in succession by the same individual. Results: This study reports high intra-rater reliability (ICC = 0.925) for REBA raw scores and moderate inter-rater reliability (IRR) (Fleiss kappa = 0.54) for a categorical scoring of REBA. Conclusion: A moderate amount of IRR was found, and a standardized training and calibration protocol is proposed as a potential means to improve intra- and inter-rater reliability.",
keywords = "Assessment, Inter-rater reliability, Intra-rater reliability, REBA",
author = "Schwartz, {Adam H.} and Albin, {Thomas J.} and Gerberich, {Susan G}",
year = "2019",
month = "5",
day = "1",
doi = "10.1016/j.ergon.2019.02.010",
language = "English (US)",
volume = "71",
pages = "111--116",
journal = "International Journal of Industrial Ergonomics",
issn = "0169-8141",
publisher = "Elsevier",

}

TY - JOUR

T1 - Intra-rater and inter-rater reliability of the rapid entire body assessment (REBA) tool

AU - Schwartz, Adam H.

AU - Albin, Thomas J.

AU - Gerberich, Susan G

PY - 2019/5/1

Y1 - 2019/5/1

N2 - Background: Ergonomics researchers and practitioners use many techniques to assess risk. The Rapid Entire Body Assessment (REBA) is a common tool used to facilitate the measurement and evaluation of the risks associated with working postures as a part of ergonomic workload. However, little work has been reported regarding the reliability of REBA reporting. Objective: This study assesses the reliability of this commonly used tool for research and practice. Methods: The study was conducted as part of the larger Safe Workload Ergonomic Exposure Project (SWEEP), which is a University of Minnesota research initiative for custodians. For this effort, a secondary data analysis was conducted on data collected during a study of custodians’ exposures to risks of musculoskeletal disorders. Eight observers used the REBA tool to sequentially evaluate tasks performed two times in succession by the same individual. Results: This study reports high intra-rater reliability (ICC = 0.925) for REBA raw scores and moderate inter-rater reliability (IRR) (Fleiss kappa = 0.54) for a categorical scoring of REBA. Conclusion: A moderate amount of IRR was found, and a standardized training and calibration protocol is proposed as a potential means to improve intra- and inter-rater reliability.

AB - Background: Ergonomics researchers and practitioners use many techniques to assess risk. The Rapid Entire Body Assessment (REBA) is a common tool used to facilitate the measurement and evaluation of the risks associated with working postures as a part of ergonomic workload. However, little work has been reported regarding the reliability of REBA reporting. Objective: This study assesses the reliability of this commonly used tool for research and practice. Methods: The study was conducted as part of the larger Safe Workload Ergonomic Exposure Project (SWEEP), which is a University of Minnesota research initiative for custodians. For this effort, a secondary data analysis was conducted on data collected during a study of custodians’ exposures to risks of musculoskeletal disorders. Eight observers used the REBA tool to sequentially evaluate tasks performed two times in succession by the same individual. Results: This study reports high intra-rater reliability (ICC = 0.925) for REBA raw scores and moderate inter-rater reliability (IRR) (Fleiss kappa = 0.54) for a categorical scoring of REBA. Conclusion: A moderate amount of IRR was found, and a standardized training and calibration protocol is proposed as a potential means to improve intra- and inter-rater reliability.

KW - Assessment

KW - Inter-rater reliability

KW - Intra-rater reliability

KW - REBA

UR - http://www.scopus.com/inward/record.url?scp=85062979633&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85062979633&partnerID=8YFLogxK

U2 - 10.1016/j.ergon.2019.02.010

DO - 10.1016/j.ergon.2019.02.010

M3 - Article

AN - SCOPUS:85062979633

VL - 71

SP - 111

EP - 116

JO - International Journal of Industrial Ergonomics

JF - International Journal of Industrial Ergonomics

SN - 0169-8141

ER -