Preliminary appraisal of the reliability and validity of the Colorado State University Feline Acute Pain Scale

Hilary Shipley, Alonso Guedes, Lynelle Graham, Elizabeth Goudie-DeAngelis, Erin L Wendt Hornickle

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Objectives: The objective of this study was to determine the inter-rater reliability and convergent validity of the Colorado State University Feline Acute Pain Scale (CSU-FAPS) in a preliminary appraisal of its performance in a clinical teaching setting. Methods: Sixty-eight female cats were assessed for pain after ovariohysterectomy. A cohort of 21 cats was examined independently by four raters (two board-certified anesthesiologists and two anesthesia residents) with the CSU-FAPS, and intra-class correlation coefficient (ICC) was used to determine inter-rater reliability. Weighted Cohen’s kappa was used to determine inter-rater reliability centered on the ‘need to reassess analgesic plan’ (dichotomous scale). A separate cohort of 47 cats was evaluated independently by two raters (one board-certified anesthesiologist and one veterinary small animal rotating intern) using the CSU-FAPS and the Glasgow Composite Measure Pain Scale (CMPS-Feline), and Spearman rank-order correlation was determined to assess convergent validity. Reliability was interpreted using Altman’s classification as very good, good, moderate, fair and poor. Validity was considered adequate if correlation coefficients were between 0.4 and 0.8. Results: The ICC was 0.61 for anesthesiologists and 0.67 for residents, indicating good reliability. Weighted Cohen’s kappa was 0.79 for anesthesiologists and 0.44 for residents, indicating moderate to good reliability. The Spearman rank correlation indicated a statistically significant (P = 0.0003) positive correlation (0.31; 95% confidence interval 0.14–0.46) between the CSU-FAPS and the CMPS-Feline. Conclusions and relevance: The CSU-FAPS showed moderate-to-good inter-rater reliability when used by veterinarians to assess pain level or need to reassess analgesic plan after ovariohysterectomy in cats. The validity fell short of current guidelines for correlation coefficients and further refinement and testing are warranted to improve its performance.

Original languageEnglish (US)
Pages (from-to)335-339
Number of pages5
JournalJournal of Feline Medicine and Surgery
Volume21
Issue number4
DOIs
StatePublished - Apr 1 2019

Fingerprint

Felidae
Acute Pain
Reproducibility of Results
pain
cats
Cats
Pain
Analgesics
spaying
analgesics
Veterinarians
performance appraisals
Teaching
Anesthesia
Guidelines
Confidence Intervals
Anesthesiologists
veterinarians
confidence interval
anesthesia

PubMed: MeSH publication types

  • Journal Article

Cite this

Preliminary appraisal of the reliability and validity of the Colorado State University Feline Acute Pain Scale. / Shipley, Hilary; Guedes, Alonso; Graham, Lynelle; Goudie-DeAngelis, Elizabeth; Wendt Hornickle, Erin L.

In: Journal of Feline Medicine and Surgery, Vol. 21, No. 4, 01.04.2019, p. 335-339.

Research output: Contribution to journalArticle

@article{186cf90ac50148be9fadd85de2049d7f,
title = "Preliminary appraisal of the reliability and validity of the Colorado State University Feline Acute Pain Scale",
abstract = "Objectives: The objective of this study was to determine the inter-rater reliability and convergent validity of the Colorado State University Feline Acute Pain Scale (CSU-FAPS) in a preliminary appraisal of its performance in a clinical teaching setting. Methods: Sixty-eight female cats were assessed for pain after ovariohysterectomy. A cohort of 21 cats was examined independently by four raters (two board-certified anesthesiologists and two anesthesia residents) with the CSU-FAPS, and intra-class correlation coefficient (ICC) was used to determine inter-rater reliability. Weighted Cohen’s kappa was used to determine inter-rater reliability centered on the ‘need to reassess analgesic plan’ (dichotomous scale). A separate cohort of 47 cats was evaluated independently by two raters (one board-certified anesthesiologist and one veterinary small animal rotating intern) using the CSU-FAPS and the Glasgow Composite Measure Pain Scale (CMPS-Feline), and Spearman rank-order correlation was determined to assess convergent validity. Reliability was interpreted using Altman’s classification as very good, good, moderate, fair and poor. Validity was considered adequate if correlation coefficients were between 0.4 and 0.8. Results: The ICC was 0.61 for anesthesiologists and 0.67 for residents, indicating good reliability. Weighted Cohen’s kappa was 0.79 for anesthesiologists and 0.44 for residents, indicating moderate to good reliability. The Spearman rank correlation indicated a statistically significant (P = 0.0003) positive correlation (0.31; 95{\%} confidence interval 0.14–0.46) between the CSU-FAPS and the CMPS-Feline. Conclusions and relevance: The CSU-FAPS showed moderate-to-good inter-rater reliability when used by veterinarians to assess pain level or need to reassess analgesic plan after ovariohysterectomy in cats. The validity fell short of current guidelines for correlation coefficients and further refinement and testing are warranted to improve its performance.",
author = "Hilary Shipley and Alonso Guedes and Lynelle Graham and Elizabeth Goudie-DeAngelis and {Wendt Hornickle}, {Erin L}",
year = "2019",
month = "4",
day = "1",
doi = "10.1177/1098612X18777506",
language = "English (US)",
volume = "21",
pages = "335--339",
journal = "Journal of Feline Medicine and Surgery",
issn = "1098-612X",
publisher = "W.B. Saunders Ltd",
number = "4",

}

TY - JOUR

T1 - Preliminary appraisal of the reliability and validity of the Colorado State University Feline Acute Pain Scale

AU - Shipley, Hilary

AU - Guedes, Alonso

AU - Graham, Lynelle

AU - Goudie-DeAngelis, Elizabeth

AU - Wendt Hornickle, Erin L

PY - 2019/4/1

Y1 - 2019/4/1

N2 - Objectives: The objective of this study was to determine the inter-rater reliability and convergent validity of the Colorado State University Feline Acute Pain Scale (CSU-FAPS) in a preliminary appraisal of its performance in a clinical teaching setting. Methods: Sixty-eight female cats were assessed for pain after ovariohysterectomy. A cohort of 21 cats was examined independently by four raters (two board-certified anesthesiologists and two anesthesia residents) with the CSU-FAPS, and intra-class correlation coefficient (ICC) was used to determine inter-rater reliability. Weighted Cohen’s kappa was used to determine inter-rater reliability centered on the ‘need to reassess analgesic plan’ (dichotomous scale). A separate cohort of 47 cats was evaluated independently by two raters (one board-certified anesthesiologist and one veterinary small animal rotating intern) using the CSU-FAPS and the Glasgow Composite Measure Pain Scale (CMPS-Feline), and Spearman rank-order correlation was determined to assess convergent validity. Reliability was interpreted using Altman’s classification as very good, good, moderate, fair and poor. Validity was considered adequate if correlation coefficients were between 0.4 and 0.8. Results: The ICC was 0.61 for anesthesiologists and 0.67 for residents, indicating good reliability. Weighted Cohen’s kappa was 0.79 for anesthesiologists and 0.44 for residents, indicating moderate to good reliability. The Spearman rank correlation indicated a statistically significant (P = 0.0003) positive correlation (0.31; 95% confidence interval 0.14–0.46) between the CSU-FAPS and the CMPS-Feline. Conclusions and relevance: The CSU-FAPS showed moderate-to-good inter-rater reliability when used by veterinarians to assess pain level or need to reassess analgesic plan after ovariohysterectomy in cats. The validity fell short of current guidelines for correlation coefficients and further refinement and testing are warranted to improve its performance.

AB - Objectives: The objective of this study was to determine the inter-rater reliability and convergent validity of the Colorado State University Feline Acute Pain Scale (CSU-FAPS) in a preliminary appraisal of its performance in a clinical teaching setting. Methods: Sixty-eight female cats were assessed for pain after ovariohysterectomy. A cohort of 21 cats was examined independently by four raters (two board-certified anesthesiologists and two anesthesia residents) with the CSU-FAPS, and intra-class correlation coefficient (ICC) was used to determine inter-rater reliability. Weighted Cohen’s kappa was used to determine inter-rater reliability centered on the ‘need to reassess analgesic plan’ (dichotomous scale). A separate cohort of 47 cats was evaluated independently by two raters (one board-certified anesthesiologist and one veterinary small animal rotating intern) using the CSU-FAPS and the Glasgow Composite Measure Pain Scale (CMPS-Feline), and Spearman rank-order correlation was determined to assess convergent validity. Reliability was interpreted using Altman’s classification as very good, good, moderate, fair and poor. Validity was considered adequate if correlation coefficients were between 0.4 and 0.8. Results: The ICC was 0.61 for anesthesiologists and 0.67 for residents, indicating good reliability. Weighted Cohen’s kappa was 0.79 for anesthesiologists and 0.44 for residents, indicating moderate to good reliability. The Spearman rank correlation indicated a statistically significant (P = 0.0003) positive correlation (0.31; 95% confidence interval 0.14–0.46) between the CSU-FAPS and the CMPS-Feline. Conclusions and relevance: The CSU-FAPS showed moderate-to-good inter-rater reliability when used by veterinarians to assess pain level or need to reassess analgesic plan after ovariohysterectomy in cats. The validity fell short of current guidelines for correlation coefficients and further refinement and testing are warranted to improve its performance.

UR - http://www.scopus.com/inward/record.url?scp=85047912120&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85047912120&partnerID=8YFLogxK

U2 - 10.1177/1098612X18777506

DO - 10.1177/1098612X18777506

M3 - Article

C2 - 29848148

AN - SCOPUS:85047912120

VL - 21

SP - 335

EP - 339

JO - Journal of Feline Medicine and Surgery

JF - Journal of Feline Medicine and Surgery

SN - 1098-612X

IS - 4

ER -