TY - JOUR
T1 - Association of Surgical Resident Competency Ratings With Patient Outcomes
AU - Kendrick, Daniel E.
AU - Thelen, Angela E.
AU - Chen, Xilin
AU - Gupta, Tanvi
AU - Yamazaki, Kenji
AU - Krumm, Andrew E.
AU - Bandeh-Ahmadi, Hoda
AU - Clark, Michael
AU - Luckoscki, John
AU - Fan, Zhaohui
AU - Wnuk, Greg M.
AU - Ryan, Andrew M.
AU - Mukherjee, Bhramar
AU - Hamstra, Stanley J.
AU - Dimick, Justin B.
AU - Holmboe, Eric S.
AU - George, Brian C.
N1 - Publisher Copyright:
Copyright © 2023 by the Association of American Medical Colleges.
PY - 2023/7/1
Y1 - 2023/7/1
N2 - Purpose: Accurate assessment of clinical performance is essential to ensure graduating residents are competent for unsupervised practice. The Accreditation Council for Graduate Medical Education milestones framework is the most widely used competency-based framework in the United States. However, the relationship between residents' milestones competency ratings and their subsequent early career clinical outcomes has not been established. It is important to examine the association between milestones competency ratings of U.S. general surgical residents and those surgeons' patient outcomes in early career practice. Method: A retrospective, cross-sectional study was conducted using a sample of national Medicare claims for 23 common, high-risk inpatient general surgical procedures performed between July 1, 2015, and November 30, 2018 (n = 12,400 cases) by nonfellowship-trained U.S. general surgeons. Milestone ratings collected during those surgeons' last year of residency (n = 701 residents) were compared with their risk-adjusted rates of mortality, any complication, or severe complication within 30 days of index operation during their first 2 years of practice. Results: There were no associations between mean milestone competency ratings of graduating general surgery residents and their subsequent early career patient outcomes, including any complication (23% proficient vs 22% not yet proficient; relative risk [RR], 0.97, [95% CI, 0.88-1.08]); severe complication (9% vs 9%, respectively; RR, 1.01, [95% CI, 0.86-1.19]); and mortality (5% vs 5%; RR, 1.07, [95% CI, 0.88-1.30]). Secondary analyses yielded no associations between patient outcomes and milestone ratings specific to technical performance, or between patient outcomes and composites of operative performance, professionalism, or leadership milestones ratings (P ranged.32-.97). Conclusions: Milestone ratings of graduating general surgery residents were not associated with the patient outcomes of those surgeons when they performed common, higher-risk procedures in a Medicare population. Efforts to improve how milestones ratings are generated might strengthen their association with early career outcomes.
AB - Purpose: Accurate assessment of clinical performance is essential to ensure graduating residents are competent for unsupervised practice. The Accreditation Council for Graduate Medical Education milestones framework is the most widely used competency-based framework in the United States. However, the relationship between residents' milestones competency ratings and their subsequent early career clinical outcomes has not been established. It is important to examine the association between milestones competency ratings of U.S. general surgical residents and those surgeons' patient outcomes in early career practice. Method: A retrospective, cross-sectional study was conducted using a sample of national Medicare claims for 23 common, high-risk inpatient general surgical procedures performed between July 1, 2015, and November 30, 2018 (n = 12,400 cases) by nonfellowship-trained U.S. general surgeons. Milestone ratings collected during those surgeons' last year of residency (n = 701 residents) were compared with their risk-adjusted rates of mortality, any complication, or severe complication within 30 days of index operation during their first 2 years of practice. Results: There were no associations between mean milestone competency ratings of graduating general surgery residents and their subsequent early career patient outcomes, including any complication (23% proficient vs 22% not yet proficient; relative risk [RR], 0.97, [95% CI, 0.88-1.08]); severe complication (9% vs 9%, respectively; RR, 1.01, [95% CI, 0.86-1.19]); and mortality (5% vs 5%; RR, 1.07, [95% CI, 0.88-1.30]). Secondary analyses yielded no associations between patient outcomes and milestone ratings specific to technical performance, or between patient outcomes and composites of operative performance, professionalism, or leadership milestones ratings (P ranged.32-.97). Conclusions: Milestone ratings of graduating general surgery residents were not associated with the patient outcomes of those surgeons when they performed common, higher-risk procedures in a Medicare population. Efforts to improve how milestones ratings are generated might strengthen their association with early career outcomes.
UR - http://www.scopus.com/inward/record.url?scp=85160316582&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85160316582&partnerID=8YFLogxK
U2 - 10.1097/ACM.0000000000005157
DO - 10.1097/ACM.0000000000005157
M3 - Article
C2 - 36724304
AN - SCOPUS:85160316582
SN - 1040-2446
VL - 98
SP - 813
EP - 820
JO - Academic Medicine
JF - Academic Medicine
IS - 7
ER -