TY - JOUR
T1 - Active control time
T2 - an objective performance metric for trainee participation in robotic surgery
AU - Clanahan, Julie M.
AU - Yee, Andrew
AU - Awad, Michael M.
N1 - Publisher Copyright:
© 2023, The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature.
PY - 2023/10
Y1 - 2023/10
N2 - Trainee participation and progression in robotic general surgery remain poorly defined. Computer-assisted technology offers the potential to provide and track objective performance metrics. In this study, we aimed to validate the use of a novel metric—active control time (ACT)—for assessing trainee participation in robotic-assisted cases. Performance data from da Vinci Surgical Systems was retrospectively analyzed for all robotic cases involving trainees with a single minimally invasive surgeon over 10 months. The primary outcome metric was percent ACT—the amount of trainee console time spent in active system manipulations over total active time from both consoles. Kruskal–Wallis and Mann–Whitney U statistical tests were applied in analyses. A total of 123 robotic cases with 18 general surgery residents and 1 fellow were included. Of these, 56 were categorized as complex. Median %ACT was statistically different between trainee levels for all case types taken in aggregate (PGY1s 3.0% [IQR 2–14%], PGY3s 32% [IQR 27–66%], PGY4s 42% [IQR 26–52%], PGY5s 50% [IQR 28–70%], and fellow 61% [IQR 41–85%], p = < 0.0001). When stratified by complexity, median %ACT was higher in standard versus complex cases for PGY5 (60% vs. 36%, p = 0.0002) and fellow groups (74% vs. 47%, p = 0.0045). In this study, we demonstrated an increase in %ACT with trainee level and with standard versus complex robotic cases. These findings are consistent with hypotheses, providing validity evidence for ACT as an objective measurement of trainee participation in robotic-assisted cases. Future studies will aim to define task-specific ACT to guide further robotic training and performance assessments.
AB - Trainee participation and progression in robotic general surgery remain poorly defined. Computer-assisted technology offers the potential to provide and track objective performance metrics. In this study, we aimed to validate the use of a novel metric—active control time (ACT)—for assessing trainee participation in robotic-assisted cases. Performance data from da Vinci Surgical Systems was retrospectively analyzed for all robotic cases involving trainees with a single minimally invasive surgeon over 10 months. The primary outcome metric was percent ACT—the amount of trainee console time spent in active system manipulations over total active time from both consoles. Kruskal–Wallis and Mann–Whitney U statistical tests were applied in analyses. A total of 123 robotic cases with 18 general surgery residents and 1 fellow were included. Of these, 56 were categorized as complex. Median %ACT was statistically different between trainee levels for all case types taken in aggregate (PGY1s 3.0% [IQR 2–14%], PGY3s 32% [IQR 27–66%], PGY4s 42% [IQR 26–52%], PGY5s 50% [IQR 28–70%], and fellow 61% [IQR 41–85%], p = < 0.0001). When stratified by complexity, median %ACT was higher in standard versus complex cases for PGY5 (60% vs. 36%, p = 0.0002) and fellow groups (74% vs. 47%, p = 0.0045). In this study, we demonstrated an increase in %ACT with trainee level and with standard versus complex robotic cases. These findings are consistent with hypotheses, providing validity evidence for ACT as an objective measurement of trainee participation in robotic-assisted cases. Future studies will aim to define task-specific ACT to guide further robotic training and performance assessments.
KW - Automated performance metrics
KW - Objective performance metrics
KW - Robotic education
KW - Robotic surgery
KW - Robotic training
UR - http://www.scopus.com/inward/record.url?scp=85160347604&partnerID=8YFLogxK
U2 - 10.1007/s11701-023-01628-5
DO - 10.1007/s11701-023-01628-5
M3 - Article
C2 - 37237112
AN - SCOPUS:85160347604
SN - 1863-2483
VL - 17
SP - 2117
EP - 2123
JO - Journal of Robotic Surgery
JF - Journal of Robotic Surgery
IS - 5
ER -