TY - JOUR
T1 - Analysis of Simulated Angiographic Procedures. Part 2
T2 - Extracting Efficiency Data from Audio and Video Recordings
AU - Duncan, James R.
AU - Kline, Benjamin
AU - Glaiberman, Craig B.
N1 - Funding Information:
This work was supported by a grant from the Barnes Jewish Hospital Foundation. The authors wish to thank Dr. Mark Scerbo for his numerous suggestions that led to an improved protocol and data analysis.
PY - 2007/4
Y1 - 2007/4
N2 - Purpose: To create and test methods of extracting efficiency data from recordings of simulated renal stent procedures. Materials and Methods: Task analysis was performed and used to design a standardized testing protocol. Five experienced angiographers then performed 16 renal stent simulations using the Simbionix AngioMentor angiographic simulator. Audio and video recordings of these simulations were captured from multiple vantage points. The recordings were synchronized and compiled. A series of efficiency metrics (procedure time, contrast volume, and tool use) were then extracted from the recordings. The intraobserver and interobserver variability of these individual metrics was also assessed. The metrics were converted to costs and aggregated to determine the fixed and variable costs of a procedure segment or the entire procedure. Results: Task analysis and pilot testing led to a standardized testing protocol suitable for performance assessment. Task analysis also identified seven checkpoints that divided the renal stent simulations into six segments. Efficiency metrics for these different segments were extracted from the recordings and showed excellent intra- and interobserver correlations. Analysis of the individual and aggregated efficiency metrics demonstrated large differences between segments as well as between different angiographers. These differences persisted when efficiency was expressed as either total or variable costs. Conclusions: Task analysis facilitated both protocol development and data analysis. Efficiency metrics were readily extracted from recordings of simulated procedures. Aggregating the metrics and dividing the procedure into segments revealed potential insights that could be easily overlooked because the simulator currently does not attempt to aggregate the metrics and only provides data derived from the entire procedure. The data indicate that analysis of simulated angiographic procedures will be a powerful method of assessing performance in interventional radiology.
AB - Purpose: To create and test methods of extracting efficiency data from recordings of simulated renal stent procedures. Materials and Methods: Task analysis was performed and used to design a standardized testing protocol. Five experienced angiographers then performed 16 renal stent simulations using the Simbionix AngioMentor angiographic simulator. Audio and video recordings of these simulations were captured from multiple vantage points. The recordings were synchronized and compiled. A series of efficiency metrics (procedure time, contrast volume, and tool use) were then extracted from the recordings. The intraobserver and interobserver variability of these individual metrics was also assessed. The metrics were converted to costs and aggregated to determine the fixed and variable costs of a procedure segment or the entire procedure. Results: Task analysis and pilot testing led to a standardized testing protocol suitable for performance assessment. Task analysis also identified seven checkpoints that divided the renal stent simulations into six segments. Efficiency metrics for these different segments were extracted from the recordings and showed excellent intra- and interobserver correlations. Analysis of the individual and aggregated efficiency metrics demonstrated large differences between segments as well as between different angiographers. These differences persisted when efficiency was expressed as either total or variable costs. Conclusions: Task analysis facilitated both protocol development and data analysis. Efficiency metrics were readily extracted from recordings of simulated procedures. Aggregating the metrics and dividing the procedure into segments revealed potential insights that could be easily overlooked because the simulator currently does not attempt to aggregate the metrics and only provides data derived from the entire procedure. The data indicate that analysis of simulated angiographic procedures will be a powerful method of assessing performance in interventional radiology.
UR - http://www.scopus.com/inward/record.url?scp=34047259029&partnerID=8YFLogxK
U2 - 10.1016/j.jvir.2007.01.006
DO - 10.1016/j.jvir.2007.01.006
M3 - Article
C2 - 17446545
AN - SCOPUS:34047259029
SN - 1051-0443
VL - 18
SP - 535
EP - 544
JO - Journal of Vascular and Interventional Radiology
JF - Journal of Vascular and Interventional Radiology
IS - 4
ER -