Requirement analysis for an AI-based AR assistance system for surgical tools in the operating room: stakeholder requirements and technical perspectives

Cramer E, Kucharski AB, Kreimeier J, Andreß S, Li S, Walk C, Merkl F, Högl J, Wucherer P, Stefan P, von Eisenhart-Rothe R, Enste P, Roth D (2024)

Publication Type: Journal article

Publication year: 2024

Journal

International Journal of Computer Assisted Radiology and Surgery Springer Verlag (Germany)

DOI: 10.1007/s11548-024-03193-0

Abstract

Purpose: We aim to investigate the integration of augmented reality (AR) within the context of increasingly complex surgical procedures and instrument handling toward the transition to smart operating rooms (OR). In contrast to cumbersome paper-based surgical instrument manuals still used in the OR, we wish to provide surgical staff with an AR head-mounted display that provides in-situ visualization and guidance throughout the assembly process of surgical instruments. Our requirement analysis supports the development and provides guidelines for its transfer into surgical practice. Methods: A three-phase user-centered design approach was applied with online interviews, an observational study, and a workshop with two focus groups with scrub nurses, circulating nurses, surgeons, manufacturers, clinic IT staff, and members of the sterilization department. The requirement analysis was based on key criteria for usability. The data were analyzed via structured content analysis. Results: We identified twelve main problems with the current use of paper manuals. Major issues included sterile users’ inability to directly handle non-sterile manuals, missing details, and excessive text information, potentially delaying procedure performance. Major requirements for AR-driven guidance fall into the categories of design, practicability, control, and integration into the current workflow. Additionally, further recommendations for technical development could be obtained. Conclusion: In conclusion, our insights have outlined a comprehensive spectrum of requirements that are essential for the successful implementation of an AI- and AR-driven guidance for assembling surgical instruments. The consistently appreciative evaluation by stakeholders underscores the profound potential of AR and AI technology as valuable assistance and guidance.

Authors with CRIS profile

Shiyu Li Juniorprofessur für Human-Centered Computing and Extended Reality

Involved external institutions

LMU Klinikum DE Germany (DE) Klinikum rechts der Isar DE Germany (DE) Westfälische Hochschule DE Germany (DE) Klinikum der Universität München DE Germany (DE)

How to cite

APA:

Cramer, E., Kucharski, A.B., Kreimeier, J., Andreß, S., Li, S., Walk, C.,... Roth, D. (2024). Requirement analysis for an AI-based AR assistance system for surgical tools in the operating room: stakeholder requirements and technical perspectives. International Journal of Computer Assisted Radiology and Surgery. https://doi.org/10.1007/s11548-024-03193-0

MLA:

Cramer, E., et al. "Requirement analysis for an AI-based AR assistance system for surgical tools in the operating room: stakeholder requirements and technical perspectives." International Journal of Computer Assisted Radiology and Surgery (2024).

BibTeX: Download