Advertisement
Systematic review| Volume 61, ISSUE 1, P19-27, January 2023

Download started.

Ok

Systematic review of techniques used to validate the registration of augmented-reality images using a head-mounted device to navigate surgery

Published:October 06, 2022DOI:https://doi.org/10.1016/j.bjoms.2022.08.007

      Abstract

      Augmented-reality (AR) head-mounted devices (HMD) allow the wearer to have digital images superposed on to their field of vision. They are being used to superpose annotations on to the surgical field akin to a navigation system. This review examines published validation studies on HMD-AR systems, their reported protocols, and outcomes. The aim was to establish commonalities and an acceptable registration outcome. Multiple databases were systematically searched for relevant articles between January 2015 and January 2021. Studies that examined the registration of AR content using a HMD to guide surgery were eligible for inclusion. The country of origin, year of publication, medical specialty, HMD device, software, and method of registration, were recorded. A meta-analysis of the mean registration error was conducted. A total of 4784 papers were identified, of which 23 met the inclusion criteria. They included studies using HoloLens (Microsoft) (n = 22) and nVisor ST60 (NVIS Inc) (n = 1). Sixty-six per cent of studies were in hard tissue specialties. Eleven studies reported registration errors using pattern markers (mean (SD) 2.6 (1.8) mm), and four reported registration errors using surface markers (mean (SD) 3.8 (3.7) mm). Three studies reported registration errors using manual alignment (mean (SD) 2.2 (1.3) mm). The majority of studies in this review used in-house software with a variety of registration methods and reported errors. The mean registration error calculated in this study can be considered as a minimum acceptable standard. It should be taken into consideration when procedural applications are selected.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to British Journal of Oral and Maxillofacial Surgery
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • McCulloch P.
        The IDEAL framework for ensuring safety and effectiveness of medical devices.
        BMJ. 2020; 370m3183
      1. Chegini S. Registry of systematic reviews/meta-analyses details. Available from URL: https://www.researchregistry.com/browse-the-registry#registryofsystematicreviewsmeta-analyses/registryofsystematicreviewsmeta-analysesdetails/62d03ae8c2e109001e6995f4/ (last accessed 17 October 2022).

        • Nguyen N.Q.
        • Cardinell J.
        • Ramjist J.
        • et al.
        Augmented reality systems for improved operating room workflow.
        Neurosurgery. 2019; 66
        • Mitsuno D.
        • Ueda K.
        • Itamiya T.
        • et al.
        Intraoperative evaluation of body surface improvement by an augmented reality system that a clinician can modify.
        Plast Reconstr Surg Glob Open. 2017; 5: e1432
        • Agten C.A.
        • Dennler C.
        • Rosskopf A.B.
        • et al.
        Augmented reality-guided lumbar facet joint injections.
        Invest Radiol. 2018; 53: 495-498
        • Nuri T.
        • Mitsuno D.
        • Otsuki Y.
        • et al.
        Augmented reality technology for the positioning of the auricle in the treatment of microtia.
        Plast Reconstr Surg Glob Open. 2020; 8: e2626
        • Frantz T.
        • Jansen B.
        • Duerinck J.
        • et al.
        Augmenting Microsoft's HoloLens with vuforia tracking for neuronavigation.
        Healthc Technol Lett. 2018; 5: 221-225
        • Jiang T.
        • Yu D.
        • Wang Y.
        • et al.
        HoloLens-based vascular localization system: precision evaluation study with a three-dimensional printed model.
        J Med Internet Res. 2020; 22: e16852
        • Moreta-Martinez R.
        • García-Mato D.
        • García-Sevilla M.
        • et al.
        Augmented reality in computer-assisted interventions based on patient-specific 3D printed reference.
        Healthc Technol Lett. 2018; 5: 162-166
        • Zhou Z.
        • Yang Z.
        • Jiang S.
        • et al.
        Design and validation of a surgical navigation system for brachytherapy based on mixed reality.
        Med Phys. 2019; 46: 3709-3718
        • Gibby J.T.
        • Swenson S.A.
        • Cvetko S.
        • et al.
        Head-mounted display augmented reality to guide pedicle screw placement utilizing computed tomography.
        Int J Comput Assist Radiol Surg. 2019; 14: 525-535
        • Gao Y.
        • Lin L.
        • Chai G.
        • et al.
        A feasibility study of a new method to enhance the augmented reality navigation effect in mandibular angle split osteotomy.
        J Craniomaxillofac Surg. 2019; 47: 1242-1248
        • Liu H.
        • Auvinet E.
        • Giles J.
        • et al.
        Augmented reality based navigation for computer assisted hip resurfacing: a proof of concept study.
        Ann Biomed Eng. 2018; 46: 1595-1605
        • van Doormaal T.P.
        • van Doormaal J.A.
        • Mensink T.
        Clinical accuracy of holographic navigation using point-based registration on augmented-reality glasses.
        Oper Neurosurg (Hagerstown). 2019; 17: 588-593
        • Liebmann F.
        • Roner S.
        • von Atzigen M.
        • et al.
        Pedicle screw navigation using surface digitization on the Microsoft HoloLens.
        Int J Comput Assist Radiol Surg. 2019; 14: 1157-1165
        • Müller F.
        • Roner S.
        • Liebmann F.
        • et al.
        Augmented reality navigation for spinal pedicle screw instrumentation using intraoperative 3D imaging.
        Spine J. 2020; 20: 621-628
        • Viehöfer A.F.
        • Wirth S.H.
        • Zimmermann S.M.
        • et al.
        Augmented reality guided osteotomy in hallux Valgus correction.
        BMC Musculoskelet Disord. 2020; 21: 438
        • Jiang J.
        • Huang Z.
        • Qian W.
        • et al.
        Registration technology of augmented reality in oral medicine: a review.
        Ieee Access. 2019; 7: 53566-53584
        • Liu H.
        • Wu J.
        • Tang Y.
        • et al.
        Percutaneous placement of lumbar pedicle screws via intraoperative CT image-based augmented reality-guided technology.
        J Neurosurg Spine. 2019; 32: 542-547
        • Zhu M.
        • Liu F.
        • Zhou C.
        • et al.
        Does intraoperative navigation improve the accuracy of mandibular angle osteotomy: comparison between augmented reality navigation, individualised templates and free-hand techniques.
        J Plast Reconstr Aesthet Surg. 2018; 71: 1188-1195
        • Wang J.
        • Shen Y.
        • Yang S.
        A practical marker-less image registration method for augmented reality oral and maxillofacial surgery.
        Int J Comput Assist Radiol Surg. 2019; 14: 763-773
        • Chen G.
        • Zeng W.
        • Yin H.
        • et al.
        The preliminary application of augmented reality in unilateral orbitozygomatic maxillary complex fractures treatment.
        J Craniofac Surg. 2020; 31: 542-548
        • Urakov T.M.
        • Wang M.Y.
        • Levi A.D.
        Workflow caveats in augmented reality-assisted pedicle instrumentation: cadaver lab.
        World Neurosurg. 2019; 126: e1449-e1455
        • Rose A.S.
        • Kim H.
        • Fuchs H.
        • et al.
        Development of augmented-reality applications in otolaryngology-head and neck surgery.
        Laryngoscope. 2019; 129: S1-S
        • Pepe A.
        • Trotta G.F.
        • Mohr-Ziak P.
        • et al.
        A marker-less registration approach for mixed reality-aided maxillofacial surgery: a pilot evaluation.
        J Digit Imaging. 2019; 32: 1008-1018
        • Gibby J.
        • Cvetko S.
        • Javan R.
        • et al.
        Use of augmented reality for image-guided spine procedures.
        Eur Spine J. 2020; 29: 1823-1832
        • Condino S.
        • Carbone M.
        • Piazza R.
        • et al.
        Perceptual limits of optical see-through visors for augmented reality guidance of manual tasks.
        IEEE Trans Biomed Eng. 2020; 67: 411-419
        • Meulstee J.W.
        • Nijsink J.
        • Schreurs R.
        • et al.
        Toward holographic-guided surgery.
        Surg Innov. 2019; 26: 86-94
        • Kuhlemann I.
        • Kleemann M.
        • Jauer P.
        • et al.
        Towards X-ray free endovascular interventions - using HoloLens for on-line holographic visualisation.
        Healthc Technol Lett. 2017; 4: 184-187
        • Andress S.
        • Johnson A.
        • Unberath M.
        • et al.
        On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial.
        J Med Imaging (Bellingham). 2018; 5021209
        • Liu J.
        • Al'Aref S.J.
        • Singh G.
        • et al.
        An augmented reality system for image guidance of transcatheter procedures for structural heart disease.
        PLoS One. 2019; 14: e0219174