Application of mixed reality-based surgical navigation system in craniomaxillofacial trauma bone reconstruction

doi:10.7518/hxkq.2022.06.008

Abstract

Abstract:

Objective This study aimed to build a surgical navigation system based on mixed reality (MR) and optical positioning technique and evaluate its clinical applicability in craniomaxillofacial trauma bone reconstruction. Me-thods　We first integrated the software and hardware platforms of the MR-based surgical navigation system and explored the system workflow. The systematic error, target registration error, and osteotomy application error of the system were then analyzed via 3D printed skull model experiment. The feasibility of the MR-based surgical navigation system in craniomaxillofacial trauma bone reconstruction was verified via zygomatico-maxillary complex (ZMC) reduction experiment of the skull model and preliminary clinical study. Results The system error of this MR-based surgical navigation system was 1.23 mm±0.52 mm, the target registration error was 2.83 mm±1.18 mm, and the osteotomy application error was 3.13 mm±1.66 mm. Virtual surgical planning and the reduction of the ZMC model were successfully conducted. In addition, with the guidance of the MR-based navigation system, the frontal bone defect was successfully reconstructed, and the clinical outcome was satisfactory. Conclusion The MR-based surgical navigation system has its advantages in virtual reality fusion effect and dynamic navigation stability. It provides a new method for doctor-patient communications, education, preoperative planning, and intraoperative navigation in craniomaxillofacial surgery.

Key words: craniomaxillofacial surgery, mixed reality, surgical navigation, virtual surgery, reconstruction

CLC Number:

R 782.05

Lin Chengzhong, Zhang Yong, Dong Shao, Wu Jinyang, Zhang Chuxi, Wan Xinjun, Zhang Shilei. Application of mixed reality-based surgical navigation system in craniomaxillofacial trauma bone reconstruction[J]. West China Journal of Stomatology, 2022, 40(6): 676-684.

Figures/Tables 5

References 29

1	Juergens P, Beinemann J, Zandbergen M, et al. A computer-assisted diagnostic and treatment concept to increase accuracy and safety in the extracranial correction of cranial vault asymmetries[J]. J Oral Maxillofac Surg, 2012, 70(3): 677-684.
2	Schramm A, Suarez-Cunqueiro MM, Barth EL, et al. Computer-assisted navigation in craniomaxillofacial tumors[J]. J Craniofac Surg, 2008, 19(4): 1067-1074.
3	Chen Q, Zhao Y, Shen G, et al. Etiology and pathogenesis of hemifacial microsomia[J]. J Dent Res, 2018, 97(12): 1297-1305.
4	Gui H, Wu J, Shen SG, et al. Navigation-guided lateral gap arthroplasty as the treatment of temporomandibular joint ankylosis[J]. J Oral Maxillofac Surg, 2014, 72(1): 128-138.
5	Yu H, Shen SG, Wang X, et al. The indication and application of computer-assisted navigation in oral and maxillofacial surgery—Shanghai's experience based on 104 cases[J]. J Craniomaxillofac Surg, 2013, 41(8): 770-774.
6	Demian N, Pearl C, Woernley TC 3rd, et al. Surgical navigation for oral and maxillofacial surgery[J]. Oral Maxillofac Surg Clin North Am, 2019, 31(4): 531-538.
7	Tepper OM, Rudy HL, Lefkowitz A, et al. Mixed reality with holoLens: where virtual reality meets augmented reality in the operating room[J]. Plast Reconstr Surg, 2017, 140(5): 1066-1070.
8	Andrews C, Southworth MK, Silva JNA, et al. Extended reality in medical practice[J]. Curr Treat Options Cardiovasc Med, 2019, 21(4): 18.
9	Hu HZ, Feng XB, Shao ZW, et al. Application and prospect of mixed reality technology in medical field[J]. Curr Med Sci, 2019, 39(1): 1-6.
10	Pelanis E, Kumar RP, Aghayan DL, et al. Use of mixed reality for improved spatial understanding of liver anatomy[J]. Minim Invasive Ther Allied Technol, 2020, 29(3): 154-160.
11	Brun H, Bugge RAB, Suther LKR, et al. Mixed reality holograms for heart surgery planning: first user experience in congenital heart disease[J]. Eur Heart J Cardiovasc Imaging, 2019, 20(8): 883-888.
12	Noorlag R, de Bree R, Witjes MJH. Image-guided surgery in oral cancer: toward improved margin control[J]. Curr Opin Oncol, 2022, 34(3): 170-176.
13	Lee GK, Moshrefi S, Fuertes V, et al. What is your reality? Virtual, augmented, and mixed reality in plastic surgery training, education, and practice[J]. Plast Reconstr Surg, 2021, 147(2): 505-511.
14	O’Reilly MK, Heagerty PJ, Gold LS, et al. Augmented reality[J]. AJNR Am J Neuroradiol, 2020, 41(8): E67-E68.
15	Verhey JT, Haglin JM, Verhey EM, et al. Virtual, augmented, and mixed reality applications in orthopedic surgery[J]. Int J Med Robot, 2020, 16(2): e2067.
16	Widmann G, Stoffner R, Bale R. Errors and error management in image-guided craniomaxillofacial surgery[J]. Oral Surg Oral Med Oral Pathol Oral Radiol Endod, 2009, 107(5): 701-715.
17	Sun Q, Mai Y, Yang R, et al. Fast and accurate online calibration of optical see-through head-mounted display for AR-based surgical navigation using Microsoft HoloLens[J]. Int J Comput Assist Radiol Surg, 2020, 15(11): 1907-1919.
18	Tu P, Gao Y, Lungu AJ, et al. Augmented reality based navigation for distal interlocking of intramedullary nails utilizing Microsoft HoloLens 2[J]. Comput Biol Med, 2021, 133: 104402.
19	Koivukangas T, Katisko JP, Koivukangas JP. Technical accuracy of optical and the electromagnetic tracking systems[J]. Springerplus, 2013, 2(1): 90.
20	Mahmoud N, Grasa ÓG, Nicolau SA, et al. On-patient see-through augmented reality based on visual SLAM[J]. Int J Comput Assist Radiol Surg, 2017, 12(1): 1-11.
21	Wu Y, Tang F, Li H. Image-based camera localization: an overview[J]. Vis Comput Ind Biomed Art, 2018, 1(1): 8.
22	Incekara F, Smits M, Dirven C, et al. Clinical feasibility of a wearable mixed-reality device in neurosurgery[J]. World Neurosurg, 2018, 118: e422-e427.
23	McJunkin JL, Jiramongkolchai P, Chung W, et al. Deve-lopment of a mixed reality platform for lateral skull base anatomy[J]. Otol Neurotol, 2018, 39(10): e1137-e1142.
24	Fotouhi J, Unberath M, Song T, et al. Co-localized augmented human and X-ray observers in collaborative surgical ecosystem[J]. Int J Comput Assist Radiol Surg, 2019, 14(9): 1553-1563.
25	Gibby W, Cvetko S, Gibby A, et al. The application of augmented reality-based navigation for accurate target acquisition of deep brain sites: advances in neurosurgical guidance[J]. J Neurosurg, 2021, 17: 1-7.
26	House PM, Pelzl S, Furrer S, et al. Use of the mixed reality tool “VSI Patient Education” for more comprehensible and imaginable patient educations before epilepsy surgery and stereotactic implantation of DBS or stereo-EEG electrodes[J]. Epilepsy Res, 2020, 159: 106247.
27	Wu X, Liu R, Yu J, et al. Mixed reality technology launches in orthopedic surgery for comprehensive preoperative management of complicated cervical fractures[J]. Surg Innov, 2018, 25(4): 421-422.
28	Radtke A, Sotiropoulos GC, Molmenti EP, et al. Computer-assisted surgery planning for complex liver resections: when is it helpful? A single-center experience over an 8-year period[J]. Ann Surg, 2010, 252(5): 876-883.
29	Coelho G, Figueiredo EG, Rabelo NN, et al. Development and evaluation of pediatric mixed-reality model for neuroendoscopic surgical training[J]. World Neurosurg, 2020, 139: e189-e202.

[1]	Li Chenxi, PAREKEJIANG·Pataer , Gong Zhongcheng. Digitalized diagnosis and treatment of pigmented villonodular synovitis of temporomandibular joint: a case report [J]. West China Journal of Stomatology, 2023, 41(6): 725-730.
[2]	Wei Mianxing, Zhang Chong, Shi Bing, Li Chenghao.. One-year clinical observation of muscular force balance reconstruction technique for the correction of secondary nasal malformation after cleft lip surgery [J]. West China Journal of Stomatology, 2023, 41(5): 563-567.
[3]	Luo Xiao, Chen Yu, Shi Bing, Zheng Qian, Li Chenghao.. Three-dimensional reconstruction reveals the correlation between the extent of alveolar clefts and secondary nasal deformity in adults [J]. West China Journal of Stomatology, 2023, 41(4): 421-425.
[4]	Tang Hui, Wang Lang, Wang Lei, Rao Pengcheng, Luo Daowen, Fu Guangxin, Xiao Jingang. Modified tragus edge incision and transmasseteric anteroparotid approach to condyle reconstruction [J]. West China Journal of Stomatology, 2023, 41(3): 290-296.
[5]	Shan Xiaofeng, Cai Zhigang.. Dental implant treatment in vascularized bone flaps after jaw reconstruction [J]. West China Journal of Stomatology, 2023, 41(2): 123-128.
[6]	Li Chenghao, Shi Bing.. Two-stage alveolar bone grafting for nasal floor reconstruction in adult cleft patients [J]. West China Journal of Stomatology, 2023, 41(2): 129-133.
[7]	Sun Xinrong, Feng Yue, Liu Weicai.. Application of visualization technology of multimode data fusion in occlusal rehabilitation [J]. West China Journal of Stomatology, 2022, 40(4): 468-475.
[8]	Han Anpeng, Lu Fangli, Lu Yuping, Li Qiang, Chen Dong. Micro-CT study on isolated teeth with hereditary dentin defects [J]. West China Journal of Stomatology, 2022, 40(2): 162-168.
[9]	Kang Zebiao, Mai Xiaoxue, Wang Xin, Xie Fuqiang. Evaluation of the postoperative effect of computer-assisted free fibula mandibular reconstruction [J]. West China Journal of Stomatology, 2022, 40(2): 189-196.
[10]	Wang Lidong, Ma Wen, Fu Shuai, Zhang Changbin, Cui Qingying, Peng Canbang, Li Ming.. Application of digital guide plate based on drill-hole sharing in oral and maxillofacial surgery [J]. West China Journal of Stomatology, 2022, 40(1): 68-74.
[11]	Chen Yu, Liu Yingmeng, Zhang Bihe, Zheng Qian, Shi Bing, Li Chenghao. Force balance reconstruction of orbicularis oris in correction of unilateral cleft lip deformity [J]. West China Journal of Stomatology, 2021, 39(6): 698-702.
[12]	Liu Yingmeng, Chen Yu, Zhang Bihe, Shi Bing, Li Chenghao. Short-term nasal symmetry repaired by force-balanced muscular reconstruction technique [J]. West China Journal of Stomatology, 2021, 39(5): 560-565.
[13]	Liu Yang. Several important issues concerning occlusal reconstruction [J]. West China Journal of Stomatology, 2020, 38(4): 357-363.
[14]	Guo Zhiyong, Ding Zhangfan, Miao Cheng, Li Chunjie, Tang Xiufa, Zhang Zhuang. Application of mixed reality in oromaxillofacial head and neck oncology surgery: a preliminary study [J]. West China Journal of Stomatology, 2020, 38(4): 470-474.
[15]	Qiuping Peng, Jun Wu. Progress in exogenous factors affecting the growth and remodeling of condylar process [J]. West China Journal of Stomatology, 2017, 35(6): 643-647.