Simulation Method for the Physical Deformation of a Three-Dimensional Soft Body in Augmented Reality-Based External Ventricular Drainage
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
Objectives: Intraoperative navigation reduces the risk of major complications and increases the likelihood of optimal surgical outcomes. This paper presents an augmented reality (AR)-based simulation technique for ventriculostomy that visualizes brain deformations caused by the movements of a surgical instrument in a three-dimensional brain model. This is achieved by utilizing a position-based dynamics (PBD) physical deformation method on a preoperative brain image.Methods: An infrared camera-based AR surgical environment aligns the real-world space with a virtual space and tracks the surgical instruments. For a realistic representation and reduced simulation computation load, a hybrid geometric model is employed, which combines a high-resolution mesh model and a multiresolution tetrahedron model. Collision handling is executed when a collision between the brain and surgical instrument is detected. Constraints are used to preserve the properties of the soft body and ensure stable deformation.Results: The experiment was conducted once in a phantom environment and once in an actual surgical environment. The tasks of inserting the surgical instrument into the ventricle using only the navigation information presented through the smart glasses and verifying the drainage of cerebrospinal fluid were evaluated. These tasks were successfully completed, as indicated by the drainage, and the deformation simulation speed averaged 18.78 fps.Conclusions: This experiment confirmed that the AR-based method for external ventricular drain surgery was beneficial to clinicians.
Abstract
Objectives: Intraoperative navigation reduces the risk of major complications and increases the likelihood of optimal surgical outcomes. This paper presents an augmented reality (AR)-based simulation technique for ventriculostomy that visualizes brain deformations caused by the movements of a surgical instrument in a three-dimensional brain model. This is achieved by utilizing a position-based dynamics (PBD) physical deformation method on a preoperative brain image.Methods: An infrared camera-based AR surgical environment aligns the real-world space with a virtual space and tracks the surgical instruments. For a realistic representation and reduced simulation computation load, a hybrid geometric model is employed, which combines a high-resolution mesh model and a multiresolution tetrahedron model. Collision handling is executed when a collision between the brain and surgical instrument is detected. Constraints are used to preserve the properties of the soft body and ensure stable deformation.Results: The experiment was conducted once in a phantom environment and once in an actual surgical environment. The tasks of inserting the surgical instrument into the ventricle using only the navigation information presented through the smart glasses and verifying the drainage of cerebrospinal fluid were evaluated. These tasks were successfully completed, as indicated by the drainage, and the deformation simulation speed averaged 18.78 fps.Conclusions: This experiment confirmed that the AR-based method for external ventricular drain surgery was beneficial to clinicians.
참고문헌 (30)
- Chen Y, "An overview of augmented reality technology", J Phys Conf Ser, 1237(2), pp.022082~ (2019)[DOI]
- Mishra R, "Virtual reality in neurosurgery : beyond neurosurgical planning", Int J Environ Res Public Health, 19(3), pp.1719~ (2022)[DOI]
- Bhushan S, "Use of augmented reality and virtual reality technologies in endoscopic training", Clin Gastroenterol Hepatol, 6(11), pp.1688~1691 (2018)[DOI]
- 박상민, "증강현실을 이용한 척추 수술", 대한척추외과학회지, 26(1), pp.26~32 (2019), 대한척추외과학회
- Chen Y, "An overview of augmented reality technology", J Phys Conf Ser, 1237(2), pp.022082~ (2019)[DOI]
- Cabrilo I, "Augmented reality in the surgery of cerebral arteriovenous malformations : technique assessment and considerations", Acta Neurochir(Wien), 156(9), pp.1769~1774 (2014)[DOI]
- Besharati Tabrizi L, "Augmented realityguided neurosurgery : accuracy and intraoperative application of an image projection technique", J Neurosurg, 123(1), pp.206~211 (2015)[DOI]
- Watanabe E, "The trans-visible navigator : a see-through neuronavigation system using augmented reality", World Neurosurg, 87, pp.399~405 (2016)[DOI]
- Gerard IJ, "Brain shift in neuronavigation of brain tumors : a review", Med Image Anal, 35, pp.403~420 (2017)[DOI]
- Vigo V, "Ideal trajectory for frontal ventriculostomy : radiological study and anatomical study", Clin Neurol Neurosurg, 217, pp.107264~ (2022)[DOI]
- Amoo M, "Common trajectories for freehand frontal ventriculostomy : a systematic review", World Neurosurg, 146, pp.292~297 (2021)[DOI]
- Hamze N, "Preoperative trajectory planning for percutaneous procedures in deformable environments", Comput Med Imaging Graph, 47, pp.16~28 (2016)[DOI]
- Bayer S, "Intraoperative imaging modalities and compensation for brain shift in tumor resection surgery", Int J Biomed Imaging, 2017, pp.6028645~ (2017)[DOI]
- Fukuhara A, "Proposition and evaluation of a collision detection method for real time surgery simulation of opening a brain fissure", ROBOMECH J, 1, pp.6~ (2014)[DOI]
- Forte AE, "Models and tissue mimics for brain shift simulations", Biomech Model Mechanobiol, 17(1), pp.249~261 (2018)[DOI]
- Muller M, "Position based dynamics", J Vis Commun Image Represent, 18(2), pp.109~118 (2007)[DOI]
- Pan J, "Real-time dissection of organs via hybrid coupling of geometric metaballs and physics-centric mesh-free method", Vis Comput, 34, pp.105~116 (2018)[DOI]
- Pan J, "Real-time haptic manipulation and cutting of hybrid soft tissue models by extended position-based dynamics", Comput Anim Virtual Worlds, 26(3-4), pp.321~335 (2015)[DOI]
- Romeo M, "Muscle and fascia simulation with extended position based dynamics", Comput Graph Forum, 39(1), pp.134~146 (2020)[DOI]
- Mortensen EN, "Interactive segmentation with intelligent scissors", Graph Models Image Process, 60(5), pp.349~384 (1998)[DOI]
- Lorensen WE, "Marching cubes : a high resolution 3D surface construction algorithm", ACM SIGGRAPH Comput Graph, 21(4), pp.163~169 (1987)[DOI]
- Allard J, "SOFA : an open source framework for medical simulation", Stud Health Technol Inform, 125, pp.13~18 (2007)
- Kim J, "Adaptive tetrahedral mesh generation for non-uniform soft tissue simulation", Hum Cent Comput Inf Sci, 11, pp.29~ (2021)[DOI]
- Muller M, "Interactive virtual materials", Proceedings of the Graphics Interface 2004 Conference, pp.239~246 (2004)
- "Motive: optical motion capture software" (2023)[URL]
- Kim JD, "Application of augmented reality for surgical guidance", pp.2020
- Kelager M, "A triangle bending constraint model for position-based dynamics", Proceedings of the Workshop on Virtual Reality Interaction and Physical Simulation, pp.31~37 (2010)
- Palmer IJ, "Collision detection for animation using sphere-trees", Comput Graph Forum, 14(2), pp.105~116 (1995)[DOI]
- Yang C, "Real-time physical deformation and cutting of heterogeneous objects via hybrid coupling of meshless approach and finite element method", Comput Anim Virtual Worlds, 25(3-4), pp.421~433 (2014)[DOI]
- Xu L, "Integrating viscoelastic mass spring dampers into position-based dynamics to simulate soft tissue deformation in real time", R Soc Open Sci, 5(2), pp.171587~ (2018)[DOI]