중강현실 기반의 최소침습수술용 인터페이스의 개발
Development of Immersive Augmented Reality interface for Minimally Invasive Surgery
2
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
This study developed a novel augmented reality interface for minimally invasive surgery. The augmented reality technique can alleviate the sensory feedback problem inherent to laparoscopic surgery. An augmented reality system merges real laparoscope image and reconstructed 3D patient model based on diagnostic medical image such as CT, MRI data. By using reconstructed 3D patient model, AR interface could express structure of patient body that is invisible outside visual field of laparoscope. Therefore, an augmented reality system improved sight information of limited laparoscope. In our augmented reality system, the laparoscopic view is located at the center of a wide-angle concave screen and reconstructed 3D patient model is displayed outside the laparoscope. By using a joystick, the laparoscopic view and the reconstructed 3D patient model view are changed concurrently. With our augmented reality system, the surgeon can see the peritoneal cavity from a wide angle of view, without having to move the laparoscope. Since the concave screen serves immersive environments, the surgeon can feel as if she is in the patient body. For these reasons, a surgeon can recognize easily depth information about inner parts of patient and position information of surgical instruments without laparoscope motion. It is possible for surgeon to manipulate surgical instruments more exact and fast. Therefore immersive augmented reality interface for minimally invasive surgery will reduce bodily, environmental load of a surgeon and increase efficiency of MIS.
Abstract
This study developed a novel augmented reality interface for minimally invasive surgery. The augmented reality technique can alleviate the sensory feedback problem inherent to laparoscopic surgery. An augmented reality system merges real laparoscope image and reconstructed 3D patient model based on diagnostic medical image such as CT, MRI data. By using reconstructed 3D patient model, AR interface could express structure of patient body that is invisible outside visual field of laparoscope. Therefore, an augmented reality system improved sight information of limited laparoscope. In our augmented reality system, the laparoscopic view is located at the center of a wide-angle concave screen and reconstructed 3D patient model is displayed outside the laparoscope. By using a joystick, the laparoscopic view and the reconstructed 3D patient model view are changed concurrently. With our augmented reality system, the surgeon can see the peritoneal cavity from a wide angle of view, without having to move the laparoscope. Since the concave screen serves immersive environments, the surgeon can feel as if she is in the patient body. For these reasons, a surgeon can recognize easily depth information about inner parts of patient and position information of surgical instruments without laparoscope motion. It is possible for surgeon to manipulate surgical instruments more exact and fast. Therefore immersive augmented reality interface for minimally invasive surgery will reduce bodily, environmental load of a surgeon and increase efficiency of MIS.
참고문헌 (20)
- Stijn De Buck, "A System to Support Laparoscopic Surgery by Augmented Reality Visualization", MICCAI, 2208, pp.691~698 (2001)
- Jeffrey H. Shuhaiber, "Augmented Reality in Surgery", Arch Surg. Vol, 139, pp.170~174 (2004)
- Jacques Marescaux, "Augmented- Reality–Assisted Laparoscopic Adrenalectomy", JAMA, 292(18), pp.2214~2215 (2004)
- Ronald T. Azuma, "In A Survey of Augmented Reality", Presence: Teleoperators and Virtual Environments, 6(4), pp.355~385 (1997)
- Tang SL, "Augmented reality systems for medical applications", IEEE Eng Med Biol Mag, 17(3), pp.49~58 (1998)
- P. J. Besl, "A method for registration of 3-d shapes", IEEE Trans. Pattern Analysis and Machine Intelligence, 14(2), pp.239~256 (1992)
- Z.Zhang, "Iterative point matching for registration of free-form curves and surfaces", International Journal of Computer Vision, 13(2), pp.119~152 (1994)
- J. Michael Fitzpatrick, "Predicting error in rigid-body,pointbased registration", IEEE Trans. Med. Imaging, 17(5), pp.694~702 (1998)
- P. H. Schonemann, "Fitting one matrix to another under choice of a central dilation and a rigid motion", Psychometrika, 35, pp.245~255 (1970)
- B.F.Green, "The orthogonal approximation of an oblique structure in factor analysis", Psychometrika, 17, pp.429~440 (1952)
- Ken Shoemake, "Matrix animation and polar decomposition", pp.258~264 (1992)
- Nicholas J Higham, "Computing the polar decomposition with applications", SIAM J. Sci. Stat. Comput, 7(4), pp.1160~1174 (1986)
- Chieh-hao Hsu, "distortion correction method for endoscope images based on calibration patterns and a simple mathematic model for optical lens", Biomedical Engineering Applications Basis & Communications, 17(6) (2005)
- Ramin Shahidi, "Implementation, Calibration and Accuracy Testing of an Image- Enhanced Endoscopy System", IEEE TRANSACTIONS ON MEDICAL IMAGING, 21(12) (2002)
- Michael R. Bax., "Real-time Lens Distortion Correction : 3D Video Graphics cards Are Good for More than Games", Stanford ECJ, pp.9~13 (2004)
- S. Shimizu, "International transmission of uncompressed endoscopic surgery images via superfast broadband Internet connections", Surg Endosc, 20, pp.167~170 (2006)
- N. Nakashima, "Telemedicine with Digital Video Transport System in Asia-Pacific Area", Telemedicine with Digital Video Transport System in Asia-Pacific Area (2005)
- Taylor RM II, "VRPN: a device-independent, network-transparent VR peripheral system", Proceedings of ACM Symposium on Virtual Reality Software & Technology, pp.55~56 (2001)
- M. Tavakoli, "A haptic interface for computer-integrated endoscopic surgery and training", Virtual Reality, 9, pp.160~176 (2006)
- M. Tavakoli, "Methods and mechanisms for contact feedback in a robot-assisted minimally invasive environment", Surg Endosc, 20, pp.1570~1579 (2006)