The 3D reconstruction of stomach anatomy using only monocular endoscopic images presents challenges due to various factors, including illumination changes and lack of distinct surface features. Previous works have encountered difficulties in achieving dense reconstructions of stomach anatomy. In this paper, we present a patient-specific, learning-based structure- from-motion (SfM) method capable of generating dense and accurate 3D reconstructions from monocular endoscopic images. We propose a pre-processing pipeline, which is applied to an existing method for sinus anatomy reconstruction and then fine-tuned specifically for stomach anatomy using our dataset. The challenge posed by texture-less stomach surfaces is addressed by employing dense point correspondences and volumetric depth fusion. The effectiveness and accuracy of our method are demonstrated using in vivo and ex vivo data, wherein we compare sparse and dense reconstructions from the original method and our proposed method. Our qualitative results indicate that the method can accurately estimate stomach shape in real human endoscopies, thereby laying the ground for performing real-time area coverage of the stomach.
목차
Abstract 1. Introduction 2. Related works 3. Methods 3.1. Dataset 3.2. Pre-Processing 3.3. Overall Pipeline 3.4. Training and Experimental setup 4. Experiment Result and Discussion 5. Conclusions Acknowledgment References
키워드
Endoscopy3D reconstructionCOLMAPSfMArea coverage.
저자
Saad Khalil [ Dept. of Intelligent Systems and Robotics Chungbuk National University ]
Bo-In Lee [ Dept. of Internal Medicine, Seoul St. Mary's Hospital The Catholic University of Korea ]
Sol Kim [ Dept. of Internal Medicine, Seoul St. Mary's Hospital The Catholic University of Korea ]
Youngbae Hwang [ Dept. of Intelligent Systems and Robotics Chungbuk National University ]
Corresponding Author