Integrating 3D Slicer with a Dynamic Simulator for Situational Aware Robotic Interventions
Authors:
Manish Sahu,
Hisashi Ishida,
Laura Connolly,
Hongyi Fan,
Anton Deguet,
Peter Kazanzides,
Francis X. Creighton,
Russell H. Taylor,
Adnan Munawar
Abstract:
Image-guided robotic interventions represent a transformative frontier in surgery, blending advanced imaging and robotics for improved precision and outcomes. This paper addresses the critical need for integrating open-source platforms to enhance situational awareness in image-guided robotic research. We present an open-source toolset that seamlessly combines a physics-based constraint formulation…
▽ More
Image-guided robotic interventions represent a transformative frontier in surgery, blending advanced imaging and robotics for improved precision and outcomes. This paper addresses the critical need for integrating open-source platforms to enhance situational awareness in image-guided robotic research. We present an open-source toolset that seamlessly combines a physics-based constraint formulation framework, AMBF, with a state-of-the-art imaging platform application, 3D Slicer. Our toolset facilitates the creation of highly customizable interactive digital twins, that incorporates processing and visualization of medical imaging, robot kinematics, and scene dynamics for real-time robot control. Through a feasibility study, we showcase real-time synchronization of a physical robotic interventional environment in both 3D Slicer and AMBF, highlighting low-latency updates and improved visualization.
△ Less
Submitted 22 January, 2024;
originally announced January 2024.
Hybrid Robot-assisted Frameworks for Endomicroscopy Scanning in Retinal Surgeries
Authors:
Zhaoshuo Li,
Mahya Shahbazi,
Niravkumar Patel,
Eimear O' Sullivan,
Haojie Zhang,
Khushi Vyas,
Preetham Chalasani,
Anton Deguet,
Peter L. Gehlbach,
Iulian Iordachita,
Guang-Zhong Yang,
Russell H. Taylor
Abstract:
High-resolution real-time intraocular imaging of retina at the cellular level is very challenging due to the vulnerable and confined space within the eyeball as well as the limited availability of appropriate modalities. A probe-based confocal laser endomicroscopy (pCLE) system, can be a potential imaging modality for improved diagnosis. The ability to visualize the retina at the cellular level co…
▽ More
High-resolution real-time intraocular imaging of retina at the cellular level is very challenging due to the vulnerable and confined space within the eyeball as well as the limited availability of appropriate modalities. A probe-based confocal laser endomicroscopy (pCLE) system, can be a potential imaging modality for improved diagnosis. The ability to visualize the retina at the cellular level could provide information that may predict surgical outcomes. The adoption of intraocular pCLE scanning is currently limited due to the narrow field of view and the micron-scale range of focus. In the absence of motion compensation, physiological tremors of the surgeons' hand and patient movements also contribute to the deterioration of the image quality.
Therefore, an image-based hybrid control strategy is proposed to mitigate the above challenges. The proposed hybrid control strategy enables a shared control of the pCLE probe between surgeons and robots to scan the retina precisely, with the absence of hand tremors and with the advantages of an image-based auto-focus algorithm that optimizes the quality of pCLE images. The hybrid control strategy is deployed on two frameworks - cooperative and teleoperated. Better image quality, smoother motion, and reduced workload are all achieved in a statistically significant manner with the hybrid control frameworks.
△ Less
Submitted 8 April, 2020; v1 submitted 15 September, 2019;
originally announced September 2019.
