-
Towards the Development of a Tendon-Actuated Galvanometer for Endoscopic Surgical Laser Scanning
Authors:
Kent K. Yamamoto,
Tanner J. Zachem,
Behnam Moradkhani,
Yash Chitalia,
Patrick J. Codd
Abstract:
There is a need for precision pathological sensing, imaging, and tissue manipulation in neurosurgical procedures, such as brain tumor resection. Precise tumor margin identification and resection can prevent further growth and protect critical structures. Surgical lasers with small laser diameters and steering capabilities can allow for new minimally invasive procedures by traversing through comple…
▽ More
There is a need for precision pathological sensing, imaging, and tissue manipulation in neurosurgical procedures, such as brain tumor resection. Precise tumor margin identification and resection can prevent further growth and protect critical structures. Surgical lasers with small laser diameters and steering capabilities can allow for new minimally invasive procedures by traversing through complex anatomy, then providing energy to sense, visualize, and affect tissue. In this paper, we present the design of a small-scale tendon-actuated galvanometer (TAG) that can serve as an end-effector tool for a steerable surgical laser. The galvanometer sensor design, fabrication, and kinematic modeling are presented and derived. It can accurately rotate up to 30.14 degrees (or a laser reflection angle of 60.28 degrees). A kinematic map** of input tendon stroke to output galvanometer angle change and a forward-kinematics model relating the end of the continuum joint to the laser end-point are derived and validated.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
An FBG-based Stiffness Estimation Sensor for In-vivo Diagnostics
Authors:
Behnam Moradkhani,
Pejman Kheradmand,
Harshith Jella,
Kent K. Yamamoto,
Alireza Tofangchi,
Patrick J. Codd,
Yash Chitalia
Abstract:
In-vivo tissue stiffness identification can be useful in pulmonary fibrosis diagnostics and minimally invasive tumor identification, among many other applications. In this work, we propose a palpation-based method for tissue stiffness estimation that uses a sensorized beam buckled onto the surface of a tissue. Fiber Bragg Gratings (FBGs) are used in our sensor as a shape-estimation modality to get…
▽ More
In-vivo tissue stiffness identification can be useful in pulmonary fibrosis diagnostics and minimally invasive tumor identification, among many other applications. In this work, we propose a palpation-based method for tissue stiffness estimation that uses a sensorized beam buckled onto the surface of a tissue. Fiber Bragg Gratings (FBGs) are used in our sensor as a shape-estimation modality to get real-time beam shape, even while the device is not visually monitored. A mechanical model is developed to predict the behavior of a buckling beam and is validated using finite element analysis and bench-top testing with phantom tissue samples (made of PDMS and PA-Gel). Bench-top estimations were conducted and the results were compared with the actual stiffness values. Mean RMSE and standard deviation (from the actual stiffnesses) values of 413.86 KPa and 313.82 KPa were obtained. Estimations for softer samples were relatively closer to the actual values. Ultimately, we used the stiffness sensor within a mock concentric tube robot as a demonstration of \textit{in-vivo} sensor feasibility. Bench-top trials with and without the robot demonstrate the effectiveness of this unique sensing modality in \textit{in-vivo} applications.
△ Less
Submitted 30 May, 2024;
originally announced May 2024.
-
Surface-Enhanced Raman Spectroscopy and Transfer Learning Toward Accurate Reconstruction of the Surgical Zone
Authors:
Ashutosh Raman,
Ren A. Odion,
Kent K. Yamamoto,
Weston Ross,
Tuan Vo-Dinh,
Patrick J. Codd
Abstract:
Raman spectroscopy, a photonic modality based on the inelastic backscattering of coherent light, is a valuable asset to the intraoperative sensing space, offering non-ionizing potential and highly-specific molecular fingerprint-like spectroscopic signatures that can be used for diagnosis of pathological tissue in the dynamic surgical field. Though Raman suffers from weakness in intensity, Surface-…
▽ More
Raman spectroscopy, a photonic modality based on the inelastic backscattering of coherent light, is a valuable asset to the intraoperative sensing space, offering non-ionizing potential and highly-specific molecular fingerprint-like spectroscopic signatures that can be used for diagnosis of pathological tissue in the dynamic surgical field. Though Raman suffers from weakness in intensity, Surface-Enhanced Raman Spectroscopy (SERS), which uses metal nanostructures to amplify Raman signals, can achieve detection sensitivities that rival traditional photonic modalities. In this study, we outline a robotic Raman system that can reliably pinpoint the location and boundaries of a tumor embedded in healthy tissue, modeled here as a tissue-mimicking phantom with selectively infused Gold Nanostar regions. Further, due to the relative dearth of collected biological SERS or Raman data, we implement transfer learning to achieve 100% validation classification accuracy for Gold Nanostars compared to Control Agarose, thus providing a proof-of-concept for Raman-based deep learning training pipelines. We reconstruct a surgical field of 30x60mm in 10.2 minutes, and achieve 98.2% accuracy, preserving relative measurements between features in the phantom. We also achieve an 84.3% Intersection-over-Union score, which is the extent of overlap between the ground truth and predicted reconstructions. Lastly, we also demonstrate that the Raman system and classification algorithm do not discern based on sample color, but instead on presence of SERS agents. This study provides a crucial step in the translation of intelligent Raman systems in intraoperative oncological spaces.
△ Less
Submitted 16 January, 2024;
originally announced January 2024.
-
Computer Vision for Increased Operative Efficiency via Identification of Instruments in the Neurosurgical Operating Room: A Proof-of-Concept Study
Authors:
Tanner J. Zachem,
Sully F. Chen,
Vishal Venkatraman,
David AW Sykes,
Ravi Prakash,
Koumani W. Ntowe,
Mikhail A. Bethell,
Samantha Spellicy,
Alexander D Suarez,
Weston Ross,
Patrick J. Codd
Abstract:
Objectives Computer vision (CV) is a field of artificial intelligence that enables machines to interpret and understand images and videos. CV has the potential to be of assistance in the operating room (OR) to track surgical instruments. We built a CV algorithm for identifying surgical instruments in the neurosurgical operating room as a potential solution for surgical instrument tracking and mana…
▽ More
Objectives Computer vision (CV) is a field of artificial intelligence that enables machines to interpret and understand images and videos. CV has the potential to be of assistance in the operating room (OR) to track surgical instruments. We built a CV algorithm for identifying surgical instruments in the neurosurgical operating room as a potential solution for surgical instrument tracking and management to decrease surgical waste and opening of unnecessary tools. Methods We collected 1660 images of 27 commonly used neurosurgical instruments. Images were labeled using the VGG Image Annotator and split into 80% training and 20% testing sets in order to train a U-Net Convolutional Neural Network using 5-fold cross validation. Results Our U-Net achieved a tool identification accuracy of 80-100% when distinguishing 25 classes of instruments, with 19/25 classes having accuracy over 90%. The model performance was not adequate for sub classifying Adson, Gerald, and Debakey forceps, which had accuracies of 60-80%. Conclusions We demonstrated the viability of using machine learning to accurately identify surgical instruments. Instrument identification could help optimize surgical tray packing, decrease tool usage and waste, decrease incidence of instrument misplacement events, and assist in timing of routine instrument maintenance. More training data will be needed to increase accuracy across all surgical instruments that would appear in a neurosurgical operating room. Such technology has the potential to be used as a method to be used for proving what tools are truly needed in each type of operation allowing surgeons across the world to do more with less.
△ Less
Submitted 29 April, 2024; v1 submitted 3 December, 2023;
originally announced December 2023.
-
Incident Angle Study for Designing an Endoscopic Tool for Intraoperative Brain Tumor Detection
Authors:
Kent Y. Yamamoto,
Tanner J. Zachem,
Weston A. Ross,
Patrick J. Codd
Abstract:
In neurosurgical procedures maximizing the resection of tumor tissue while avoiding healthy tissue is of paramount importance and a difficult task due to many factors, such as surrounding eloquent brain. Swiftly identifying tumor tissue for removal could increase surgical outcomes. The TumorID is a laser-induced fluorescence spectroscopy device that utilizes endogenous fluorophores such as NADH an…
▽ More
In neurosurgical procedures maximizing the resection of tumor tissue while avoiding healthy tissue is of paramount importance and a difficult task due to many factors, such as surrounding eloquent brain. Swiftly identifying tumor tissue for removal could increase surgical outcomes. The TumorID is a laser-induced fluorescence spectroscopy device that utilizes endogenous fluorophores such as NADH and FAD to detect tumor regions. With the goal of creating an endoscopic tool for intraoperative tumor detection in mind, a study of the TumorID was conducted to assess how the angle of incidence (AoI) affects the collected spectral response of the scanned tumor. For this study, flat and convex NADH/FAD gellan gum phantoms were scanned at various AoI (a range of 36 degrees) to observe the spectral behavior. Results showed that spectral signature did not change significantly across flat and convex phantoms, and the Area under Curve (AUC) values calculated for each spectrum had a standard deviation of 0.02 and 0.01 for flat and convex phantoms, respectively. Therefore, the study showed that AoI will affect the intensity of the spectral response, but the peaks representative of the endogenous fluorophores are still observable and similar. Future work includes conducting an AoI study with a longer working-distance lens, then incorporating said lens to design an endoscopic, intraoperative tumor detection device for minimally invasive surgery, with first applications in endonasal endoscopic approaches for pituitary tumors.
△ Less
Submitted 7 November, 2023;
originally announced November 2023.
-
Robotic Laser Orientation Planning with a 3D Data-driven Method
Authors:
Guangshen Ma,
Weston Ross,
Patrick J. Codd
Abstract:
This paper focuses on a research problem of robotic controlled laser orientation to minimize errant overcutting of healthy tissue during the course of pathological tissue resection. Laser scalpels have been widely used in surgery to remove pathological tissue targets such as tumors or other lesions. However, different laser orientations can create various tissue ablation cavities, and incorrect in…
▽ More
This paper focuses on a research problem of robotic controlled laser orientation to minimize errant overcutting of healthy tissue during the course of pathological tissue resection. Laser scalpels have been widely used in surgery to remove pathological tissue targets such as tumors or other lesions. However, different laser orientations can create various tissue ablation cavities, and incorrect incident angles can cause over-irradiation of healthy tissue that should not be ablated. This work aims to formulate an optimization problem to find the optimal laser orientation in order to minimize the possibility of excessive laser-induced tissue ablation. We first develop a 3D data-driven geometric model to predict the shape of the tissue cavity after a single laser ablation. Modelling the target and non-target tissue region by an obstacle boundary, the determination of an optimal orientation is converted to a collision-minimization problem. The goal of this optimization formulation is maintaining the ablated contour distance from the obstacle boundary, which is solved by Projected gradient descent. Simulation experiments were conducted and the results validated the proposed method with conditions of various obstacle shapes and different initial incident angles.
△ Less
Submitted 4 January, 2022;
originally announced January 2022.
-
FIRST J153350.8+272729: the radio afterglow of a decades-old tidal disruption event
Authors:
Vikram Ravi,
Hannah Dykaar,
Jackson Codd,
Ginevra Zaccagnini,
Dillon Dong,
Maria R. Drout,
Bryan M. Gaensler,
Gregg Hallinan,
Casey Law
Abstract:
We present the discovery of the fading radio transient FIRST J153350.8+272729. The source had a maximum observed 5-GHz radio luminosity of $8\times10^{39}$ erg s$^{-1}$ in 1986, but by 2019 had faded by a factor of nearly 400. It is located 0.15 arcsec from the center of a galaxy (SDSS J153350.89+272729) at 147 Mpc, which shows weak Type II Seyfert activity. We show that a tidal disruption event (…
▽ More
We present the discovery of the fading radio transient FIRST J153350.8+272729. The source had a maximum observed 5-GHz radio luminosity of $8\times10^{39}$ erg s$^{-1}$ in 1986, but by 2019 had faded by a factor of nearly 400. It is located 0.15 arcsec from the center of a galaxy (SDSS J153350.89+272729) at 147 Mpc, which shows weak Type II Seyfert activity. We show that a tidal disruption event (TDE) is the preferred scenario for FIRST J153350.8+272729, although it could plausibly be interpreted as the afterglow of a long-duration gamma-ray burst. This is only the second TDE candidate to be first discovered at radio wavelengths. Its luminosity fills a gap between the radio afterglows of sub-relativistic TDEs in the local universe, and relativistic TDEs at high redshifts. The unusual properties of FIRST J153350.8+272729 (ongoing nuclear activity in the host galaxy, high radio luminosity) motivate more extensive TDE searches in untargeted radio surveys.
△ Less
Submitted 10 February, 2021;
originally announced February 2021.