-
HemoSet: The First Blood Segmentation Dataset for Automation of Hemostasis Management
Authors:
Albert J. Miao,
Shan Lin,
**gpei Lu,
Florian Richter,
Benjamin Ostrander,
Emily K. Funk,
Ryan K. Orosco,
Michael C. Yip
Abstract:
Hemorrhaging occurs in surgeries of all types, forcing surgeons to quickly adapt to the visual interference that results from blood rapidly filling the surgical field. Introducing automation into the crucial surgical task of hemostasis management would offload mental and physical tasks from the surgeon and surgical assistants while simultaneously increasing the efficiency and safety of the operati…
▽ More
Hemorrhaging occurs in surgeries of all types, forcing surgeons to quickly adapt to the visual interference that results from blood rapidly filling the surgical field. Introducing automation into the crucial surgical task of hemostasis management would offload mental and physical tasks from the surgeon and surgical assistants while simultaneously increasing the efficiency and safety of the operation. The first step in automation of hemostasis management is detection of blood in the surgical field. To propel the development of blood detection algorithms in surgeries, we present HemoSet, the first blood segmentation dataset based on bleeding during a live animal robotic surgery. Our dataset features vessel hemorrhage scenarios where turbulent flow leads to abnormal pooling geometries in surgical fields. These pools are formed in conditions endemic to surgical procedures -- uneven heterogeneous tissue, under glossy lighting conditions and rapid tool movement. We benchmark several state-of-the-art segmentation models and provide insight into the difficulties specific to blood detection. We intend for HemoSet to spur development of autonomous blood suction tools by providing a platform for training and refining blood segmentation models, addressing the precision needed for such robotics.
△ Less
Submitted 2 June, 2024; v1 submitted 24 March, 2024;
originally announced March 2024.
-
From Bench to Bedside: The First Live Robotic Surgery on the dVRK to Enable Remote Telesurgery with Motion Scaling
Authors:
Florian Richter,
Emily K. Funk,
Won Seo Park,
Ryan K. Orosco,
Michael C. Yip
Abstract:
Innovations from surgical robotic research rarely translates to live surgery due to the significant difference between the lab and a live environment. Live environments require considerations that are often overlooked during early stages of research such as surgical staff, surgical procedure, and the challenges of working with live tissue. One such example is the da Vinci Research Kit (dVRK) which…
▽ More
Innovations from surgical robotic research rarely translates to live surgery due to the significant difference between the lab and a live environment. Live environments require considerations that are often overlooked during early stages of research such as surgical staff, surgical procedure, and the challenges of working with live tissue. One such example is the da Vinci Research Kit (dVRK) which is used by over 40 robotics research groups and represents an open-sourced version of the da Vinci Surgical System. Despite dVRK being available for nearly a decade and the ideal candidate for translating research to practice on over 5,000 da Vinci Systems used in hospitals around the world, not one live surgery has been conducted with it. In this paper, we address the challenges, considerations, and solutions for translating surgical robotic research from bench-to-bedside. This is explained from the perspective of a remote telesurgery scenario where motion scaling solutions previously experimented in a lab setting are translated to a live pig surgery. This study presents results from the first ever use of a dVRK in a live animal and discusses how the surgical robotics community can approach translating their research to practice.
△ Less
Submitted 24 September, 2021;
originally announced September 2021.
-
Bimanual Regras** for Suture Needles using Reinforcement Learning for Rapid Motion Planning
Authors:
Zih-Yun Chiu,
Florian Richter,
Emily K. Funk,
Ryan K. Orosco,
Michael C. Yip
Abstract:
Regras** a suture needle is an important yet time-consuming process in suturing. To bring efficiency into regras**, prior work either designs a task-specific mechanism or guides the gripper toward some specific pick-up point for proper gras** of a needle. Yet, these methods are usually not deployable when the working space is changed. Therefore, in this work, we present rapid trajectory gene…
▽ More
Regras** a suture needle is an important yet time-consuming process in suturing. To bring efficiency into regras**, prior work either designs a task-specific mechanism or guides the gripper toward some specific pick-up point for proper gras** of a needle. Yet, these methods are usually not deployable when the working space is changed. Therefore, in this work, we present rapid trajectory generation for bimanual needle regras** via reinforcement learning (RL). Demonstrations from a sampling-based motion planning algorithm is incorporated to speed up the learning. In addition, we propose the ego-centric state and action spaces for this bimanual planning problem, where the reference frames are on the end-effectors instead of some fixed frame. Thus, the learned policy can be directly applied to any feasible robot configuration. Our experiments in simulation show that the success rate of a single pass is 97%, and the planning time is 0.0212s on average, which outperforms other widely used motion planning algorithms. For the real-world experiments, the success rate is 73.3% if the needle pose is reconstructed from an RGB image, with a planning time of 0.0846s and a run time of 5.1454s. If the needle pose is known beforehand, the success rate becomes 90.5%, with a planning time of 0.0807s and a run time of 2.8801s.
△ Less
Submitted 23 May, 2021; v1 submitted 9 November, 2020;
originally announced November 2020.
-
Autonomous Robotic Suction to Clear the Surgical Field for Hemostasis using Image-based Blood Flow Detection
Authors:
Florian Richter,
Shihao Shen,
Fei Liu,
**gbin Huang,
Emily K. Funk,
Ryan K. Orosco,
Michael C. Yip
Abstract:
Autonomous robotic surgery has seen significant progression over the last decade with the aims of reducing surgeon fatigue, improving procedural consistency, and perhaps one day take over surgery itself. However, automation has not been applied to the critical surgical task of controlling tissue and blood vessel bleeding--known as hemostasis. The task of hemostasis covers a spectrum of bleeding so…
▽ More
Autonomous robotic surgery has seen significant progression over the last decade with the aims of reducing surgeon fatigue, improving procedural consistency, and perhaps one day take over surgery itself. However, automation has not been applied to the critical surgical task of controlling tissue and blood vessel bleeding--known as hemostasis. The task of hemostasis covers a spectrum of bleeding sources and a range of blood velocity, trajectory, and volume. In an extreme case, an un-controlled blood vessel fills the surgical field with flowing blood. In this work, we present the first, automated solution for hemostasis through development of a novel probabilistic blood flow detection algorithm and a trajectory generation technique that guides autonomous suction tools towards pooling blood. The blood flow detection algorithm is tested in both simulated scenes and in a real-life trauma scenario involving a hemorrhage that occurred during thyroidectomy. The complete solution is tested in a physical lab setting with the da Vinci Research Kit (dVRK) and a simulated surgical cavity for blood to flow through. The results show that our automated solution has accurate detection, a fast reaction time, and effective removal of the flowing blood. Therefore, the proposed methods are powerful tools to clearing the surgical field which can be followed by either a surgeon or future robotic automation developments to close the vessel rupture.
△ Less
Submitted 18 January, 2021; v1 submitted 16 October, 2020;
originally announced October 2020.
-
CORD-19: The COVID-19 Open Research Dataset
Authors:
Lucy Lu Wang,
Kyle Lo,
Yoganand Chandrasekhar,
Russell Reas,
Jiangjiang Yang,
Doug Burdick,
Darrin Eide,
Kathryn Funk,
Yannis Katsis,
Rodney Kinney,
Yunyao Li,
Ziyang Liu,
William Merrill,
Paul Mooney,
Dewey Murdick,
Devvret Rishi,
Jerry Sheehan,
Zhihong Shen,
Brandon Stilson,
Alex Wade,
Kuansan Wang,
Nancy Xin Ru Wang,
Chris Wilhelm,
Boya Xie,
Douglas Raymond
, et al. (3 additional authors not shown)
Abstract:
The COVID-19 Open Research Dataset (CORD-19) is a growing resource of scientific papers on COVID-19 and related historical coronavirus research. CORD-19 is designed to facilitate the development of text mining and information retrieval systems over its rich collection of metadata and structured full text papers. Since its release, CORD-19 has been downloaded over 200K times and has served as the b…
▽ More
The COVID-19 Open Research Dataset (CORD-19) is a growing resource of scientific papers on COVID-19 and related historical coronavirus research. CORD-19 is designed to facilitate the development of text mining and information retrieval systems over its rich collection of metadata and structured full text papers. Since its release, CORD-19 has been downloaded over 200K times and has served as the basis of many COVID-19 text mining and discovery systems. In this article, we describe the mechanics of dataset construction, highlighting challenges and key design decisions, provide an overview of how CORD-19 has been used, and describe several shared tasks built around the dataset. We hope this resource will continue to bring together the computing community, biomedical experts, and policy makers in the search for effective treatments and management policies for COVID-19.
△ Less
Submitted 10 July, 2020; v1 submitted 22 April, 2020;
originally announced April 2020.
-
SuPer: A Surgical Perception Framework for Endoscopic Tissue Manipulation with Surgical Robotics
Authors:
Yang Li,
Florian Richter,
**gpei Lu,
Emily K. Funk,
Ryan K. Orosco,
Jianke Zhu,
Michael C. Yip
Abstract:
Traditional control and task automation have been successfully demonstrated in a variety of structured, controlled environments through the use of highly specialized modeled robotic systems in conjunction with multiple sensors. However, the application of autonomy in endoscopic surgery is very challenging, particularly in soft tissue work, due to the lack of high-quality images and the unpredictab…
▽ More
Traditional control and task automation have been successfully demonstrated in a variety of structured, controlled environments through the use of highly specialized modeled robotic systems in conjunction with multiple sensors. However, the application of autonomy in endoscopic surgery is very challenging, particularly in soft tissue work, due to the lack of high-quality images and the unpredictable, constantly deforming environment. In this work, we propose a novel surgical perception framework, SuPer, for surgical robotic control. This framework continuously collects 3D geometric information that allows for map** a deformable surgical field while tracking rigid instruments within the field. To achieve this, a model-based tracker is employed to localize the surgical tool with a kinematic prior in conjunction with a model-free tracker to reconstruct the deformable environment and provide an estimated point cloud as a map** of the environment. The proposed framework was implemented on the da Vinci Surgical System in real-time with an end-effector controller where the target configurations are set and regulated through the framework. Our proposed framework successfully completed soft tissue manipulation tasks with high accuracy. The demonstration of this novel framework is promising for the future of surgical autonomy. In addition, we provide our dataset for further surgical research.
△ Less
Submitted 14 February, 2020; v1 submitted 11 September, 2019;
originally announced September 2019.
-
Control of the third dimension in copper-based square-lattice antiferromagnets
Authors:
Paul A. Goddard,
John Singleton,
Isabel Franke,
Johannes S. Moller,
Tom Lancaster,
Andrew J. Steele,
Craig V. Top**,
Stephen J. Blundell,
Francis L. Pratt,
C. Baines,
Jesper Bendix,
Ross D. McDonald,
Jamie Brambleby,
Martin R. Lees,
Saul H. Lapidus,
Peter W. Stephens,
Brendan W. Twamley,
Marianne M. Conner,
Kylee Funk,
Jordan F. Corbey,
Hope E. Tran,
J. A. Schlueter,
Jamie L. Manson
Abstract:
Using a mixed-ligand synthetic scheme, we create a family of quasi-two-dimensional antiferromagnets, namely, [Cu(HF$_2$)(pyz)$_2$]ClO$_4$ [pyz = pyrazine], [Cu$L_2$(pyz)$_2$](ClO$_4$)$_2$ [$L$ = pyO = pyridine-N-oxide and 4-phpyO = 4-phenylpyridine-N-oxide. These materials are shown to possess equivalent two-dimensional [Cu(pyz)$_2$]$^{2+}$ nearly square layers, but exhibit interlayer spacings tha…
▽ More
Using a mixed-ligand synthetic scheme, we create a family of quasi-two-dimensional antiferromagnets, namely, [Cu(HF$_2$)(pyz)$_2$]ClO$_4$ [pyz = pyrazine], [Cu$L_2$(pyz)$_2$](ClO$_4$)$_2$ [$L$ = pyO = pyridine-N-oxide and 4-phpyO = 4-phenylpyridine-N-oxide. These materials are shown to possess equivalent two-dimensional [Cu(pyz)$_2$]$^{2+}$ nearly square layers, but exhibit interlayer spacings that vary from 6.5713~Å~to 16.777~Å, as dictated by the axial ligands. We present the structural and magnetic properties of this family as determined via x-ray diffraction, electron-spin resonance, pulsed- and quasistatic-field magnetometry and muon-spin rotation, and compare them to those of the prototypical two-dimensional magnetic polymer Cu(pyz)$_2$(ClO$_4$)$_2$. We find that, within the limits of the experimental error, the two-dimensional, {\it intralayer} exchange coupling in our family of materials remains largely unaffected by the axial ligand substitution, while the observed magnetic ordering temperature decreases slowly with increasing layer separation. Despite the structural motifs common to this family and Cu(pyz)$_2$(ClO$_4$)$_2$, the latter has significantly stronger two-dimensional exchange interactions and hence a higher ordering temperature. We discuss these results, as well as the mechanisms that might drive the long-range order in these materials, in terms of departures from the ideal $S=1/2$ two-dimensional square-lattice Heisenberg antiferromagnet. In particular, we find that both spin exchange anisotropy in the intralayer interaction and interlayer couplings (exchange, dipolar, or both) are needed to account for the observed ordering temperatures, with the intralayer anisotropy becoming more important as the layers are pulled further apart.
△ Less
Submitted 1 March, 2016;
originally announced March 2016.
-
Isotope effect in quasi-two-dimensional metal-organic antiferromagnets
Authors:
P. A. Goddard,
J. Singleton,
C. Maitland,
S. J. Blundell,
T. Lancaster,
P. J. Baker,
R. D. McDonald,
S. Cox,
P. Sengupta,
J. L. Manson,
K. A. Funk,
J. A. Schlueter
Abstract:
Although the isotope effect in superconducting materials is well-documented, changes in the magnetic properties of antiferromagnets due to isotopic substitution are seldom discussed and remain poorly understood. This is perhaps surprising given the possible link between the quasi-two-dimensional (Q2D) antiferromagnetic and superconducting phases of the layered cuprates. Here we report the experi…
▽ More
Although the isotope effect in superconducting materials is well-documented, changes in the magnetic properties of antiferromagnets due to isotopic substitution are seldom discussed and remain poorly understood. This is perhaps surprising given the possible link between the quasi-two-dimensional (Q2D) antiferromagnetic and superconducting phases of the layered cuprates. Here we report the experimental observation of shifts in the Néel temperature and critical magnetic fields ($ΔT_{\rm N}/T_{\rm N}\approx 4%$; $ΔB_{\rm c}/B_{\rm c}\approx 4%$) in a Q2D organic molecular antiferromagnets on substitution of hydrogen for deuterium. These compounds are characterized by strong hydrogen bonds through which the dominant superexchange is mediated. We evaluate how the in-plane and inter-plane exchange energies evolve as the hydrogens on different ligands are substituted, and suggest a possible mechanism for this effect in terms of the relative exchange efficiency of hydrogen and deuterium bonds.
△ Less
Submitted 11 July, 2008; v1 submitted 9 July, 2008;
originally announced July 2008.
