-
Perturbing Dynamics of Active Emulsions and Their Collectives
Authors:
Muhammad Turab Ali Khan,
Gaurav Gardi,
Ren Hao Soon,
Mingchao Zhang,
Metin Sitti
Abstract:
Controlling fluidic flows in active droplets is crucial in develo** intelligent models to understand and mimic single-celled microorganisms. Typically, these fluidic flows are affected by the interfacial dynamics of chemical agents. We found that these flows can be reconfigured by the mere presence of anisotropic solid boundary embedded within active droplets. Spontaneous fluidic flows dynamical…
▽ More
Controlling fluidic flows in active droplets is crucial in develo** intelligent models to understand and mimic single-celled microorganisms. Typically, these fluidic flows are affected by the interfacial dynamics of chemical agents. We found that these flows can be reconfigured by the mere presence of anisotropic solid boundary embedded within active droplets. Spontaneous fluidic flows dynamically orient an embedded magnetic cluster and the magnetic cluster, when realigned, causes these flows to reorient. Thus, providing an unprecedented control over the propulsion dynamics of chemotactic emulsions. When continuously perturbed, achiral emulsions exhibit emergent chiral motion with rotating fluidic flows. Such solid-fluid interactions removes barriers of specific emulsion chemistries and complements their inherent abilities thereby also enabling control over emergent collective behaviors of active droplets.
△ Less
Submitted 9 May, 2024;
originally announced May 2024.
-
A Simple Quantitative Model of Neuromodulation. Part I: Ion Flow Through Neural Ion Channels
Authors:
Linda Werneck,
Mertcan Han,
Erdost Yildiz,
Marc-André Keip,
Metin Sitti,
Michael Ortiz
Abstract:
We develop a simple model of ionic current through neuronal membranes as a function of membrane potential and extracellular ion concentration. The model combines a simplified Poisson-Nernst-Planck (PNP) model of ion transport through individual mechanosensitive ion channels with channel activation functions calibrated from ad hoc in-house experimental data. The simplified PNP model is validated ag…
▽ More
We develop a simple model of ionic current through neuronal membranes as a function of membrane potential and extracellular ion concentration. The model combines a simplified Poisson-Nernst-Planck (PNP) model of ion transport through individual mechanosensitive ion channels with channel activation functions calibrated from ad hoc in-house experimental data. The simplified PNP model is validated against bacterial Gramicidin A ion channel data. The calibrated model accounts for the transport of calcium, sodium, potassium, and chloride and exhibits remarkable agreement with the experimentally measured current-voltage curves for the differentiated human neural cells. All relevant data and code related to the ion flow models are available at DaRUS.
△ Less
Submitted 4 September, 2023;
originally announced September 2023.
-
Designing Covalent Organic Framework-based Light-driven Microswimmers towards Intraocular Theranostic Applications
Authors:
Varun Sridhar,
Erdost Yildiz,
Andrés Rodríguez-Camargo,
Xianglong Lyu,
Liang Yao,
Paul Wrede,
Amirreza Aghakhani,
Mukrime Birgul Akolpoglu,
Filip Podjaski,
Bettina V. Lotsch,
Metin Sitti
Abstract:
Even micromachines with tailored functionalities enable targeted therapeutic applications in biological environments, their controlled motion in biological media and drug delivery functions usually require sophisticated designs and complex propulsion apparatuses for practical applications. Covalent organic frameworks (COFs), new chemically versatile and nanoporous materials, offer microscale multi…
▽ More
Even micromachines with tailored functionalities enable targeted therapeutic applications in biological environments, their controlled motion in biological media and drug delivery functions usually require sophisticated designs and complex propulsion apparatuses for practical applications. Covalent organic frameworks (COFs), new chemically versatile and nanoporous materials, offer microscale multi-purpose solutions, which are not explored in light-driven micromachines. We describe and compare two different types of COFs, uniformly spherical TABP-PDA-COF sub-micron particles and texturally highly nanoporous, irregular, micron-sized TpAzo-COF particles as light-driven microrobots. They can be used as highly efficient visible-light-driven drug carriers in aqueous ionic and cellular media, even in intraocular fluids. Their absorption ranging down to red light enables phototaxis even in deeper biological media and the organic nature of COFs enables their biocompatibility. The inherently porous structure with ~2.5 nm structural pores, and large surface areas allow for targeted and efficient drug loading even for insoluble drugs and peptides, which can be released on demand. Also, indocyanine green (ICG) dye loading in the pores enables photoacoustic imaging or optical coherence tomography and hyperthermia in operando conditions. The real-time visualization of the drug-loaded COF microswimmers enables new insights into the function of porous organic micromachines, which will be useful to solve various drug delivery problems.
△ Less
Submitted 10 January, 2023;
originally announced January 2023.
-
MRI-powered Magnetic Miniature Capsule Robot with HIFU-controlled On-demand Drug Delivery
Authors:
Mehmet Efe Tiryaki,
Fatih Dogangun,
Cem Balda Dayan,
Paul Wrede,
Metin Sitti
Abstract:
Magnetic resonance imaging (MRI)-guided robotic systems offer great potential for new minimally invasive medical tools, including MRI-powered miniature robots. By re-purposing the imaging hardware of an MRI scanner, the magnetic miniature robot could be navigated into the remote part of the patient's body without needing tethered endoscopic tools. However, the state-of-art MRI-powered magnetic min…
▽ More
Magnetic resonance imaging (MRI)-guided robotic systems offer great potential for new minimally invasive medical tools, including MRI-powered miniature robots. By re-purposing the imaging hardware of an MRI scanner, the magnetic miniature robot could be navigated into the remote part of the patient's body without needing tethered endoscopic tools. However, the state-of-art MRI-powered magnetic miniature robots have limited functionality besides navigation. Here, we propose an MRI-powered magnetic miniature capsule robot benefiting from acoustic streaming forces generated by MRI-guided high-intensity focus ultrasound (HIFU) for controlled drug release. Our design comprises a polymer capsule shell with a submillimeter-diameter drug-release hole that captures an air bubble functioning as a stopper. We use the HIFU pulse to initiate drug release by removing the air bubble once the capsule robot reaches the target location. By controlling acoustic pressure, we also regulate the drug release rate for multiple location targeting during navigation. We demonstrated that the proposed magnetic capsule robot could travel at high speed up to 1.13 cm/s in ex vivo porcine small intestine and release drug to multiple target sites in a single operation, using a combination of MRI-powered actuation and HIFU-controlled release. The proposed MRI-guided microrobotic drug release system will greatly impact minimally invasive medical procedures by allowing on-demand targeted drug delivery.
△ Less
Submitted 17 January, 2023;
originally announced January 2023.
-
Design and Development of a Lorentz Force-Based MRI-Driven Neuroendoscope
Authors:
Martin Francis Phelan III,
Nihal Olcay Dogan,
Jelena Lazovic,
Metin Sitti
Abstract:
The introduction of neuroendoscopy, microneurosurgery, neuronavigation, and intraoperative imaging for surgical operations has made significant improvements over other traditionally invasive surgical techniques. The integration of magnetic resonance imaging (MRI)-driven surgical devices with intraoperative imaging and endoscopy can enable further advancements in surgical treatments and outcomes. T…
▽ More
The introduction of neuroendoscopy, microneurosurgery, neuronavigation, and intraoperative imaging for surgical operations has made significant improvements over other traditionally invasive surgical techniques. The integration of magnetic resonance imaging (MRI)-driven surgical devices with intraoperative imaging and endoscopy can enable further advancements in surgical treatments and outcomes. This work proposes the design and development of an MRI-driven endoscope leveraging the high (3-7 T), external magnetic field of an MR scanner for heat-mitigated steering within the ventricular system of the brain. It also demonstrates the effectiveness of a Lorentz force-based grasper for diseased tissue manipulation and ablation. Feasibility studies show the neuroendoscope can be steered precisely within the lateral ventricle to locate a tumor using both MRI and endoscopic guidance. Results also indicate gras** forces as high as 31 mN are possible and power inputs as low as 0.69 mW can cause cancerous tissue ablation. These findings enable further developments of steerable devices using MR imaging integrated with endoscopic guidance for improved outcomes.
△ Less
Submitted 18 September, 2022;
originally announced September 2022.
-
Biocompatible carbon nitride-based light-driven microswimmer propulsion in biological and ionic media with responsive on-demand drug delivery
Authors:
Varun Sridhar,
Filip Podjaski,
Yunus Alapan,
Julia Kröger,
Lars Grunenberg,
Vimal Kishore,
Bettina V. Lotsch,
Metin Sitti
Abstract:
We propose two-dimensional organic poly(heptazine imide) (PHI) carbon nitride microparticles as light-driven microswimmers in various ionic and biological media. Their demonstrated high-speed (15-23 $μ$m/s) swimming in multi-component ionic solutions with concentrations up to 1 M and without dedicated fuels is unprecedented, overcoming one of the bottlenecks of previous light-driven microswimmers.…
▽ More
We propose two-dimensional organic poly(heptazine imide) (PHI) carbon nitride microparticles as light-driven microswimmers in various ionic and biological media. Their demonstrated high-speed (15-23 $μ$m/s) swimming in multi-component ionic solutions with concentrations up to 1 M and without dedicated fuels is unprecedented, overcoming one of the bottlenecks of previous light-driven microswimmers. Such high ion tolerance is attributed to a favorable interplay between the particle's textural and structural nanoporosity and optoionic properties, facilitating ionic interactions in solutions with high salinity. Biocompatibility of the microswimmers is validated by cell viability tests with three different cell types and primary cells. The nanopores of the swimmers are loaded with a model cancer drug, doxorubicin (DOX), in high (185%) loading efficiency without passive release. Controlled drug release is reported in different pH conditions and can be triggered on-demand also by illumination. Light-triggered, boosted release of DOX and its active degradation products is demonstrated in oxygen-poor conditions using the intrinsic, environmentally sensitive and light-induced charge storage properties of PHI, which could enable future theranostic applications in oxygen-deprived tumor regions. These organic PHI microswimmers simultaneously solve the current light-driven microswimmer challenges of high ion tolerance, fuel-free high-speed propulsion in biological media, biocompatibility and controlled on-demand cargo release towards their biomedical, environmental and other potential future applications.
△ Less
Submitted 31 March, 2021;
originally announced March 2021.
-
Suction-based Soft Robotic Grip** of Rough and Irregular Parts
Authors:
Sukho Song,
Dirk-Michael Drotlef,
Donghoon Son,
Anastasia Koivikko,
Metin Sitti
Abstract:
Recently, suction-based robotic systems with microscopic features or active suction components have been proposed to grip rough and irregular surfaces. However, sophisticated fabrication methods or complex control systems are required for such systems, and robust attachment to rough real-world surfaces still remains a grand challenge. Here, we propose a fully soft robotic gripper, where a flat ela…
▽ More
Recently, suction-based robotic systems with microscopic features or active suction components have been proposed to grip rough and irregular surfaces. However, sophisticated fabrication methods or complex control systems are required for such systems, and robust attachment to rough real-world surfaces still remains a grand challenge. Here, we propose a fully soft robotic gripper, where a flat elastic membrane is used to conform and contact parts or surfaces well, where an internal negative pressure exerted on the air-sealed membrane induces the suction-based grip**. 3D printing in combination with soft molding techniques enable the fabrication of the soft gripper. Robust attachment to complex 3D and rough surfaces is enabled by the surface-conformable soft flat membrane, which generates strong and robust suction at the contact interface. Such robust attachment to rough and irregular surfaces enables manipulation of a broad range of real-world objects, such as an egg, lime, and foiled package, without any physical damage. Compared to the conventional suction cup designs, the proposed suction gripper design shows a four-fold increase in grip** performance on rough surfaces. Furthermore, the structural and material simplicity of the proposed gripper architecture facilitates its system-level integration with other soft robotic peripherals, which can enable broader impact in diverse fields, such as digital manufacturing, robotic manipulation, and medical grip** applications.
△ Less
Submitted 17 September, 2020;
originally announced September 2020.
-
Selectively Controlled Magnetic Microrobots with Opposing Helices
Authors:
Joshua Giltinan,
Panayiota Katsamba,
Wendong Wang,
Eric Lauga,
Metin Sitti
Abstract:
Magnetic microrobots that swim through liquid media are of interest for minimally invasive medical procedures, bioengineering, and manufacturing. Many of the envisaged applications, such as micromanipulation and targeted cargo delivery, necessitate the use and adequate control of multiple microrobots, which will increase the velocity, robustness, and efficacy of a procedure. While various methods…
▽ More
Magnetic microrobots that swim through liquid media are of interest for minimally invasive medical procedures, bioengineering, and manufacturing. Many of the envisaged applications, such as micromanipulation and targeted cargo delivery, necessitate the use and adequate control of multiple microrobots, which will increase the velocity, robustness, and efficacy of a procedure. While various methods involving heterogeneous geometries, magnetic properties, and surface chemistries have been proposed to enhance independent control, the main challenge has been that the motion between all microwsimmers remains coupled through the global control signal of the magnetic field. Katsamba and Lauga proposed transchiral microrobots, a theoretical design with magnetized spirals of opposite handedness. The competition between the spirals can be tuned to give an intrinsic nonlinearity that each device can function only within a given band of frequencies. This allows individual microrobots to be selectively controlled by varying the frequency of the rotating magnetic field. Here we present the experimental realization and characterization of transchiral micromotors composed of independently driven magnetic helices. We show a swimming micromotor that yields negligible net motion until a critical frequency is reached and a micromotor that changes its translation direction as a function of the frequency of the rotating magnetic field. This work demonstrates a crucial step towards completely decoupled and addressable swimming magnetic microrobots.
△ Less
Submitted 1 April, 2020;
originally announced April 2020.
-
Rotational Flows Generated by Microrobots Rotating Near Surfaces at Low Reynolds Number
Authors:
Zhou Ye,
Anirban Jana,
Metin Sitti
Abstract:
In this study, we use numerical simulations to investigate the flow field induced by a single magnetic microrobot rotating with a constant angular speed about an axis perpendicular to an underlying surface. A parallel solver for steady Stokes flow equations based on the boundary-element method is used for simulating these flows. A simple transformation is introduced to extend the predictive capabi…
▽ More
In this study, we use numerical simulations to investigate the flow field induced by a single magnetic microrobot rotating with a constant angular speed about an axis perpendicular to an underlying surface. A parallel solver for steady Stokes flow equations based on the boundary-element method is used for simulating these flows. A simple transformation is introduced to extend the predictive capability of the solver to cases with small unsteadiness. Flows induced by four simple robot shapes are investigated: sphere, upright cylinder, horizontally-laid cylinder, and five-pointed star-shaped prism. Shapes with cross-sections that are axisymmetric about the rotation axis (sphere and upright cylinder) generate time-invariant flow fields, which could be useful for applications such as micromanipulation. Non-axisymmetric shapes (horizontally-laid cylinder and the star-shaped prism) induce significant unsteadiness inside the flow field, which could be desirable for applications such as micromixing. Furthermore, a slender horizontally-laid cylinder generates substantially three-dimensional flows, an added benefit for micromixing applications. The presence of nearby walls such as a bottom substrate or sidewalls has a retarding effect on the induced flows, which is quantified. Finally, we present the driving torque and power-consumption of these microrobots rotating in viscous liquids. The numerical modeling platform used in this work can enable future optimal microrobot designs for a given application requirement.
△ Less
Submitted 12 March, 2020;
originally announced March 2020.
-
Characterization and Thermal Management of a DC Motor-Driven Resonant Actuator for Miniature Mobile Robots with Oscillating Limbs
Authors:
David Colmenares,
Randall Kania,
Miao Liu,
Metin Sitti
Abstract:
In this paper, we characterize the performance of and develop thermal management solutions for a DC motor-driven resonant actuator developed for flap** wing micro air vehicles. The actuator, a DC micro-gearmotor connected in parallel with a torsional spring, drives reciprocal wing motion. Compared to the gearmotor alone, this design increased torque and power density by 161.1% and 666.8%, respec…
▽ More
In this paper, we characterize the performance of and develop thermal management solutions for a DC motor-driven resonant actuator developed for flap** wing micro air vehicles. The actuator, a DC micro-gearmotor connected in parallel with a torsional spring, drives reciprocal wing motion. Compared to the gearmotor alone, this design increased torque and power density by 161.1% and 666.8%, respectively, while decreasing the drawn current by 25.8%. Characterization of the actuator, isolated from nonlinear aerodynamic loading, results in standard metrics directly comparable to other actuators. The micro-motor, selected for low weight considerations, operates at high power for limited duration due to thermal effects. To predict system performance, a lumped parameter thermal circuit model was developed. Critical model parameters for this micro-motor, two orders of magnitude smaller than those previously characterized, were identified experimentally. This included the effects of variable winding resistance, bushing friction, speed-dependent forced convection, and the addition of a heatsink. The model was then used to determine a safe operation envelope for the vehicle and to design a weight-optimal heatsink. This actuator design and thermal modeling approach could be applied more generally to improve the performance of any miniature mobile robot or device with motor-driven oscillating limbs or loads.
△ Less
Submitted 24 January, 2020;
originally announced February 2020.
-
Bio-inspired Flexible Twisting Wings Increase Lift and Efficiency of a Flap** Wing Micro Air Vehicle
Authors:
David Colmenares,
Randall Kania,
Wang Zhang,
Metin Sitti
Abstract:
We investigate the effect of wing twist flexibility on lift and efficiency of a flap**-wing micro air vehicle capable of liftoff. Wings used previously were chosen to be fully rigid due to modeling and fabrication constraints. However, biological wings are highly flexible and other micro air vehicles have successfully utilized flexible wing structures for specialized tasks. The goal of our study…
▽ More
We investigate the effect of wing twist flexibility on lift and efficiency of a flap**-wing micro air vehicle capable of liftoff. Wings used previously were chosen to be fully rigid due to modeling and fabrication constraints. However, biological wings are highly flexible and other micro air vehicles have successfully utilized flexible wing structures for specialized tasks. The goal of our study is to determine if dynamic twisting of flexible wings can increase overall aerodynamic lift and efficiency. A flexible twisting wing design was found to increase aerodynamic efficiency by 41.3%, translational lift production by 35.3%, and the effective lift coefficient by 63.7% compared to the rigid-wing design. These results exceed the predictions of quasi-steady blade element models, indicating the need for unsteady computational fluid dynamics simulations of twisted flap** wings.
△ Less
Submitted 23 January, 2020;
originally announced January 2020.
-
Order and Information in the Patterns of Spinning Magnetic Micro-disks at the Air-water Interface
Authors:
Wendong Wang,
Gaurav Gardi,
Paolo Malgaretti,
Vimal Kishore,
Lyndon Koens,
Donghoon Son,
Hunter Gilbert,
Zongyuan Wu,
Palak Harwani,
Eric Lauga,
Christian Holm,
Metin Sitti
Abstract:
The application of the Shannon entropy to study the relationship between information and structures has yielded insights into molecular and material systems. However, the difficulty in directly observing and manipulating atoms and molecules hampers the ability of these systems to serve as model systems for further exploring the links between information and structures. Here, we use, as a model exp…
▽ More
The application of the Shannon entropy to study the relationship between information and structures has yielded insights into molecular and material systems. However, the difficulty in directly observing and manipulating atoms and molecules hampers the ability of these systems to serve as model systems for further exploring the links between information and structures. Here, we use, as a model experimental system, hundreds of spinning magnetic micro-disks self-organizing at the air-water interface to generate various spatiotemporal patterns with varying degrees of orders. Using the neighbor distance as the information-bearing variable, we demonstrate the links among information, structure, and interactions. Most importantly, we establish a direct link between information and structure without using explicit knowledge of interactions. Finally, we show that the Shannon entropy by neighbor distances is a powerful observable in characterizing structural changes. Our findings are relevant for analyzing natural self-organizing systems and for designing collective robots.
△ Less
Submitted 16 January, 2022; v1 submitted 24 October, 2019;
originally announced October 2019.
-
Cohesive self-organization of mobile microrobotic swarms
Authors:
Berk Yigit,
Yunus Alapan,
Metin Sitti
Abstract:
Mobile microrobots are envisioned to be useful in a wide range of high-impact applications, many of which requiring cohesive group formation to maintain self-bounded swarms in the absence of confining boundaries. Cohesive group formation relies on a balance between attractive and repulsive interactions between agents. We found that a balance of magnetic dipolar attraction and multipolar repulsion…
▽ More
Mobile microrobots are envisioned to be useful in a wide range of high-impact applications, many of which requiring cohesive group formation to maintain self-bounded swarms in the absence of confining boundaries. Cohesive group formation relies on a balance between attractive and repulsive interactions between agents. We found that a balance of magnetic dipolar attraction and multipolar repulsion between self-assembled particle chain microrobots enable their self-organization into cohesive clusters. Self-organized microrobotic clusters translate above a solid substrate via a hydrodynamic self-propulsion mechanism. Cluster velocity increases with cluster size, resulting from collective hydrodynamic effects. Clustering is promoted by the strength of cohesive interactions and hindered by heterogeneities of individual microrobots. Scalability of cohesive interactions allows formation of larger groups, whose internal spatiotemporal organization undergoes a transition from solid-like ordering to liquid-like behavior with increasing cluster size. Our work elucidates the dynamics of clustering under cohesive interactions, and presents an approach for addressing operation of microrobots as localized teams.
△ Less
Submitted 2 July, 2019;
originally announced July 2019.
-
Monolithic shape-programmable dielectric liquid crystal elastomer actuators
Authors:
Zoey S. Davidson,
Hamed Shahsavan,
Amirreza Aghakhani,
Yubing Guo,
Lindsey Hines,
Yu Xia,
Shu Yang,
Metin Sitti
Abstract:
Macroscale robotic systems have demonstrated great capabilities of high speed, precise, and agile functions. However, the ability of soft robots to perform complex tasks, especially in centimeter and millimeter scale, remains limited due to the unavailability of fast, energy-efficient soft actuators that can programmably change shape. Here, we combine desirable characteristics from two distinct ac…
▽ More
Macroscale robotic systems have demonstrated great capabilities of high speed, precise, and agile functions. However, the ability of soft robots to perform complex tasks, especially in centimeter and millimeter scale, remains limited due to the unavailability of fast, energy-efficient soft actuators that can programmably change shape. Here, we combine desirable characteristics from two distinct active materials: fast and efficient actuation from dielectric elastomers and facile shape programmability from liquid crystal elastomers into a single shape changing electrical actuator. Uniaxially aligned monoliths achieve strain rates over 120%/s with energy conversion efficiency of 20% while moving loads over 700 times the actuator weight. The combined actuator technology offers unprecedented opportunities towards miniaturization with precision, efficiency, and more degrees of freedom for applications in soft robotics and beyond.
△ Less
Submitted 21 April, 2019;
originally announced April 2019.
-
The near and far of a pair of magnetic capillary disks
Authors:
Lyndon Koens,
Wendong Wang,
Metin Sitti,
Eric Lauga
Abstract:
Control on microscopic scales depends critically on our ability to manipulate interactions with different physical fields. The creation of micro-machines therefore requires us to understand how multiple fields, such as surface capillary or electro-magnetic, can be used to produce predictable behaviour. Recently, a spinning micro-raft system was developed that exhibited both static and dynamic self…
▽ More
Control on microscopic scales depends critically on our ability to manipulate interactions with different physical fields. The creation of micro-machines therefore requires us to understand how multiple fields, such as surface capillary or electro-magnetic, can be used to produce predictable behaviour. Recently, a spinning micro-raft system was developed that exhibited both static and dynamic self-assembly [Wang et al. (2017) Sci. Adv. 3, e1602522]. These rafts employed both capillary and magnetic interactions and, at a critical driving frequency, would suddenly change from stable orbital patterns to static assembled structures. In this paper, we explain the dynamics of two interacting micro-rafts through a combination of theoretical models and experiments. This is first achieved by identifying the governing physics of the orbital patterns, the assembled structures, and the collapse separately. We find that the orbital patterns are determined by the short range capillary interactions between the disks, while the explanations of the other two behaviours only require the capillary far field. Finally we combine the three models to explain the dynamics of a new micro-raft experiment.
△ Less
Submitted 23 January, 2019;
originally announced January 2019.
-
Programmable collective behavior in dynamically self-assembled mobile microrobotic swarms
Authors:
Berk Yigit,
Yunus Alapan,
Metin Sitti
Abstract:
Collective control of mobile microrobotic swarms is indispensable for their potential high-impact applications in targeted drug delivery, medical diagnostics, parallel micromanipulation, and environmental sensing and remediation. Lack of on-board computational and sensing capabilities in current microrobotic systems necessitates use of physical interactions among individual microrobots for local p…
▽ More
Collective control of mobile microrobotic swarms is indispensable for their potential high-impact applications in targeted drug delivery, medical diagnostics, parallel micromanipulation, and environmental sensing and remediation. Lack of on-board computational and sensing capabilities in current microrobotic systems necessitates use of physical interactions among individual microrobots for local physical communication and cooperation. Here, we show that mobile microrobotic swarms with well-defined collective behavior can be designed by engineering magnetic interactions among individual units. Microrobots, consisting of a linear chain of self-assembled magnetic microparticles, locomote on surfaces in response to a precessing magnetic field. Control over the direction of precessing magnetic field allows engineering attractive and repulsive interactions among microrobots and, thus, collective order with well-defined spatial organization and parallel operation over macroscale distances (~1 cm). These microrobotic swarms can be guided through confined spaces, while preserving microrobot morphology and function. These swarms can further achieve directional transport of large cargoes on surfaces and small cargoes in bulk fluids. Described design approach, exploiting physical interactions among individual robots, enables facile and rapid formation of self-organized and reconfigurable microrobotic swarms with programmable collective order.
△ Less
Submitted 25 July, 2018;
originally announced July 2018.
-
Magnetic-Visual Sensor Fusion-based Dense 3D Reconstruction and Localization for Endoscopic Capsule Robots
Authors:
Mehmet Turan,
Yasin Almalioglu,
Evin Pinar Ornek,
Helder Araujo,
Mehmet Fatih Yanik,
Metin Sitti
Abstract:
Reliable and real-time 3D reconstruction and localization functionality is a crucial prerequisite for the navigation of actively controlled capsule endoscopic robots as an emerging, minimally invasive diagnostic and therapeutic technology for use in the gastrointestinal (GI) tract. In this study, we propose a fully dense, non-rigidly deformable, strictly real-time, intraoperative map fusion approa…
▽ More
Reliable and real-time 3D reconstruction and localization functionality is a crucial prerequisite for the navigation of actively controlled capsule endoscopic robots as an emerging, minimally invasive diagnostic and therapeutic technology for use in the gastrointestinal (GI) tract. In this study, we propose a fully dense, non-rigidly deformable, strictly real-time, intraoperative map fusion approach for actively controlled endoscopic capsule robot applications which combines magnetic and vision-based localization, with non-rigid deformations based frame-to-model map fusion. The performance of the proposed method is demonstrated using four different ex-vivo porcine stomach models. Across different trajectories of varying speed and complexity, and four different endoscopic cameras, the root mean square surface reconstruction errors 1.58 to 2.17 cm.
△ Less
Submitted 2 March, 2018;
originally announced March 2018.
-
Unsupervised Odometry and Depth Learning for Endoscopic Capsule Robots
Authors:
Mehmet Turan,
Evin Pinar Ornek,
Nail Ibrahimli,
Can Giracoglu,
Yasin Almalioglu,
Mehmet Fatih Yanik,
Metin Sitti
Abstract:
In the last decade, many medical companies and research groups have tried to convert passive capsule endoscopes as an emerging and minimally invasive diagnostic technology into actively steerable endoscopic capsule robots which will provide more intuitive disease detection, targeted drug delivery and biopsy-like operations in the gastrointestinal(GI) tract. In this study, we introduce a fully unsu…
▽ More
In the last decade, many medical companies and research groups have tried to convert passive capsule endoscopes as an emerging and minimally invasive diagnostic technology into actively steerable endoscopic capsule robots which will provide more intuitive disease detection, targeted drug delivery and biopsy-like operations in the gastrointestinal(GI) tract. In this study, we introduce a fully unsupervised, real-time odometry and depth learner for monocular endoscopic capsule robots. We establish the supervision by war** view sequences and assigning the re-projection minimization to the loss function, which we adopt in multi-view pose estimation and single-view depth estimation network. Detailed quantitative and qualitative analyses of the proposed framework performed on non-rigidly deformable ex-vivo porcine stomach datasets proves the effectiveness of the method in terms of motion estimation and depth recovery.
△ Less
Submitted 2 March, 2018;
originally announced March 2018.
-
Thermocapillary-driven fluid flow within microchannels
Authors:
Guillermo J Amador,
Ahmet Fatih Tabak,
Ziyu Ren,
Yunus Alapan,
Oncay Yasa,
Metin Sitti
Abstract:
Surface tension gradients induce Marangoni flow, which may be exploited for fluid transport. At the micrometer scale, these surface-driven flows can be more significant than those driven by pressure. By introducing fluid-fluid interfaces on the walls of microfluidic channels, we use surface tension gradients to drive bulk fluid flows. The gradients are specifically induced through thermal energy,…
▽ More
Surface tension gradients induce Marangoni flow, which may be exploited for fluid transport. At the micrometer scale, these surface-driven flows can be more significant than those driven by pressure. By introducing fluid-fluid interfaces on the walls of microfluidic channels, we use surface tension gradients to drive bulk fluid flows. The gradients are specifically induced through thermal energy, exploiting the temperature dependence of a fluid-fluid interface to generate thermocapillary flow. In this report, we provide the design concept for a biocompatible, thermocapillary microchannel capable of being powered by solar irradiation. Using temperature gradients on the order of degrees Celsius per centimeter, we achieve fluid velocities on the order of millimeters per second. Following experimental observations, fluid dynamic models, and numerical simulation, we find that the fluid velocity is linearly proportional to the provided temperature gradient, enabling full control of the fluid flow within the microchannels.
△ Less
Submitted 1 February, 2018;
originally announced February 2018.
-
Kinetics of 2D-constrained orbitally-shaken particles
Authors:
Dhananjay Ipparthi,
Tijmen A. G. Hageman,
Nicolas Cambier,
Metin Sitti,
Marco Dorigo,
Leon Abelmann,
Massimo Mastrangeli
Abstract:
We present an experimental study of the kinetics of orbitally-shaken macroscopic particles confined to a two-dimensional bounded domain. Discounting the forcing action of the external periodic actuation, the particles show translational velocities and diffusivity consistent with a confined random walk model. Such experimental system may therefore represent a suitable macroscopic analog to investig…
▽ More
We present an experimental study of the kinetics of orbitally-shaken macroscopic particles confined to a two-dimensional bounded domain. Discounting the forcing action of the external periodic actuation, the particles show translational velocities and diffusivity consistent with a confined random walk model. Such experimental system may therefore represent a suitable macroscopic analog to investigate aspects of molecular dynamics and self-assembly.
△ Less
Submitted 16 August, 2018; v1 submitted 28 September, 2017;
originally announced October 2017.
-
Endo-VMFuseNet: Deep Visual-Magnetic Sensor Fusion Approach for Uncalibrated, Unsynchronized and Asymmetric Endoscopic Capsule Robot Localization Data
Authors:
Mehmet Turan,
Yasin Almalioglu,
Hunter Gilbert,
Alp Eren Sari,
Ufuk Soylu,
Metin Sitti
Abstract:
In the last decade, researchers and medical device companies have made major advances towards transforming passive capsule endoscopes into active medical robots. One of the major challenges is to endow capsule robots with accurate perception of the environment inside the human body, which will provide necessary information and enable improved medical procedures. We extend the success of deep learn…
▽ More
In the last decade, researchers and medical device companies have made major advances towards transforming passive capsule endoscopes into active medical robots. One of the major challenges is to endow capsule robots with accurate perception of the environment inside the human body, which will provide necessary information and enable improved medical procedures. We extend the success of deep learning approaches from various research fields to the problem of uncalibrated, asynchronous, and asymmetric sensor fusion for endoscopic capsule robots. The results performed on real pig stomach datasets show that our method achieves sub-millimeter precision for both translational and rotational movements and contains various advantages over traditional sensor fusion techniques.
△ Less
Submitted 22 September, 2017; v1 submitted 18 September, 2017;
originally announced September 2017.
-
EndoSensorFusion: Particle Filtering-Based Multi-sensory Data Fusion with Switching State-Space Model for Endoscopic Capsule Robots
Authors:
Mehmet Turan,
Yasin Almalioglu,
Hunter Gilbert,
Helder Araujo,
Taylan Cemgil,
Metin Sitti
Abstract:
A reliable, real time multi-sensor fusion functionality is crucial for localization of actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we propose a novel multi-sensor fusion approach based on a particle filter that incorporates an online estimation of sensor reliability…
▽ More
A reliable, real time multi-sensor fusion functionality is crucial for localization of actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we propose a novel multi-sensor fusion approach based on a particle filter that incorporates an online estimation of sensor reliability and a non-linear kinematic model learned by a recurrent neural network. Our method sequentially estimates the true robot pose from noisy pose observations delivered by multiple sensors. We experimentally test the method using 5 degree-of-freedom (5-DoF) absolute pose measurement by a magnetic localization system and a 6-DoF relative pose measurement by visual odometry. In addition, the proposed method is capable of detecting and handling sensor failures by ignoring corrupted data, providing the robustness expected of a medical device. Detailed analyses and evaluations are presented using ex-vivo experiments on a porcine stomach model prove that our system achieves high translational and rotational accuracies for different types of endoscopic capsule robot trajectories.
△ Less
Submitted 25 September, 2017; v1 submitted 8 September, 2017;
originally announced September 2017.
-
Sparse-then-Dense Alignment based 3D Map Reconstruction Method for Endoscopic Capsule Robots
Authors:
Mehmet Turan,
Yusuf Yigit Pilavci,
Ipek Ganiyusufoglu,
Helder Araujo,
Ender Konukoglu,
Metin Sitti
Abstract:
Since the development of capsule endoscopcy technology, substantial progress were made in converting passive capsule endoscopes to robotic active capsule endoscopes which can be controlled by the doctor. However, robotic capsule endoscopy still has some challenges. In particular, the use of such devices to generate a precise and globally consistent three-dimensional (3D) map of the entire inner or…
▽ More
Since the development of capsule endoscopcy technology, substantial progress were made in converting passive capsule endoscopes to robotic active capsule endoscopes which can be controlled by the doctor. However, robotic capsule endoscopy still has some challenges. In particular, the use of such devices to generate a precise and globally consistent three-dimensional (3D) map of the entire inner organ remains an unsolved problem. Such global 3D maps of inner organs would help doctors to detect the location and size of diseased areas more accurately, precisely, and intuitively, thus permitting more accurate and intuitive diagnoses. The proposed 3D reconstruction system is built in a modular fashion including preprocessing, frame stitching, and shading-based 3D reconstruction modules. We propose an efficient scheme to automatically select the key frames out of the huge quantity of raw endoscopic images. Together with a bundle fusion approach that aligns all the selected key frames jointly in a globally consistent way, a significant improvement of the mosaic and 3D map accuracy was reached. To the best of our knowledge, this framework is the first complete pipeline for an endoscopic capsule robot based 3D map reconstruction containing all of the necessary steps for a reliable and accurate endoscopic 3D map. For the qualitative evaluations, a real pig stomach is employed. Moreover, for the first time in literature, a detailed and comprehensive quantitative analysis of each proposed pipeline modules is performed using a non-rigid esophagus gastro duodenoscopy simulator, four different endoscopic cameras, a magnetically activated soft capsule robot (MASCE), a sub-millimeter precise optical motion tracker and a fine-scale 3D optical scanner.
△ Less
Submitted 29 August, 2017;
originally announced August 2017.
-
Deep EndoVO: A Recurrent Convolutional Neural Network (RCNN) based Visual Odometry Approach for Endoscopic Capsule Robots
Authors:
Mehmet Turan,
Yasin Almalioglu,
Helder Araujo,
Ender Konukoglu,
Metin Sitti
Abstract:
Ingestible wireless capsule endoscopy is an emerging minimally invasive diagnostic technology for inspection of the GI tract and diagnosis of a wide range of diseases and pathologies. Medical device companies and many research groups have recently made substantial progresses in converting passive capsule endoscopes to active capsule robots, enabling more accurate, precise, and intuitive detection…
▽ More
Ingestible wireless capsule endoscopy is an emerging minimally invasive diagnostic technology for inspection of the GI tract and diagnosis of a wide range of diseases and pathologies. Medical device companies and many research groups have recently made substantial progresses in converting passive capsule endoscopes to active capsule robots, enabling more accurate, precise, and intuitive detection of the location and size of the diseased areas. Since a reliable real time pose estimation functionality is crucial for actively controlled endoscopic capsule robots, in this study, we propose a monocular visual odometry (VO) method for endoscopic capsule robot operations. Our method lies on the application of the deep Recurrent Convolutional Neural Networks (RCNNs) for the visual odometry task, where Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) are used for the feature extraction and inference of dynamics across the frames, respectively. Detailed analyses and evaluations made on a real pig stomach dataset proves that our system achieves high translational and rotational accuracies for different types of endoscopic capsule robot trajectories.
△ Less
Submitted 8 September, 2017; v1 submitted 22 August, 2017;
originally announced August 2017.
-
A fully dense and globally consistent 3D map reconstruction approach for GI tract to enhance therapeutic relevance of the endoscopic capsule robot
Authors:
Mehmet Turan,
Yusuf Yigit Pilavci,
Redhwan Jamiruddin,
Helder Araujo,
Ender Konukoglu,
Metin Sitti
Abstract:
In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is emerging as a novel, minimally invasive diagnostic technology for inspection of the GI tract and diagnosis of a wide range of diseases and pathologies. Since the development of this technology, medical device companies and many research groups have made substantial progress in converting passive capsule en…
▽ More
In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is emerging as a novel, minimally invasive diagnostic technology for inspection of the GI tract and diagnosis of a wide range of diseases and pathologies. Since the development of this technology, medical device companies and many research groups have made substantial progress in converting passive capsule endoscopes to robotic active capsule endoscopes with most of the functionality of current active flexible endoscopes. However, robotic capsule endoscopy still has some challenges. In particular, the use of such devices to generate a precise three-dimensional (3D) map** of the entire inner organ remains an unsolved problem. Such global 3D maps of inner organs would help doctors to detect the location and size of diseased areas more accurately and intuitively, thus permitting more reliable diagnoses. To our knowledge, this paper presents the first complete pipeline for a complete 3D visual map reconstruction of the stomach. The proposed pipeline is modular and includes a preprocessing module, an image registration module, and a final shape-from-shading-based 3D reconstruction module; the 3D map is primarily generated by a combination of image stitching and shape-from-shading techniques, and is updated in a frame-by-frame iterative fashion via capsule motion inside the stomach. A comprehensive quantitative analysis of the proposed 3D reconstruction method is performed using an esophagus gastro duodenoscopy simulator, three different endoscopic cameras, and a 3D optical scanner.
△ Less
Submitted 18 May, 2017;
originally announced May 2017.
-
Magnetic-Visual Sensor Fusion based Medical SLAM for Endoscopic Capsule Robot
Authors:
Mehmet Turan,
Yasin Almalioglu,
Hunter Gilbert,
Helder Araujo,
Ender Konukoglu,
Metin Sitti
Abstract:
A reliable, real-time simultaneous localization and map** (SLAM) method is crucial for the navigation of actively controlled capsule endoscopy robots. These robots are an emerging, minimally invasive diagnostic and therapeutic technology for use in the gastrointestinal (GI) tract. In this study, we propose a dense, non-rigidly deformable, and real-time map fusion approach for actively controlled…
▽ More
A reliable, real-time simultaneous localization and map** (SLAM) method is crucial for the navigation of actively controlled capsule endoscopy robots. These robots are an emerging, minimally invasive diagnostic and therapeutic technology for use in the gastrointestinal (GI) tract. In this study, we propose a dense, non-rigidly deformable, and real-time map fusion approach for actively controlled endoscopic capsule robot applications. The method combines magnetic and vision based localization, and makes use of frame-to-model fusion and model-to-model loop closure. The performance of the method is demonstrated using an ex-vivo porcine stomach model. Across four trajectories of varying speed and complexity, and across three cameras, the root mean square localization errors range from 0.42 to 1.92 cm, and the root mean square surface reconstruction errors range from 1.23 to 2.39 cm.
△ Less
Submitted 5 November, 2017; v1 submitted 17 May, 2017;
originally announced May 2017.
-
A Non-Rigid Map Fusion-Based RGB-Depth SLAM Method for Endoscopic Capsule Robots
Authors:
Mehmet Turan,
Yasin Almalioglu,
Helder Araujo,
Ender Konukoglu,
Metin Sitti
Abstract:
In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is considered as a minimally invasive novel diagnostic technology to inspect the entire GI tract and to diagnose various diseases and pathologies. Since the development of this technology, medical device companies and many groups have made significant progress to turn such passive capsule endoscopes into robo…
▽ More
In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is considered as a minimally invasive novel diagnostic technology to inspect the entire GI tract and to diagnose various diseases and pathologies. Since the development of this technology, medical device companies and many groups have made significant progress to turn such passive capsule endoscopes into robotic active capsule endoscopes to achieve almost all functions of current active flexible endoscopes. However, the use of robotic capsule endoscopy still has some challenges. One such challenge is the precise localization of such active devices in 3D world, which is essential for a precise three-dimensional (3D) map** of the inner organ. A reliable 3D map of the explored inner organ could assist the doctors to make more intuitive and correct diagnosis. In this paper, we propose to our knowledge for the first time in literature a visual simultaneous localization and map** (SLAM) method specifically developed for endoscopic capsule robots. The proposed RGB-Depth SLAM method is capable of capturing comprehensive dense globally consistent surfel-based maps of the inner organs explored by an endoscopic capsule robot in real time. This is achieved by using dense frame-to-model camera tracking and windowed surfelbased fusion coupled with frequent model refinement through non-rigid surface deformations.
△ Less
Submitted 15 May, 2017;
originally announced May 2017.
-
A Deep Learning Based 6 Degree-of-Freedom Localization Method for Endoscopic Capsule Robots
Authors:
Mehmet Turan,
Yasin Almalioglu,
Ender Konukoglu,
Metin Sitti
Abstract:
We present a robust deep learning based 6 degrees-of-freedom (DoF) localization system for endoscopic capsule robots. Our system mainly focuses on localization of endoscopic capsule robots inside the GI tract using only visual information captured by a mono camera integrated to the robot. The proposed system is a 23-layer deep convolutional neural network (CNN) that is capable to estimate the pose…
▽ More
We present a robust deep learning based 6 degrees-of-freedom (DoF) localization system for endoscopic capsule robots. Our system mainly focuses on localization of endoscopic capsule robots inside the GI tract using only visual information captured by a mono camera integrated to the robot. The proposed system is a 23-layer deep convolutional neural network (CNN) that is capable to estimate the pose of the robot in real time using a standard CPU. The dataset for the evaluation of the system was recorded inside a surgical human stomach model with realistic surface texture, softness, and surface liquid properties so that the pre-trained CNN architecture can be transferred confidently into a real endoscopic scenario. An average error of 7:1% and 3:4% for translation and rotation has been obtained, respectively. The results accomplished from the experiments demonstrate that a CNN pre-trained with raw 2D endoscopic images performs accurately inside the GI tract and is robust to various challenges posed by reflection distortions, lens imperfections, vignetting, noise, motion blur, low resolution, and lack of unique landmarks to track.
△ Less
Submitted 15 May, 2017;
originally announced May 2017.
