-
Exploring Optical Flow Inclusion into nnU-Net Framework for Surgical Instrument Segmentation
Authors:
Marcos Fernández-Rodríguez,
Bruno Silva,
Sandro Queirós,
Helena R. Torres,
Bruno Oliveira,
Pedro Morais,
Lukas R. Buschle,
Jorge Correia-Pinto,
Estevão Lima,
João L. Vilaça
Abstract:
Surgical instrument segmentation in laparoscopy is essential for computer-assisted surgical systems. Despite the Deep Learning progress in recent years, the dynamic setting of laparoscopic surgery still presents challenges for precise segmentation. The nnU-Net framework excelled in semantic segmentation analyzing single frames without temporal information. The framework's ease of use, including it…
▽ More
Surgical instrument segmentation in laparoscopy is essential for computer-assisted surgical systems. Despite the Deep Learning progress in recent years, the dynamic setting of laparoscopic surgery still presents challenges for precise segmentation. The nnU-Net framework excelled in semantic segmentation analyzing single frames without temporal information. The framework's ease of use, including its ability to be automatically configured, and its low expertise requirements, have made it a popular base framework for comparisons. Optical flow (OF) is a tool commonly used in video tasks to estimate motion and represent it in a single frame, containing temporal information. This work seeks to employ OF maps as an additional input to the nnU-Net architecture to improve its performance in the surgical instrument segmentation task, taking advantage of the fact that instruments are the main moving objects in the surgical field. With this new input, the temporal component would be indirectly added without modifying the architecture. Using CholecSeg8k dataset, three different representations of movement were estimated and used as new inputs, comparing them with a baseline model. Results showed that the use of OF maps improves the detection of classes with high movement, even when these are scarce in the dataset. To further improve performance, future work may focus on implementing other OF-preserving augmentations.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
Tuning the bulk behavior and 2D interfacial self-assembly of microgels by Keggin-type polyoxometalate ionic specificity
Authors:
Antonio Rubio-Andrés,
Delfi Bastos-González,
Miguel Angel Fernandez-Rodriguez
Abstract:
Finding new ways to tune the behavior of thermoresponsive microgels in bulk and confined at 2D liquid interfaces is key to achieve a deeper understanding and control of these smart materials. We studied the interaction of positively charged pNIPAM microgels with the Keggin-type polyoxometalate $Na_{3}PW_{12}O_{40}$ (POM). In bulk, we observed charge inversions below and above the volume phase tran…
▽ More
Finding new ways to tune the behavior of thermoresponsive microgels in bulk and confined at 2D liquid interfaces is key to achieve a deeper understanding and control of these smart materials. We studied the interaction of positively charged pNIPAM microgels with the Keggin-type polyoxometalate $Na_{3}PW_{12}O_{40}$ (POM). In bulk, we observed charge inversions below and above the volume phase transition temperature (VPTT) at significantly low POM concentrations as $5\cdot10^{-5}$ M. In the presence of POM, the microgels exhibited a deswelling-swelling-deswelling behaviour below the VPTT, and a two-step further deswelling above the VPTT. When microgels were confined at 2D water/air interfaces, adding $10^{-5}$ M of POM below the VPTT was equivalent to heat above the VPTT and compress the monolayer from $5$ to $20\,\text{mN m$^{-1}$}$. Above the VPTT, the diameter at the interface did not change while the portion immersed in the subphase further deswelled, in agreement with the behavior in bulk. Adding more POM did not change the diameter at the interface nor the height of the microgels, showing a saturation effect in 2D. The restructuring of the pNIPAM polymeric network by the POM was characterized by EDS map** and XPS. The microgel monolayers with POM improved their resistance to plasma etching, which could be useful for soft colloidal lithography.
△ Less
Submitted 25 August, 2023; v1 submitted 27 February, 2023;
originally announced February 2023.
-
Hot Brownian Motion of thermoresponsive microgels in optical tweezers shows discontinuous volume phase transition and bistability
Authors:
Miguel Angel Fernandez-Rodriguez,
Sergio Orozco-Barrera,
Wei Sun,
Francisco Gámez,
Carlos Caro,
María L. García-Martín,
Raúl Alberto Rica
Abstract:
Microgels are soft microparticles that often exhibit thermoresponsiveness and feature a transformation at a critical temperature, referred to as the volume phase transition temperature. The question of whether this transformation occurs as a smooth or as a discontinuous one is still a matter of debate. This question can be addressed by studying individual microgels trapped in optical tweezers. For…
▽ More
Microgels are soft microparticles that often exhibit thermoresponsiveness and feature a transformation at a critical temperature, referred to as the volume phase transition temperature. The question of whether this transformation occurs as a smooth or as a discontinuous one is still a matter of debate. This question can be addressed by studying individual microgels trapped in optical tweezers. For this aim, composite particles were obtained by decorating pNIPAM microgels with iron oxide nanocubes. These composites become self-heating when illuminated by the infrared trap** laser, featuring Hot Brownian Motion within the trap. Above a certain laser power, a single decorated microgel features a volume phase transition that is discontinuous, while the usual continuous sigmoidal-like dependence is recovered after averaging over different microgels. The collective sigmoidal behavior enables the application of a power-to-temperature calibration and provides the effective drag coefficient of the self-heating microgels, thus establishing these composite particles as potential micro-thermometers and micro-heaters. Moreover, the self-heating microgels also exhibit an unexpected and intriguing bistability behavior above the critical temperature, probably due to partial collapses of the microgel. These results set the stage for further studies and the development of applications based on the Hot Brownian Motion of soft particles.
△ Less
Submitted 27 February, 2023;
originally announced February 2023.
-
Near-zero surface pressure assembly of rectangular lattices of microgels at fluid interfaces for colloidal lithography
Authors:
Miguel Angel Fernandez-Rodriguez,
Maria-Nefeli Antonopoulou,
Lucio Isa
Abstract:
Understanding and engineering the self-assembly of soft colloidal particles (microgels) at liquid-liquid interfaces is broadening their use in colloidal lithography. Here, we present a new route to assemble rectangular lattices of microgels at near zero surface pressure relying on the balance between attractive quadrupolar capillary interactions and steric repulsion among the particles at water/oi…
▽ More
Understanding and engineering the self-assembly of soft colloidal particles (microgels) at liquid-liquid interfaces is broadening their use in colloidal lithography. Here, we present a new route to assemble rectangular lattices of microgels at near zero surface pressure relying on the balance between attractive quadrupolar capillary interactions and steric repulsion among the particles at water/oil interfaces. These self-assembled rectangular lattices are obtained for a broad range of particles and, after deposition, can be used as lithography masks to obtain regular arrays of vertically aligned nanowires via wet and dry etching processes.
△ Less
Submitted 4 December, 2020; v1 submitted 13 October, 2020;
originally announced October 2020.
-
Reconfigurable Artificial Microswimmers with Internal Feedback
Authors:
L. Alvarez,
M. A. Fernandez-Rodriguez,
A. Alegria,
S. Arrese-Igor,
K. Zhao,
M. Kröger,
Lucio Isa
Abstract:
Micron-size self-propelling particles are often proposed as synthetic models for biological microswimmers, yet they lack internally regulated adaptation, which is central to the autonomy of their biological counterparts. Conversely, adaptation and autonomy can be encoded in larger-scale soft-robotic devices, but transferring these capabilities to the colloidal scale remains elusive. Here, we creat…
▽ More
Micron-size self-propelling particles are often proposed as synthetic models for biological microswimmers, yet they lack internally regulated adaptation, which is central to the autonomy of their biological counterparts. Conversely, adaptation and autonomy can be encoded in larger-scale soft-robotic devices, but transferring these capabilities to the colloidal scale remains elusive. Here, we create a new class of responsive microswimmers, powered by induced-charge electrophoresis, which can adapt their motility to external stimuli via an internal feedback. Using sequential capillary assembly, we fabricate deterministic colloidal clusters comprising soft thermoresponsive microparticles, which, upon spontaneous reconfiguration, induce motility changes, such as adaptation of the clusters' propulsion velocity and reversal of its direction. We rationalize the response in terms of a coupling between self-propulsion and variations of particle shape and dielectric properties. Harnessing those allows for strategies to achieve local dynamical control with simple illumination patterns, revealing exciting opportunities for the development of new tactic active materials.
△ Less
Submitted 17 September, 2020;
originally announced September 2020.
-
Self-Templating Assembly of Soft Microparticles into Complex Tessellations
Authors:
Fabio Grillo,
Miguel-Angel Fernandez-Rodriguez,
Maria-Nefeli Antonopoulou,
Dominic Gerber,
Lucio Isa
Abstract:
Self-assembled monolayers of microparticles encoding Archimedean and non-regular tessellations promise unprecedented structure-property relationships for a wide spectrum of applications in fields ranging from optoelectronics to surface technology. Yet, despite numerous computational studies predicting the emergence of exotic structures from simple interparticle interactions, the experimental reali…
▽ More
Self-assembled monolayers of microparticles encoding Archimedean and non-regular tessellations promise unprecedented structure-property relationships for a wide spectrum of applications in fields ranging from optoelectronics to surface technology. Yet, despite numerous computational studies predicting the emergence of exotic structures from simple interparticle interactions, the experimental realization of non-hexagonal patterns remains challenging. Not only kinetic limitations often hinder structural relaxation, but also programming the inteparticle interactions during assembly, and hence the target structure, remains an elusive task. Here, we demonstrate how a single type of soft polymeric microparticle (microgels) can be assembled into a wide array of complex structures as a result of simple pairwise interactions. We first let microgels self-assemble at a water-oil interface into a hexagonally packed monolayer, which we then compress to varying degrees and deposit onto a solid substrate. By repeating this process twice, we find that the resultant structure is not the mere stacking of two hexagonal patterns. The first monolayer retains its hexagonal structure and acts as a template into which the particles of the second monolayer rearrange to occupy interstitial positions. The frustration between the two lattices generates new symmetries. By simply varying the packing fraction of the two monolayers, we obtain not only low-coordination structures such as rectangular and honeycomb lattices, but also rhomboidal, hexagonal, and herringbone superlattices which display non-regular tessellations. Molecular dynamics simulations show that these structures are thermodynamically stable and develop from short-ranged repulsive interactions, making them easy to predict, and thus opening new avenues to the rational design of complex patterns.
△ Less
Submitted 29 November, 2019;
originally announced November 2019.
-
Active Brownian motion with orientation-dependent motility: theory and experiments
Authors:
Alexander R. Sprenger,
Miguel Angel Fernandez-Rodriguez,
Laura Alvarez,
Lucio Isa,
Raphael Wittkowski,
Hartmut Löwen
Abstract:
Combining experiments on active colloids, whose propulsion velocity can be controlled via a feedback loop, and theory of active Brownian motion, we explore the dynamics of an overdamped active particle with a motility that depends explicitly on the particle orientation. In this case, the active particle moves faster when oriented along one direction and slower when oriented along another, leading…
▽ More
Combining experiments on active colloids, whose propulsion velocity can be controlled via a feedback loop, and theory of active Brownian motion, we explore the dynamics of an overdamped active particle with a motility that depends explicitly on the particle orientation. In this case, the active particle moves faster when oriented along one direction and slower when oriented along another, leading to an anisotropic translational dynamics which is coupled to the particle's rotational diffusion. We propose a basic model of active Brownian motion for orientation-dependent motility. Based on this model, we obtain analytic results for the mean trajectories, averaged over the Brownian noise for various initial configurations, and for the mean-square displacements including their anisotropic non-Gaussian behavior. The theoretical results are found to be in good agreement with the experimental data. Our findings establish a methodology to engineer complex anisotropic motilities of active Brownian particles, with potential impact in the study of the swimming behavior of microorganisms subjected to anisotropic driving fields.
△ Less
Submitted 21 November, 2019;
originally announced November 2019.
-
Feedback-Controlled Active Brownian Colloids with Space-Dependent Rotational Dynamics
Authors:
Miguel Angel Fernandez-Rodriguez,
Fabio Grillo,
Laura Alvarez,
Marco Rathlef,
Ivo Buttinoni,
Giovanni Volpe,
Lucio Isa
Abstract:
The non-thermal nature of self-propelling colloids offers new insights into non-equilibrium physics. The central mathematical model to describe their trajectories is active Brownian motion, where a particle moves with a constant speed, while randomly changing direction due to rotational diffusion. While several feedback strategies exist to achieve position-dependent velocity, the possibility of sp…
▽ More
The non-thermal nature of self-propelling colloids offers new insights into non-equilibrium physics. The central mathematical model to describe their trajectories is active Brownian motion, where a particle moves with a constant speed, while randomly changing direction due to rotational diffusion. While several feedback strategies exist to achieve position-dependent velocity, the possibility of spatial and temporal control over rotational diffusion, which is inherently dictated by thermal fluctuations, remains untapped. Here, we decouple rotational diffusion from thermal noise. Using external magnetic fields and discrete-time feedback loops, we tune the rotational diffusivity of active colloids above and below its thermal value at will and explore a rich range of phenomena including anomalous diffusion, directed transport, and localization. These findings add a new dimension to the control of active matter, with implications for a broad range of disciplines, from optimal transport to smart materials.
△ Less
Submitted 14 June, 2020; v1 submitted 6 November, 2019;
originally announced November 2019.
-
Microgels Adsorbed at Liquid-Liquid Interfaces: A Joint Numerical and Experimental Study
Authors:
Fabrizio Camerin,
Miguel Angel Fernandez-Rodriguez,
Lorenzo Rovigatti,
Maria-Nefeli Antonopoulou,
Nicoletta Gnan,
Andrea Ninarello,
Lucio Isa,
Emanuela Zaccarelli
Abstract:
Soft particles display highly versatile properties with respect to hard colloids, even more so at fluid-fluid interfaces. In particular, microgels, consisting of a cross-linked polymer network, are able to deform and flatten upon adsorption at the interface due to the balance between surface tension and internal elasticity. Despite the existence of experimental results, a detailed theoretical unde…
▽ More
Soft particles display highly versatile properties with respect to hard colloids, even more so at fluid-fluid interfaces. In particular, microgels, consisting of a cross-linked polymer network, are able to deform and flatten upon adsorption at the interface due to the balance between surface tension and internal elasticity. Despite the existence of experimental results, a detailed theoretical understanding of this phenomenon is still lacking due to the absence of appropriate microscopic models. In this work, we propose an advanced modelling of microgels at a flat water/oil interface. The model builds on a realistic description of the internal polymeric architecture and single-particle properties of the microgel and is able to reproduce its experimentally observed shape at the interface. Complementing molecular dynamics simulations with in-situ cryo-electron microscopy experiments and atomic force microscopy imaging after Langmuir-Blodgett deposition, we compare the morphology of the microgels for different values of the cross-linking ratios. Our model allows for a systematic microscopic investigation of soft particles at fluid interfaces, which is essential to develop predictive power for the use of microgels in a broad range of applications, including the stabilization of smart emulsions and the versatile patterning of surfaces.
△ Less
Submitted 5 April, 2019;
originally announced April 2019.