Showing 1–5 of 5 results for author: Rauby, B

Pruning Sparse Tensor Neural Networks Enables Deep Learning for 3D Ultrasound Localization Microscopy

Authors: Brice Rauby, Paul Xing, Jonathan Porée, Maxime Gasse, Jean Provost

Abstract: Ultrasound Localization Microscopy (ULM) is a non-invasive technique that allows for the imaging of micro-vessels in vivo, at depth and with a resolution on the order of ten microns. ULM is based on the sub-resolution localization of individual microbubbles injected in the bloodstream. Map** the whole angioarchitecture requires the accumulation of microbubbles trajectories from thousands of fram… ▽ More Ultrasound Localization Microscopy (ULM) is a non-invasive technique that allows for the imaging of micro-vessels in vivo, at depth and with a resolution on the order of ten microns. ULM is based on the sub-resolution localization of individual microbubbles injected in the bloodstream. Map** the whole angioarchitecture requires the accumulation of microbubbles trajectories from thousands of frames, typically acquired over a few minutes. ULM acquisition times can be reduced by increasing the microbubble concentration, but requires more advanced algorithms to detect them individually. Several deep learning approaches have been proposed for this task, but they remain limited to 2D imaging, in part due to the associated large memory requirements. Herein, we propose to use sparse tensor neural networks to reduce memory usage in 2D and to improve the scaling of the memory requirement for the extension of deep learning architecture to 3D. We study several approaches to efficiently convert ultrasound data into a sparse format and study the impact of the associated loss of information. When applied in 2D, the sparse formulation reduces the memory requirements by a factor 2 at the cost of a small reduction of performance when compared against dense networks. In 3D, the proposed approach reduces memory requirements by two order of magnitude while largely outperforming conventional ULM in high concentration settings. We show that Sparse Tensor Neural Networks in 3D ULM allow for the same benefits as dense deep learning based method in 2D ULM i.e. the use of higher concentration in silico and reduced acquisition time. △ Less

Submitted 14 February, 2024; originally announced February 2024.

ACM Class: I.4.9

A Tracking prior to Localization workflow for Ultrasound Localization Microscopy

Authors: Alexis Leconte, Jonathan Porée, Brice Rauby, Alice Wu, Nin Ghigo, Paul Xing, Chloé Bourquin, Gerardo Ramos-Palacios, Abbas F. Sadikot, Jean Provost

Abstract: Ultrasound Localization Microscopy (ULM) has proven effective in resolving microvascular structures and local mean velocities at sub-diffraction-limited scales, offering high-resolution imaging capabilities. Dynamic ULM (DULM) enables the creation of angiography or velocity movies throughout cardiac cycles. Currently, these techniques rely on a Localization-and-Tracking (LAT) workflow consisting i… ▽ More Ultrasound Localization Microscopy (ULM) has proven effective in resolving microvascular structures and local mean velocities at sub-diffraction-limited scales, offering high-resolution imaging capabilities. Dynamic ULM (DULM) enables the creation of angiography or velocity movies throughout cardiac cycles. Currently, these techniques rely on a Localization-and-Tracking (LAT) workflow consisting in detecting microbubbles (MB) in the frames before pairing them to generate tracks. While conventional LAT methods perform well at low concentrations, they suffer from longer acquisition times and degraded localization and tracking accuracy at higher concentrations, leading to biased angiogram reconstruction and velocity estimation. In this study, we propose a novel approach to address these challenges by reversing the current workflow. The proposed method, Tracking-and-Localization (TAL), relies on first tracking the MB and then performing localization. Through comprehensive benchmarking using both in silico and in vivo experiments and employing various metrics to quantify ULM angiography and velocity maps, we demonstrate that the TAL method consistently outperforms the reference LAT workflow. Moreover, when applied to DULM, TAL successfully extracts velocity variations along the cardiac cycle with improved repeatability. The findings of this work highlight the effectiveness of the TAL approach in overcoming the limitations of conventional LAT methods, providing enhanced ULM angiography and velocity imaging. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Quantitative pulsatility measurements using 3D Dynamic Ultrasound Localization Microscopy

Authors: Chloé Bourquin, Jonathan Porée, Brice Rauby, Vincent Perrot, Nin Ghigo, Hatim Belgharbi, Samuel Bélanger, Gerardo Ramos-Palacios, Nelson Cortés, Hugo Ladret, Lamyae Ikan, Christian Casanova, Frédéric Lesage, Jean Provost

Abstract: A rise in blood flow velocity variations (i.e., pulsatility) in the brain, caused by the stiffening of upstream arteries, is associated with cognitive impairment and neurodegenerative diseases. The study of this phenomenon requires brain-wide pulsatility measurements, with high penetration depth and high spatiotemporal resolution. The development of Dynamic Ultrasound Localization Microscopy (DULM… ▽ More A rise in blood flow velocity variations (i.e., pulsatility) in the brain, caused by the stiffening of upstream arteries, is associated with cognitive impairment and neurodegenerative diseases. The study of this phenomenon requires brain-wide pulsatility measurements, with high penetration depth and high spatiotemporal resolution. The development of Dynamic Ultrasound Localization Microscopy (DULM), based on ULM, has enabled pulsatility measurements in the rodent brain in 2D. However, 2D imaging accesses only one slice of the brain and measures biased velocities due to 2D projection. Herein, we present 3D DULM, which can extract quantitative pulsatility measurements in the cat brain with craniotomy and in the whole mouse brain through the skull, showing a wide range of flow hemodynamics in both large and small vessels. We highlighted a decrease in pulsatility along the vascular tree in the cat brain, and performed an intra-animal validation of the method by showing consistent measurements between the two sides of the Willis circle in the mouse brain. Our study provides the first step towards a new biomarker that would allow the detection of dynamic abnormalities in microvessels in the whole brain volume, which could be linked to early signs of neurodegenerative diseases. △ Less

Submitted 24 March, 2023; originally announced March 2023.

Comments: 10 pages, 6 figures. Supplementary materials 1 (video): https://youtu.be/DQ3Cf4w1J_0 ; Supplementary materials 2 (video): https://youtu.be/U1V7m6rtyYM

Phase Aberration Correction for in vivo Ultrasound Localization Microscopy Using a Spatiotemporal Complex-Valued Neural Network

Authors: Paul Xing, Jonathan Porée, Brice Rauby, Antoine Malescot, Éric Martineau, Vincent Perrot, Ravi L. Rungta, Jean Provost

Abstract: Ultrasound Localization Microscopy (ULM) can map microvessels at a resolution of a few micrometers (μm). Transcranial ULM remains challenging in presence of aberrations caused by the skull, which lead to localization errors. Herein, we propose a deep learning approach based on complex-valued convolutional neural networks (CV-CNNs) to retrieve the aberration function, which can then be used to form… ▽ More Ultrasound Localization Microscopy (ULM) can map microvessels at a resolution of a few micrometers (μm). Transcranial ULM remains challenging in presence of aberrations caused by the skull, which lead to localization errors. Herein, we propose a deep learning approach based on complex-valued convolutional neural networks (CV-CNNs) to retrieve the aberration function, which can then be used to form enhanced images using standard delay-and-sum beamforming. CV-CNNs were selected as they can apply time delays through multiplication with in-phase quadrature input data. Predicting the aberration function rather than corrected images also confers enhanced explainability to the network. In addition, 3D spatiotemporal convolutions were used for the network to leverage entire microbubble tracks. For training and validation, we used an anatomically and hemodynamically realistic mouse brain microvascular network model to simulate the flow of microbubbles in presence of aberration. The proposed CV-CNN performance was compared to the coherence-based method by using microbubble tracks. We then confirmed the capability of the proposed network to generalize to transcranial \textit{in vivo} data in the mouse brain (n=3). Vascular reconstructions using a locally predicted aberration function included additional and sharper vessels. The CV-CNN was more robust than the coherence-based method and could perform aberration correction in a 6-month-old mouse. After correction, we measured a resolution of 15.6 μm for younger mice, representing an improvement of 25.8 $\%$, while the resolution was improved by 13.9 $\%$ for the 6-month-old mouse. This work leads to different applications for complex-valued convolutions in biomedical imaging and strategies to perform transcranial ULM. △ Less

Submitted 17 July, 2023; v1 submitted 21 September, 2022; originally announced September 2022.

Geo-Spatiotemporal Features and Shape-Based Prior Knowledge for Fine-grained Imbalanced Data Classification

Authors: Charles A. Kantor, Marta Skreta, Brice Rauby, Léonard Boussioux, Emmanuel Jehanno, Alexandra Luccioni, David Rolnick, Hugues Talbot

Abstract: Fine-grained classification aims at distinguishing between items with similar global perception and patterns, but that differ by minute details. Our primary challenges come from both small inter-class variations and large intra-class variations. In this article, we propose to combine several innovations to improve fine-grained classification within the use-case of wildlife, which is of practical i… ▽ More Fine-grained classification aims at distinguishing between items with similar global perception and patterns, but that differ by minute details. Our primary challenges come from both small inter-class variations and large intra-class variations. In this article, we propose to combine several innovations to improve fine-grained classification within the use-case of wildlife, which is of practical interest for experts. We utilize geo-spatiotemporal data to enrich the picture information and further improve the performance. We also investigate state-of-the-art methods for handling the imbalanced data issue. △ Less

Submitted 20 March, 2021; originally announced March 2021.

Comments: Copyright by the authors. All rights reserved to authors only. Correspondence to: ckantor (at) stanford [dot] edu

Journal ref: Proc. IJCAI 2021, Workshop on AI for Social Good, Harvard University (2021)