-
Towards Transcranial 3D Ultrasound Localization Microscopy of the Nonhuman Primate Brain
Authors:
Paul Xing,
Vincent Perrot,
Adan Ulises Dominguez-Vargas,
Stephan Quessy,
Numa Dancause,
Jean Provost
Abstract:
Hemodynamic changes occur in stroke and neurodegenerative diseases. Develo** imaging techniques allowing the in vivo visualization and quantification of cerebral blood flow would help better understand the underlying mechanism of those cerebrovascular diseases. 3D ultrasound localization microscopy (ULM) is a novel technology that can map the microvasculature of the brain at large depth and has…
▽ More
Hemodynamic changes occur in stroke and neurodegenerative diseases. Develo** imaging techniques allowing the in vivo visualization and quantification of cerebral blood flow would help better understand the underlying mechanism of those cerebrovascular diseases. 3D ultrasound localization microscopy (ULM) is a novel technology that can map the microvasculature of the brain at large depth and has been mainly used until now in rodents. Here, we demonstrated the feasibility of 3D ULM of the nonhuman primate (NHP) brain with a single 256-channels programmable ultrasound scanner. We achieved a highly resolved vascular map of the macaque brain at large depth in presence of craniotomy and durectomy using an 8-MHz multiplexed matrix probe. We were able to distinguish vessels as small as 26.9 μm. We also demonstrated that transcranial imaging of the macaque brain at similar depth was feasible using a 3-MHz probe and achieved a resolution of 60.4 μm. This work paves the way to clinical application of 3D ULM.
△ Less
Submitted 4 April, 2024;
originally announced April 2024.
-
Pruning Sparse Tensor Neural Networks Enables Deep Learning for 3D Ultrasound Localization Microscopy
Authors:
Brice Rauby,
Paul Xing,
Jonathan Porée,
Maxime Gasse,
Jean Provost
Abstract:
Ultrasound Localization Microscopy (ULM) is a non-invasive technique that allows for the imaging of micro-vessels in vivo, at depth and with a resolution on the order of ten microns. ULM is based on the sub-resolution localization of individual microbubbles injected in the bloodstream. Map** the whole angioarchitecture requires the accumulation of microbubbles trajectories from thousands of fram…
▽ More
Ultrasound Localization Microscopy (ULM) is a non-invasive technique that allows for the imaging of micro-vessels in vivo, at depth and with a resolution on the order of ten microns. ULM is based on the sub-resolution localization of individual microbubbles injected in the bloodstream. Map** the whole angioarchitecture requires the accumulation of microbubbles trajectories from thousands of frames, typically acquired over a few minutes. ULM acquisition times can be reduced by increasing the microbubble concentration, but requires more advanced algorithms to detect them individually. Several deep learning approaches have been proposed for this task, but they remain limited to 2D imaging, in part due to the associated large memory requirements. Herein, we propose to use sparse tensor neural networks to reduce memory usage in 2D and to improve the scaling of the memory requirement for the extension of deep learning architecture to 3D. We study several approaches to efficiently convert ultrasound data into a sparse format and study the impact of the associated loss of information. When applied in 2D, the sparse formulation reduces the memory requirements by a factor 2 at the cost of a small reduction of performance when compared against dense networks. In 3D, the proposed approach reduces memory requirements by two order of magnitude while largely outperforming conventional ULM in high concentration settings. We show that Sparse Tensor Neural Networks in 3D ULM allow for the same benefits as dense deep learning based method in 2D ULM i.e. the use of higher concentration in silico and reduced acquisition time.
△ Less
Submitted 14 February, 2024;
originally announced February 2024.
-
Inverse Problem Approach to Aberration Correction for in vivo Transcranial Imaging Based on a Sparse Representation of Contrast-enhanced Ultrasound Data
Authors:
Paul Xing,
Antoine Malescot,
Eric Martineau,
Ravi Rungta,
Jean Provost
Abstract:
Transcranial ultrasound imaging is currently limited by attenuation and aberration induced by the skull. First used in contrast-enhanced ultrasound (CEUS), highly echoic microbubbles allowed for the development of novel imaging modalities such as ultrasound localization microscopy (ULM). Herein, we develop an inverse problem approach to aberration correction (IPAC) that leverages the sparsity of m…
▽ More
Transcranial ultrasound imaging is currently limited by attenuation and aberration induced by the skull. First used in contrast-enhanced ultrasound (CEUS), highly echoic microbubbles allowed for the development of novel imaging modalities such as ultrasound localization microscopy (ULM). Herein, we develop an inverse problem approach to aberration correction (IPAC) that leverages the sparsity of microbubble signals. We propose to use the \textit{a priori} knowledge of the medium based upon microbubble localization and wave propagation to build a forward model to link the measured signals directly to the aberration function. A standard least-squares inversion is then used to retrieve the aberration function. We first validated IPAC on simulated data of a vascular network using plane wave as well as divergent wave emissions. We then evaluated the reproducibility of IPAC \textit{in vivo} in 5 mouse brains. We showed that aberration correction improved the contrast of CEUS images by 4.6 dB. For ULM images, IPAC yielded sharper vessels, reduced vessel duplications, and improved the resolution from 21.1 $μ$m to 18.3 $μ$m. Aberration correction also improved hemodynamic quantification for velocity magnitude and flow direction.
△ Less
Submitted 14 May, 2024; v1 submitted 18 January, 2024;
originally announced January 2024.
-
A Tracking prior to Localization workflow for Ultrasound Localization Microscopy
Authors:
Alexis Leconte,
Jonathan Porée,
Brice Rauby,
Alice Wu,
Nin Ghigo,
Paul Xing,
Chloé Bourquin,
Gerardo Ramos-Palacios,
Abbas F. Sadikot,
Jean Provost
Abstract:
Ultrasound Localization Microscopy (ULM) has proven effective in resolving microvascular structures and local mean velocities at sub-diffraction-limited scales, offering high-resolution imaging capabilities. Dynamic ULM (DULM) enables the creation of angiography or velocity movies throughout cardiac cycles. Currently, these techniques rely on a Localization-and-Tracking (LAT) workflow consisting i…
▽ More
Ultrasound Localization Microscopy (ULM) has proven effective in resolving microvascular structures and local mean velocities at sub-diffraction-limited scales, offering high-resolution imaging capabilities. Dynamic ULM (DULM) enables the creation of angiography or velocity movies throughout cardiac cycles. Currently, these techniques rely on a Localization-and-Tracking (LAT) workflow consisting in detecting microbubbles (MB) in the frames before pairing them to generate tracks. While conventional LAT methods perform well at low concentrations, they suffer from longer acquisition times and degraded localization and tracking accuracy at higher concentrations, leading to biased angiogram reconstruction and velocity estimation. In this study, we propose a novel approach to address these challenges by reversing the current workflow. The proposed method, Tracking-and-Localization (TAL), relies on first tracking the MB and then performing localization. Through comprehensive benchmarking using both in silico and in vivo experiments and employing various metrics to quantify ULM angiography and velocity maps, we demonstrate that the TAL method consistently outperforms the reference LAT workflow. Moreover, when applied to DULM, TAL successfully extracts velocity variations along the cardiac cycle with improved repeatability. The findings of this work highlight the effectiveness of the TAL approach in overcoming the limitations of conventional LAT methods, providing enhanced ULM angiography and velocity imaging.
△ Less
Submitted 4 August, 2023;
originally announced August 2023.
-
Phase Aberration Correction for in vivo Ultrasound Localization Microscopy Using a Spatiotemporal Complex-Valued Neural Network
Authors:
Paul Xing,
Jonathan Porée,
Brice Rauby,
Antoine Malescot,
Éric Martineau,
Vincent Perrot,
Ravi L. Rungta,
Jean Provost
Abstract:
Ultrasound Localization Microscopy (ULM) can map microvessels at a resolution of a few micrometers (μm). Transcranial ULM remains challenging in presence of aberrations caused by the skull, which lead to localization errors. Herein, we propose a deep learning approach based on complex-valued convolutional neural networks (CV-CNNs) to retrieve the aberration function, which can then be used to form…
▽ More
Ultrasound Localization Microscopy (ULM) can map microvessels at a resolution of a few micrometers (μm). Transcranial ULM remains challenging in presence of aberrations caused by the skull, which lead to localization errors. Herein, we propose a deep learning approach based on complex-valued convolutional neural networks (CV-CNNs) to retrieve the aberration function, which can then be used to form enhanced images using standard delay-and-sum beamforming. CV-CNNs were selected as they can apply time delays through multiplication with in-phase quadrature input data. Predicting the aberration function rather than corrected images also confers enhanced explainability to the network. In addition, 3D spatiotemporal convolutions were used for the network to leverage entire microbubble tracks. For training and validation, we used an anatomically and hemodynamically realistic mouse brain microvascular network model to simulate the flow of microbubbles in presence of aberration. The proposed CV-CNN performance was compared to the coherence-based method by using microbubble tracks. We then confirmed the capability of the proposed network to generalize to transcranial \textit{in vivo} data in the mouse brain (n=3). Vascular reconstructions using a locally predicted aberration function included additional and sharper vessels. The CV-CNN was more robust than the coherence-based method and could perform aberration correction in a 6-month-old mouse. After correction, we measured a resolution of 15.6 μm for younger mice, representing an improvement of 25.8 $\%$, while the resolution was improved by 13.9 $\%$ for the 6-month-old mouse. This work leads to different applications for complex-valued convolutions in biomedical imaging and strategies to perform transcranial ULM.
△ Less
Submitted 17 July, 2023; v1 submitted 21 September, 2022;
originally announced September 2022.
-
Experimental Investigation on the Friction-induced Vibration with Periodic Characteristics in a Running-in Process under Lubrication
Authors:
Di Sun,
Pengfei Xing,
Guobin Li,
Hongtao Gao,
Sifan Yang,
Honglin Gao,
Hongpeng Zhang
Abstract:
This paper investigated the friction-induced vibration (FIV) behavior under the running-in process with oil lubrication. The FIV signal with periodic characteristics under lubrication was identified with the help of the squeal signal induced in an oil-free wear experiment and then extracted by the harmonic wavelet packet transform (HWPT). The variation of the FIV signal from running-in wear stage…
▽ More
This paper investigated the friction-induced vibration (FIV) behavior under the running-in process with oil lubrication. The FIV signal with periodic characteristics under lubrication was identified with the help of the squeal signal induced in an oil-free wear experiment and then extracted by the harmonic wavelet packet transform (HWPT). The variation of the FIV signal from running-in wear stage to steady wear stage was studied by its root mean square (RMS) values. The result indicates that the time-frequency characteristics of the FIV signals evolve with the wear process and can reflect the wear stages of the friction pairs. The RMS evolvement of the FIV signal is in the same trend to the composite surface roughness and demonstrates that the friction pair goes through the running-in wear stage and the steady wear stage. Therefore, the FIV signal with periodic characteristics can describe the evolvement of the running-in process and distinguish the running-in wear stage and the stable wear stage of the friction pair.
△ Less
Submitted 23 November, 2021; v1 submitted 15 November, 2021;
originally announced November 2021.
-
Towards Robust Partially Supervised Multi-Structure Medical Image Segmentation on Small-Scale Data
Authors:
Nanqing Dong,
Michael Kampffmeyer,
Xiaodan Liang,
Min Xu,
Irina Voiculescu,
Eric P. Xing
Abstract:
The data-driven nature of deep learning (DL) models for semantic segmentation requires a large number of pixel-level annotations. However, large-scale and fully labeled medical datasets are often unavailable for practical tasks. Recently, partially supervised methods have been proposed to utilize images with incomplete labels in the medical domain. To bridge the methodological gaps in partially su…
▽ More
The data-driven nature of deep learning (DL) models for semantic segmentation requires a large number of pixel-level annotations. However, large-scale and fully labeled medical datasets are often unavailable for practical tasks. Recently, partially supervised methods have been proposed to utilize images with incomplete labels in the medical domain. To bridge the methodological gaps in partially supervised learning (PSL) under data scarcity, we propose Vicinal Labels Under Uncertainty (VLUU), a simple yet efficient framework utilizing the human structure similarity for partially supervised medical image segmentation. Motivated by multi-task learning and vicinal risk minimization, VLUU transforms the partially supervised problem into a fully supervised problem by generating vicinal labels. We systematically evaluate VLUU under the challenges of small-scale data, dataset shift, and class imbalance on two commonly used segmentation datasets for the tasks of chest organ segmentation and optic disc-and-cup segmentation. The experimental results show that VLUU can consistently outperform previous partially supervised models in these settings. Our research suggests a new research direction in label-efficient deep learning with partial supervision.
△ Less
Submitted 26 October, 2021; v1 submitted 28 November, 2020;
originally announced November 2020.
-
Petuum: A New Platform for Distributed Machine Learning on Big Data
Authors:
Eric P. Xing,
Qirong Ho,
Wei Dai,
** Kyu Kim,
**liang Wei,
Seunghak Lee,
Xun Zheng,
Pengtao Xie,
Abhimanu Kumar,
Yaoliang Yu
Abstract:
What is a systematic way to efficiently apply a wide spectrum of advanced ML programs to industrial scale problems, using Big Models (up to 100s of billions of parameters) on Big Data (up to terabytes or petabytes)? Modern parallelization strategies employ fine-grained operations and scheduling beyond the classic bulk-synchronous processing paradigm popularized by MapReduce, or even specialized gr…
▽ More
What is a systematic way to efficiently apply a wide spectrum of advanced ML programs to industrial scale problems, using Big Models (up to 100s of billions of parameters) on Big Data (up to terabytes or petabytes)? Modern parallelization strategies employ fine-grained operations and scheduling beyond the classic bulk-synchronous processing paradigm popularized by MapReduce, or even specialized graph-based execution that relies on graph representations of ML programs. The variety of approaches tends to pull systems and algorithms design in different directions, and it remains difficult to find a universal platform applicable to a wide range of ML programs at scale. We propose a general-purpose framework that systematically addresses data- and model-parallel challenges in large-scale ML, by observing that many ML programs are fundamentally optimization-centric and admit error-tolerant, iterative-convergent algorithmic solutions. This presents unique opportunities for an integrative system design, such as bounded-error network synchronization and dynamic scheduling based on ML program structure. We demonstrate the efficacy of these system designs versus well-known implementations of modern ML algorithms, allowing ML programs to run in much less time and at considerably larger model sizes, even on modestly-sized compute clusters.
△ Less
Submitted 14 May, 2015; v1 submitted 30 December, 2013;
originally announced December 2013.