-
Compressed Ultrasound Imaging:from Sub-Nyquist Rates to Super-Resolution
Authors:
Oded Drori,
Alon Mamistvalov,
Oren Solomon,
Yonina C. Eldar
Abstract:
The multi-billion dollar, worldwide medical ultrasound (US) market continues to grow annually. Its non-ionizing nature, real-time capabilities and relatively low cost, compared to other imaging modalities, have led to significant applications in many different fields, including cardiology, angiology, obstetrics and emergency medicine. Facilitated by ongoing innovations, US continues to change rule…
▽ More
The multi-billion dollar, worldwide medical ultrasound (US) market continues to grow annually. Its non-ionizing nature, real-time capabilities and relatively low cost, compared to other imaging modalities, have led to significant applications in many different fields, including cardiology, angiology, obstetrics and emergency medicine. Facilitated by ongoing innovations, US continues to change rules and norms regarding patient screening, diagnosis and surgery. This huge and promising market is constantly driven by new imaging and processing techniques. From 3D images to sophisticated software, hardware and portability improvements, it is clear that the status of US as one of the leading medical imaging technologies is ensured for many years ahead. However, as imaging systems evolve, new engineering challenges emerge. Acquisition, transmission and processing of huge amounts of data are common for all ultrasound-based imaging modalities. Moreover, achieving higher resolution is constantly on demand, as improved diagnosis could be achieved by better visualization of organs and blood vessels deep within tissues. In this article, our goal is to motivate further interest and research in emerging processing techniques, as well as their applications in medical ultrasound, enabled by recent advancements in signal processing algorithms and deep learning. We address some of the primary challenges and potential remedies from a signal processing perspective, by exploiting the inherent structure of the received US signal.
△ Less
Submitted 23 July, 2021;
originally announced July 2021.
-
Deep Cerebellar Nuclei Segmentation via Semi-Supervised Deep Context-Aware Learning from 7T Diffusion MRI
Authors:
**young Kim,
Remi Patriat,
Jordan Kaplan,
Oren Solomon,
Noam Harel
Abstract:
Deep cerebellar nuclei are a key structure of the cerebellum that are involved in processing motor and sensory information. It is thus a crucial step to accurately segment deep cerebellar nuclei for the understanding of the cerebellum system and its utility in deep brain stimulation treatment. However, it is challenging to clearly visualize such small nuclei under standard clinical magnetic resona…
▽ More
Deep cerebellar nuclei are a key structure of the cerebellum that are involved in processing motor and sensory information. It is thus a crucial step to accurately segment deep cerebellar nuclei for the understanding of the cerebellum system and its utility in deep brain stimulation treatment. However, it is challenging to clearly visualize such small nuclei under standard clinical magnetic resonance imaging (MRI) protocols and therefore precise segmentation is not feasible. Recent advances in 7 Tesla (T) MRI technology and great potential of deep neural networks facilitate automatic patient-specific segmentation. In this paper, we propose a novel deep learning framework (referred to as DCN-Net) for fast, accurate, and robust patient-specific segmentation of deep cerebellar dentate and interposed nuclei on 7T diffusion MRI. DCN-Net effectively encodes contextual information on the patch images without consecutive pooling operations and adding complexity via proposed dilated dense blocks. During the end-to-end training, label probabilities of dentate and interposed nuclei are independently learned with a hybrid loss, handling highly imbalanced data. Finally, we utilize self-training strategies to cope with the problem of limited labeled data. To this end, auxiliary dentate and interposed nuclei labels are created on unlabeled data by using DCN-Net trained on manual labels. We validate the proposed framework using 7T B0 MRIs from 60 subjects. Experimental results demonstrate that DCN-Net provides better segmentation than atlas-based deep cerebellar nuclei segmentation tools and other state-of-the-art deep neural networks in terms of accuracy and consistency. We further prove the effectiveness of the proposed components within DCN-Net in dentate and interposed nuclei segmentation.
△ Less
Submitted 30 May, 2020; v1 submitted 21 April, 2020;
originally announced April 2020.
-
The Poschl-Teller Like Description of Quantum Mechanical Carnot Engine
Authors:
E. O. Oladimeji,
S. O. Owolabi Solomon,
J. T. Adeleke
Abstract:
In this work an example of a cyclic engine based on a quantum-mechanical properties of the strongly non linear quantum oscillator described by the Poschl-Teller [PT] model is examined. Using the [PT] model as shown in our earlier works [1-4], a quantum-mechanical analog of Carnot cycle (i.e quantum heat engine) has been constructed through the changes of both, the width L of the well and its quant…
▽ More
In this work an example of a cyclic engine based on a quantum-mechanical properties of the strongly non linear quantum oscillator described by the Poschl-Teller [PT] model is examined. Using the [PT] model as shown in our earlier works [1-4], a quantum-mechanical analog of Carnot cycle (i.e quantum heat engine) has been constructed through the changes of both, the width L of the well and its quantum state. This quantum heat engine has a cycle consisting of adiabatic and isothermal quantum processes. The efficiency of the quantum engine based on the Poschl-Teller-like potential is derived and it is analogous to classical thermodynamic engines.
△ Less
Submitted 14 February, 2021; v1 submitted 9 June, 2019;
originally announced June 2019.
-
Deep Unfolded Robust PCA with Application to Clutter Suppression in Ultrasound
Authors:
Oren Solomon,
Regev Cohen,
Yi Zhang,
Yi Yang,
He Qiong,
Jianwen Luo,
Ruud J. G. van Sloun,
Yonina C. Eldar
Abstract:
Contrast enhanced ultrasound is a radiation-free imaging modality which uses encapsulated gas microbubbles for improved visualization of the vascular bed deep within the tissue. It has recently been used to enable imaging with unprecedented subwavelength spatial resolution by relying on super-resolution techniques. A typical preprocessing step in super-resolution ultrasound is to separate the micr…
▽ More
Contrast enhanced ultrasound is a radiation-free imaging modality which uses encapsulated gas microbubbles for improved visualization of the vascular bed deep within the tissue. It has recently been used to enable imaging with unprecedented subwavelength spatial resolution by relying on super-resolution techniques. A typical preprocessing step in super-resolution ultrasound is to separate the microbubble signal from the cluttering tissue signal. This step has a crucial impact on the final image quality. Here, we propose a new approach to clutter removal based on robust principle component analysis (PCA) and deep learning. We begin by modeling the acquired contrast enhanced ultrasound signal as a combination of a low rank and sparse components. This model is used in robust PCA and was previously suggested in the context of ultrasound Doppler processing and dynamic magnetic resonance imaging. We then illustrate that an iterative algorithm based on this model exhibits improved separation of microbubble signal from the tissue signal over commonly practiced methods. Next, we apply the concept of deep unfolding to suggest a deep network architecture tailored to our clutter filtering problem which exhibits improved convergence speed and accuracy with respect to its iterative counterpart. We compare the performance of the suggested deep network on both simulations and in-vivo rat brain scans, with a commonly practiced deep-network architecture and the fast iterative shrinkage algorithm, and show that our architecture exhibits better image quality and contrast.
△ Less
Submitted 20 November, 2018;
originally announced November 2018.
-
Super-resolution Ultrasound Localization Microscopy through Deep Learning
Authors:
Ruud J. G. van Sloun,
Oren Solomon,
Matthew Bruce,
Zin Z. Khaing,
Hessel Wijkstra,
Yonina C. Eldar,
Massimo Mischi
Abstract:
Ultrasound localization microscopy has enabled super-resolution vascular imaging through precise localization of individual ultrasound contrast agents (microbubbles) across numerous imaging frames. However, analysis of high-density regions with significant overlaps among the microbubble point spread responses yields high localization errors, constraining the technique to low-concentration conditio…
▽ More
Ultrasound localization microscopy has enabled super-resolution vascular imaging through precise localization of individual ultrasound contrast agents (microbubbles) across numerous imaging frames. However, analysis of high-density regions with significant overlaps among the microbubble point spread responses yields high localization errors, constraining the technique to low-concentration conditions. As such, long acquisition times are required to sufficiently cover the vascular bed. In this work, we present a fast and precise method for obtaining super-resolution vascular images from high-density contrast-enhanced ultrasound imaging data. This method, which we term Deep Ultrasound Localization Microscopy (Deep-ULM), exploits modern deep learning strategies and employs a convolutional neural network to perform localization microscopy in dense scenarios. This end-to-end fully convolutional neural network architecture is trained effectively using on-line synthesized data, enabling robust inference in-vivo under a wide variety of imaging conditions. We show that deep learning attains super-resolution with challenging contrast-agent densities, both in-silico as well as in-vivo. Deep-ULM is suitable for real-time applications, resolving about 70 high-resolution patches (128x128 pixels) per second on a standard PC. Exploiting GPU computation, this number increases to 1250 patches per second.
△ Less
Submitted 13 December, 2018; v1 submitted 20 April, 2018;
originally announced April 2018.
-
Exploiting flow dynamics for super-resolution in contrast-enhanced ultrasound
Authors:
Oren Solomon,
Ruud J. G. van Sloun,
Hessel Wijkstra,
Massimo Mischi,
Yonina C. Eldar
Abstract:
Ultrasound localization microscopy offers new radiation-free diagnostic tools for vascular imaging deep within the tissue. Sequential localization of echoes returned from inert microbubbles with low-concentration within the bloodstream reveal the vasculature with capillary resolution. Despite its high spatial resolution, low microbubble concentrations dictate the acquisition of tens of thousands o…
▽ More
Ultrasound localization microscopy offers new radiation-free diagnostic tools for vascular imaging deep within the tissue. Sequential localization of echoes returned from inert microbubbles with low-concentration within the bloodstream reveal the vasculature with capillary resolution. Despite its high spatial resolution, low microbubble concentrations dictate the acquisition of tens of thousands of images, over the course of several seconds to tens of seconds, to produce a single super-resolved image. %since each echo is required to be well separated from adjacent microbubbles. Such long acquisition times and stringent constraints on microbubble concentration are undesirable in many clinical scenarios. To address these restrictions, sparsity-based approaches have recently been developed. These methods reduce the total acquisition time dramatically, while maintaining good spatial resolution in settings with considerable microbubble overlap. %Yet, non of the reported methods exploit the fact that microbubbles actually flow within the bloodstream. % to improve recovery. Here, we further improve sparsity-based super-resolution ultrasound imaging by exploiting the inherent flow of microbubbles and utilize their motion kinematics. While doing so, we also provide quantitative measurements of microbubble velocities. Our method relies on simultaneous tracking and super-localization of individual microbubbles in a frame-by-frame manner, and as such, may be suitable for real-time implementation. We demonstrate the effectiveness of the proposed approach on both simulations and {\it in-vivo} contrast enhanced human prostate scans, acquired with a clinically approved scanner.
△ Less
Submitted 7 April, 2018;
originally announced April 2018.
-
SUSHI: Sparsity-based Ultrasound Super-resolution Hemodynamic Imaging
Authors:
Avinoam Bar-Zion,
Oren Solomon,
Charles Tremblay-Darveau,
Dan Adam,
Yonina C. Eldar
Abstract:
Identifying and visualizing vasculature within organs and tumors has major implications in managing cardiovascular diseases and cancer. Contrast-enhanced ultrasound scans detect slow-flowing blood, facilitating non-invasive perfusion measurements. However, their limited spatial resolution prevents the depiction of microvascular structures. Recently, super-localization ultrasonography techniques ha…
▽ More
Identifying and visualizing vasculature within organs and tumors has major implications in managing cardiovascular diseases and cancer. Contrast-enhanced ultrasound scans detect slow-flowing blood, facilitating non-invasive perfusion measurements. However, their limited spatial resolution prevents the depiction of microvascular structures. Recently, super-localization ultrasonography techniques have surpassed this limit. However, they require long acquisition times of several minutes, preventing the detection of hemodynamic changes. We present a fast super-resolution method that exploits sparsity in the underlying vasculature and statistical independence within the measured signals. Similar to super-localization techniques, this approach improves the spatial resolution by up to an order of magnitude compared to standard scans. Unlike super-localization methods, it requires acquisition times of only tens of milliseconds. We demonstrate a temporal resolution of 25Hz, which may enable functional super-resolution imaging deep within the tissue, surpassing the temporal resolution limitations of current super-resolution methods, e.g. in neural imaging. The sub-second acquisitions make our approach robust to motion artifacts, simplifying in-vivo use of super-resolution ultrasound.
△ Less
Submitted 17 September, 2018; v1 submitted 2 December, 2017;
originally announced December 2017.
-
SPARCOM: Sparsity Based Super-Resolution Correlation Microscopy
Authors:
Oren Solomon,
Yonina C. Eldar,
Maor Mutzafi,
Mordechai Segev
Abstract:
In traditional optical imaging systems, the spatial resolution is limited by the physics of diffraction, which acts as a low-pass filter. The information on sub-wavelength features is carried by evanescent waves, never reaching the camera, thereby posing a hard limit on resolution: the so-called diffraction limit. Modern microscopic methods enable super-resolution, by employing florescence techniq…
▽ More
In traditional optical imaging systems, the spatial resolution is limited by the physics of diffraction, which acts as a low-pass filter. The information on sub-wavelength features is carried by evanescent waves, never reaching the camera, thereby posing a hard limit on resolution: the so-called diffraction limit. Modern microscopic methods enable super-resolution, by employing florescence techniques. State-of-the-art localization based fluorescence subwavelength imaging techniques such as PALM and STORM achieve sub-diffraction spatial resolution of several tens of nano-meters. However, they require tens of thousands of exposures, which limits their temporal resolution. We have recently proposed SPARCOM (sparsity based super-resolution correlation microscopy), which exploits the sparse nature of the fluorophores distribution, alongside a statistical prior of uncorrelated emissions, and showed that SPARCOM achieves spatial resolution comparable to PALM/STORM, while capturing the data hundreds of times faster. Here, we provide a detailed mathematical formulation of SPARCOM, which in turn leads to an efficient numerical implementation, suitable for large-scale problems. We further extend our method to a general framework for sparsity based super-resolution imaging, in which sparsity can be assumed in other domains such as wavelet or discrete-cosine, leading to improved reconstructions in a variety of physical settings.
△ Less
Submitted 11 December, 2018; v1 submitted 28 July, 2017;
originally announced July 2017.
-
Photoacoustic imaging beyond the acoustic diffraction-limit with dynamic speckle illumination and sparse joint support recovery
Authors:
Eliel Hojman,
Thomas Chaigne,
Oren Solomon,
Sylvain Gigan,
Emmanuel Bossy,
Yonina C. Eldar,
Ori Katz
Abstract:
In deep tissue photoacoustic imaging the spatial resolution is inherently limited by the acoustic wavelength. Recently, it was demonstrated that it is possible to surpass the acoustic diffraction limit by analyzing fluctuations in a set of photoacoustic images obtained under unknown speckle illumination patterns. Here, we purpose an approach to boost reconstruction fidelity and resolution, while r…
▽ More
In deep tissue photoacoustic imaging the spatial resolution is inherently limited by the acoustic wavelength. Recently, it was demonstrated that it is possible to surpass the acoustic diffraction limit by analyzing fluctuations in a set of photoacoustic images obtained under unknown speckle illumination patterns. Here, we purpose an approach to boost reconstruction fidelity and resolution, while reducing the number of acquired images by utilizing a compressed sensing computational reconstruction framework. The approach takes into account prior knowledge of the system response and sparsity of the target structure. We provide proof of principle experiments of the approach and demonstrate that improved performance is obtained when both speckle fluctuations and object priors are used. We numerically study the expected performance as a function of the measurements signal to noise ratio and sample spatial-sparsity. The presented reconstruction framework can be applied to analyze existing photoacoustic experimental datasets containing dynamic fluctuations.
△ Less
Submitted 13 June, 2019; v1 submitted 25 December, 2016;
originally announced December 2016.
-
Fast Vascular Ultrasound Imaging with Enhanced Spatial Resolution and Background Rejection
Authors:
Avinoam Bar-Zion,
Charles Tremblay-Darveau,
Oren Solomon,
Dan Adam,
Yonina C. Eldar
Abstract:
Ultrasound super-localization microscopy techniques presented in the last few years enable non-invasive imaging of vascular structures at the capillary level by tracking the flow of ultrasound contrast agents (gas microbubbles). However, these techniques are currently limited by low temporal resolution and long acquisition times. Super-resolution optical fluctuation imaging (SOFI) is a fluorescenc…
▽ More
Ultrasound super-localization microscopy techniques presented in the last few years enable non-invasive imaging of vascular structures at the capillary level by tracking the flow of ultrasound contrast agents (gas microbubbles). However, these techniques are currently limited by low temporal resolution and long acquisition times. Super-resolution optical fluctuation imaging (SOFI) is a fluorescence microscopy technique enabling sub-diffraction limit imaging with high temporal resolution by calculating high order statistics of the fluctuating optical signal. The aim of this work is to achieve fast acoustic imaging with enhanced resolution by applying the tools used in SOFI to contrast-enhance ultrasound (CEUS) plane-wave scans. The proposed method was tested using numerical simulations and evaluated using two in-vivo rabbit models: scans of healthy kidneys and VX-2 tumor xenografts. Improved spatial resolution was observed with a reduction of up to 50% in the full width half max of the point spread function. In addition, substantial reduction in the background level was achieved compared to standard mean amplitude persistence images, revealing small vascular structures within tumors. The scan duration of the proposed method is less than a second while current superlocalization techniques require acquisition duration of several minutes. As a result, the proposed technique may be used to obtain scans with enhanced spatial resolution and high temporal resolution, facilitating flow-dynamics monitoring. Our method can also be applied during a breath-hold, reducing the sensitivity to motion artifacts.
△ Less
Submitted 9 August, 2016; v1 submitted 21 January, 2016;
originally announced January 2016.
