-
On the Echogenicity of Natural Starch-Based Blood Mimicking Fluids for Contrast Enhanced Ultrasound Imaging: Preliminary In-vitro Experiments
Authors:
V. Arun Kumar,
A. N. Madhavanunni,
S. Nivetha,
Mahesh Raveendranatha Panicker
Abstract:
Natural starch-based blood-mimicking fluid (BMF) has been used as an alternative to commercially available BMFs for in-vitro Doppler investigations in low-resource settings. Most reported works in the literature have used corn starch-based BMF. Evaluation of other natural starches for potential BMF and their characterization have relatively been unexplored in the literature. To this end, this work…
▽ More
Natural starch-based blood-mimicking fluid (BMF) has been used as an alternative to commercially available BMFs for in-vitro Doppler investigations in low-resource settings. Most reported works in the literature have used corn starch-based BMF. Evaluation of other natural starches for potential BMF and their characterization have relatively been unexplored in the literature. To this end, this work investigates the echogenicity of corn-, potato-, tapioca-, and wheat starch-based BMFs prepared using a liquid base of pure water-glycerol mixture with three different starch concentrations (1%, 3%, and 5%). The experiments were performed by manually pum** the BMFs to a PolyVinyl alcohol (PVA) based flow phantom using a syringe and raw datasets were acquired using a Verasonics Vantage 128 Research Ultrasound System. Echogenicity was measured as the mean pixel intensity in a selected region of interest (ROI) in the beamformed image. Among the four natural starch-based BMFs, potato starch-based BMF showed the highest echogenicity and contrast with almost 13%, 14%, and 10% higher pixel intensities (dB) than that of the least echoic BMF with 1%, 3%, and 5% starch concentrations respectively. Moreover, the echogenicity of corn, tapioca, and wheat starch-based BMF was observed to be similar, and the results suggest that these BMFs with higher starch concentrations shall be employed for in-vitro contrast-enhanced ultrasound imaging.
△ Less
Submitted 10 March, 2024;
originally announced March 2024.
-
A Performance Evaluation of Filtered Delay Multiply and Sum Beamforming for Ultrasound Localization Microscopy: Preliminary Results
Authors:
A. N. Madhavanunni,
Niya Mariam Benoy,
Mahesh Raveendranatha Panicker,
Himanshu Shekhar
Abstract:
Ultrafast ultrasound localization microscopy (ULM), which has shown promising results in microvascular imaging, overcomes the typical trade-off between resolution and penetration depth. Combining ultrasound contrast agents and high frame rate imaging enables ULM to visualize microvasculature and quantify flow. However, the quality of the microvascular maps obtained depends on the signal-to-noise r…
▽ More
Ultrafast ultrasound localization microscopy (ULM), which has shown promising results in microvascular imaging, overcomes the typical trade-off between resolution and penetration depth. Combining ultrasound contrast agents and high frame rate imaging enables ULM to visualize microvasculature and quantify flow. However, the quality of the microvascular maps obtained depends on the signal-to-noise ratio of the received signals, image reconstruction techniques, and the microbubble (MB) localization and tracking algorithms used. Most reported research in ULM employs the conventional delay and sum (DAS) beamforming technique for image reconstruction despite its limited contrast and resolution. In this work, a filtered delay multiply and sum (F-DMAS) beamforming approach with non-steered plane wave transmit was employed for ULM, and its performance was compared with the conventional DAS-based approach for the different localization algorithms available in the Localization and Tracking Toolbox for Ultrasound Localization Microscopy. We also introduce two novel image quality measures that can overcome the limitations of conventional quality metrics that require suitable targets for evaluation. We also report the preliminary in-vitro investigation of F-DMAS with B-mode and power Doppler maps for microvascular imaging. The results are promising with enhanced contrast and lateral resolution, and suggest that further experimental studies are warranted.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
Tiny-VBF: Resource-Efficient Vision Transformer based Lightweight Beamformer for Ultrasound Single-Angle Plane Wave Imaging
Authors:
Abdul Rahoof,
Vivek Chaturvedi,
Mahesh Raveendranatha Panicker,
Muhammad Shafique
Abstract:
Accelerating compute intensive non-real-time beam-forming algorithms in ultrasound imaging using deep learning architectures has been gaining momentum in the recent past. Nonetheless, the complexity of the state-of-the-art deep learning techniques poses challenges for deployment on resource-constrained edge devices. In this work, we propose a novel vision transformer based tiny beamformer (Tiny-VB…
▽ More
Accelerating compute intensive non-real-time beam-forming algorithms in ultrasound imaging using deep learning architectures has been gaining momentum in the recent past. Nonetheless, the complexity of the state-of-the-art deep learning techniques poses challenges for deployment on resource-constrained edge devices. In this work, we propose a novel vision transformer based tiny beamformer (Tiny-VBF), which works on the raw radio-frequency channel data acquired through single-angle plane wave insonification. The output of our Tiny-VBF provides fast envelope detection requiring very low frame rate, i.e. 0.34 GOPs/Frame for a frame size of 368 x 128 in comparison to the state-of-the-art deep learning models. It also exhibited an 8% increase in contrast and gains of 5% and 33% in axial and lateral resolution respectively when compared to Tiny-CNN on in-vitro dataset. Additionally, our model showed a 4.2% increase in contrast and gains of 4% and 20% in axial and lateral resolution respectively when compared against conventional Delay-and-Sum (DAS) beamformer. We further propose an accelerator architecture and implement our Tiny-VBF model on a Zynq UltraScale+ MPSoC ZCU104 FPGA using a hybrid quantization scheme with 50% less resource consumption compared to the floating-point implementation, while preserving the image quality.
△ Less
Submitted 16 January, 2024; v1 submitted 20 November, 2023;
originally announced November 2023.
-
A Portable Ultrasound Imaging Pipeline Implementation with GPU Acceleration on Nvidia CLARA AGX
Authors:
A. N. Madhavanunni,
V. Arun Kumar,
Mahesh Raveendranatha Panicker
Abstract:
In this paper, we present a GPU-accelerated prototype implementation of a portable ultrasound imaging pipeline on an Nvidia CLARA AGX development kit. The raw data is acquired with nonsteered plane wave transmit using a programmable handheld open platform that supports 128-channel transmit and 64-channel receive. The received signals are transferred to the Nvidia CLARA AGX developer platform throu…
▽ More
In this paper, we present a GPU-accelerated prototype implementation of a portable ultrasound imaging pipeline on an Nvidia CLARA AGX development kit. The raw data is acquired with nonsteered plane wave transmit using a programmable handheld open platform that supports 128-channel transmit and 64-channel receive. The received signals are transferred to the Nvidia CLARA AGX developer platform through a host system for accelerated imaging. GPU-accelerated implementation of the conventional delay and sum (DAS) beamformer along with two adaptive nonlinear beamformers and two Fourier-based techniques was performed. The feasibility of the complete pipeline and its imaging performance was evaluated with in-vitro phantom imaging experiments and the efficacy is demonstrated with preliminary in-vivo scans. The image quality quantified by the standard contrast and resolution metrics was comparable with that of the CPU implementation. The execution speed of the implemented beamformers was also investigated for different sizes of imaging grids and a significant speedup as high as 180 times that of the CPU implementation was observed. Since the proposed pipeline involves Nvidia CLARA AGX, there is always the potential for easy incorporation of online/active learning approaches.
△ Less
Submitted 31 October, 2023;
originally announced November 2023.
-
Towards Non-contact 3D Ultrasound for Wrist Imaging
Authors:
Antony Jerald,
A. N. Madhavanunni,
Gayathri Malamal,
Mahesh Raveendranatha Panicker
Abstract:
Objective: The objective of this work is an attempt towards non-contact freehand 3D ultrasound imaging with minimal complexity added to the existing point of care ultrasound (POCUS) systems. Methods: This study proposes a novel approach of using a mechanical track for non-contact ultrasound (US) scanning. The approach thus restricts the probe motion to a linear plane, to simplify the acquisition a…
▽ More
Objective: The objective of this work is an attempt towards non-contact freehand 3D ultrasound imaging with minimal complexity added to the existing point of care ultrasound (POCUS) systems. Methods: This study proposes a novel approach of using a mechanical track for non-contact ultrasound (US) scanning. The approach thus restricts the probe motion to a linear plane, to simplify the acquisition and 3D reconstruction process. A pipeline for US 3D volume reconstruction employing an US research platform and a GPU-based edge device is developed. Results: The efficacy of the proposed approach is demonstrated through ex-vivo and in-vivo experiments. Conclusion: The proposed approach with the adjustable field of view capability, non-contact design, and low cost of deployment without significantly altering the existing setup would open doors for up gradation of traditional systems to a wide range of 3D US imaging applications. Significance: Ultrasound (US) imaging is a popular clinical imaging modality for the point-of-care bedside imaging, particularly of the wrist/knee in the pediatric population due to its non-invasive and radiation free nature. However, the limited views of tissue structures obtained with 2D US in such scenarios make the diagnosis challenging. To overcome this, 3D US imaging which uses 2D US images and their orientation/position to reconstruct 3D volumes was developed. The accurate position estimation of the US probe at low cost has always stood as a challenging task in 3D reconstruction. Additionally, US imaging involves contact, which causes difficulty to pediatric subjects while monitoring live fractures or open wounds. Towards overcoming these challenges, a novel framework is attempted in this work.
△ Less
Submitted 6 October, 2023;
originally announced October 2023.
-
On The Application Of Log Compression and Enhanced Denoising In Contrast Enhancement Of Digital Radiography Images
Authors:
M. S. Asif,
Mahesh Raveendranatha Panicker
Abstract:
Digital radiography (DR) is becoming popular for the point of care imaging in the recent past. To reduce the radiation exposure, controlled radiation based on as low as reasonably achievable (ALARA) principle is employed and this results in low contrast images. To address this issue, post-processing algorithms such as the Multiscale Image Contrast Amplification (MUSICA) algorithm can be used to en…
▽ More
Digital radiography (DR) is becoming popular for the point of care imaging in the recent past. To reduce the radiation exposure, controlled radiation based on as low as reasonably achievable (ALARA) principle is employed and this results in low contrast images. To address this issue, post-processing algorithms such as the Multiscale Image Contrast Amplification (MUSICA) algorithm can be used to enhance the contrast of DR images even with a low radiation dose. In this study, a modification of the MUSICA algorithm is investigated to determine the potential for further contrast improvement specifically for DR images. The conclusion is that combining log compression and its inverse at the appropriate stage with a multi-stage MUSICA and denoising is very promising. The proposed method resulted in an average of 66.5 % increase in the mean contrast-to-noise ratio (CNR) for the test images considered.
△ Less
Submitted 18 April, 2023; v1 submitted 8 April, 2023;
originally announced April 2023.
-
Fast Marching based Tissue Adaptive Delay Estimation for Aberration Corrected Delay and Sum Beamforming in Ultrasound Imaging
Authors:
M. S. Asif,
Gayathri Malamal,
A. N. Madhavanunni,
Vikram Melapudi,
V Rahul,
Abhijit Patil,
Rajesh Langoju,
Mahesh Raveendranatha Panicker
Abstract:
Conventional ultrasound (US) imaging employs the delay and sum (DAS) receive beamforming with dynamic receive focus for image reconstruction due to its simplicity and robustness. However, the DAS beamforming follows a geometrical method of delay estimation with a spatially constant speed-of-sound (SoS) of 1540 m/s throughout the medium irrespective of the tissue in-homogeneity. This approximation…
▽ More
Conventional ultrasound (US) imaging employs the delay and sum (DAS) receive beamforming with dynamic receive focus for image reconstruction due to its simplicity and robustness. However, the DAS beamforming follows a geometrical method of delay estimation with a spatially constant speed-of-sound (SoS) of 1540 m/s throughout the medium irrespective of the tissue in-homogeneity. This approximation leads to errors in delay estimations that accumulate with depth and degrades the resolution, contrast and overall accuracy of the US image. In this work, we propose a fast marching based DAS for focused transmissions which leverages the approximate SoS map to estimate the refraction corrected propagation delays for each pixel in the medium. The proposed approach is validated qualitatively and quantitatively for imaging depths of upto ~ 11 cm through simulations, where fat layer induced aberration is employed to alter the SoS in the medium. To the best of authors' knowledge, this is the first work considering the effect of SoS on image quality for deeper imaging.
△ Less
Submitted 19 April, 2023; v1 submitted 7 April, 2023;
originally announced April 2023.
-
A Simplified 3D Ultrasound Freehand Imaging Framework Using 1D Linear Probe and Low-Cost Mechanical Track
Authors:
Antony Jerald,
A. N. Madhavanunni,
Gayathri Malamal,
Pisharody Harikrishnan Gopalakrishnan,
Mahesh Raveendranatha Panicker
Abstract:
Ultrasound imaging is the most popular medical imaging modality for point-of-care bedside imaging. However, 2D ultrasound imaging provides only limited views of the organ of interest, making diagnosis challenging. To overcome this, 3D ultrasound imaging was developed, which uses 2D ultrasound images and their orientation/position to reconstruct 3D volumes. The accurate position estimation of the u…
▽ More
Ultrasound imaging is the most popular medical imaging modality for point-of-care bedside imaging. However, 2D ultrasound imaging provides only limited views of the organ of interest, making diagnosis challenging. To overcome this, 3D ultrasound imaging was developed, which uses 2D ultrasound images and their orientation/position to reconstruct 3D volumes. The accurate position estimation of the ultrasound probe at low cost has always stood as a challenging task in 3D reconstruction. In this study, we propose a novel approach of using a mechanical track for ultrasound scanning, which restricts the probe motion to a linear plane, simplifying the acquisition and hence the reconstruction process. We also present an end-to-end pipeline for 3D ultrasound volume reconstruction and demonstrate its efficacy with an in-vitro tube phantom study and an ex-vivo bone experiment. The comparison between a sensorless freehand and the proposed mechanical track based acquisition is available online (shorturl.at/jqvX0).
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
Ultrasound based Gas Detection: Analyzing Acoustic Impedance for High-Performance and Low-Cost Solutions
Authors:
Ayush Singh,
Harikrishnan Pisharody Gopalkrishnan,
Mahesh Raveendranatha Panicker
Abstract:
Gas leakage is a serious hazard in a variety of sectors, including industrial, domestic, and gas-powered vehicles. The installation of gas leak detection systems has emerged as a critical preventative measure to solve this problem. Traditional gas sensors, such as electrochemical, infrared point, and Metal Oxide Semiconductor sensors, have been widely used for gas leak detection. However, these se…
▽ More
Gas leakage is a serious hazard in a variety of sectors, including industrial, domestic, and gas-powered vehicles. The installation of gas leak detection systems has emerged as a critical preventative measure to solve this problem. Traditional gas sensors, such as electrochemical, infrared point, and Metal Oxide Semiconductor sensors, have been widely used for gas leak detection. However, these sensors have limitations in terms of their adaptation to various gases, as well as their high cost and difficulties in scaling. In this paper, a novel non-contact gas detection technique based on a 40 kHz ultrasonic signal is described. The proposed approach employs the reflections of the emitted ultrasonic wave to detect the gas leaks and also able to identify the exact gas in real-time. To confirm the method's effectiveness, trials were carried out using Hydrogen, Helium, Argon, and Butane gas. The system identified gas flow breaches in 0.01 seconds, whereas the gas identification procedure took 0.8 seconds. An interesting extension of the proposed approach is real-time visualisation of gas flow employing an array of transducers.
△ Less
Submitted 5 July, 2023; v1 submitted 31 January, 2023;
originally announced January 2023.
-
A Prototype System for High Frame Rate Ultrasound Imaging based Prosthetic Arm Control
Authors:
Ayush Singh,
Pisharody Harikrishnan Gopalkrishnan,
Mahesh Raveendranatha Panicker
Abstract:
The creation of unique control methods for a hand prosthesis is still a problem that has to be addressed. The best choice of a human-machine interface (HMI) that should be used to enable natural control is still a challenge. Surface electromyography (sEMG), the most popular option, has a variety of difficult-to-fix issues (electrode displacement, sweat, fatigue). The ultrasound imaging-based metho…
▽ More
The creation of unique control methods for a hand prosthesis is still a problem that has to be addressed. The best choice of a human-machine interface (HMI) that should be used to enable natural control is still a challenge. Surface electromyography (sEMG), the most popular option, has a variety of difficult-to-fix issues (electrode displacement, sweat, fatigue). The ultrasound imaging-based methodology offers a means of recognising complex muscle activity and configuration with a greater SNR and less hardware requirements as compared to sEMG. In this study, a prototype system for high frame rate ultrasound imaging for prosthetic arm control is proposed. Using the proposed framework, a virtual robotic hand simulation is developed that can mimic a human hand as illustrated in the link [10]. The proposed classification model simulating four hand gestures has a classification accuracy of more than 90%.
△ Less
Submitted 18 April, 2023; v1 submitted 31 January, 2023;
originally announced January 2023.
-
Software Package for Automated Analysis of Lung Ultrasound Videos
Authors:
Anito Anto,
Linda Rose Jimson,
Tanya Rose,
Mohammed Jafrin,
Mahesh Raveendranatha Panicker
Abstract:
In the recent past with the rapid surge of COVID-19 infections, lung ultrasound has emerged as a fast and powerful diagnostic tool particularly for continuous and periodic monitoring of the lung. There have been many attempts towards severity classification, segmentation and detection of key landmarks in the lung. Leveraging the progress, an automated lung ultrasound video analysis package is pres…
▽ More
In the recent past with the rapid surge of COVID-19 infections, lung ultrasound has emerged as a fast and powerful diagnostic tool particularly for continuous and periodic monitoring of the lung. There have been many attempts towards severity classification, segmentation and detection of key landmarks in the lung. Leveraging the progress, an automated lung ultrasound video analysis package is presented in this work, which can provide summary of key frames in the video, flagging of the key frames with lung infection and options to automatically detect and segment the lung landmarks. The integrated package is implemented as an open-source web application and available in the link https://github.com/anitoanto/alus-package.
△ Less
Submitted 1 August, 2022;
originally announced August 2022.
-
Learning while Acquisition: Towards Active Learning Framework for Beamforming in Ultrasound Imaging
Authors:
Mayank Katare,
Mahesh Raveendranatha Panicker,
A N Madhavanunni,
Gayathri Malamal
Abstract:
In the recent past, there have been many efforts to accelerate adaptive beamforming for ultrasound (US) imaging using neural networks (NNs). However, most of these efforts are based on static models, i.e., they are trained to learn a single adaptive beamforming approach (e.g., minimum variance distortionless response (MVDR)) assuming that they result in the best image quality. Moreover, the traini…
▽ More
In the recent past, there have been many efforts to accelerate adaptive beamforming for ultrasound (US) imaging using neural networks (NNs). However, most of these efforts are based on static models, i.e., they are trained to learn a single adaptive beamforming approach (e.g., minimum variance distortionless response (MVDR)) assuming that they result in the best image quality. Moreover, the training of such NNs is initiated only after acquiring a large set of data that consumes several gigabytes (GBs) of storage space. In this study, an active learning framework for beamforming is described for the first time in the context of NNs. The best quality image chosen by the user serves as the ground truth for the proposed technique, which trains the NN concurrently with data acqusition. On average, the active learning approach takes 0.5 seconds to complete a single iteration of training.
△ Less
Submitted 31 July, 2022;
originally announced August 2022.
-
covEcho Resource constrained lung ultrasound image analysis tool for faster triaging and active learning
Authors:
**u Joseph,
Mahesh Raveendranatha Panicker,
Yale Tung Chen,
Kesavadas Chandrasekharan,
Vimal Chacko Mondy,
Anoop Ayyappan,
**eesh Valakkada,
Kiran Vishnu Narayan
Abstract:
Lung ultrasound (LUS) is possibly the only medical imaging modality which could be used for continuous and periodic monitoring of the lung. This is extremely useful in tracking the lung manifestations either during the onset of lung infection or to track the effect of vaccination on lung as in pandemics such as COVID-19. There have been many attempts in automating the classification of severity of…
▽ More
Lung ultrasound (LUS) is possibly the only medical imaging modality which could be used for continuous and periodic monitoring of the lung. This is extremely useful in tracking the lung manifestations either during the onset of lung infection or to track the effect of vaccination on lung as in pandemics such as COVID-19. There have been many attempts in automating the classification of severity of lung into various classes or automatic segmentation of various LUS landmarks and manifestations. However, all these approaches are based on training static machine learning models which require a significantly clinically annotated large dataset and are computationally heavy and most of the time non-real time. In this work, a real-time light weight active learning-based approach is presented for faster triaging in COVID-19 subjects in resource constrained settings. The tool, based on the you look only once (YOLO) network, has the capability of providing the quality of images based on the identification of various LUS landmarks, artefacts and manifestations, prediction of severity of lung infection, possibility of active learning based on the feedback from clinicians or on the image quality and a summarization of the significant frames which are having high severity of infection and high image quality for further analysis. The results show that the proposed tool has a mean average precision (mAP) of 66% at an Intersection over Union (IoU) threshold of 0.5 for the prediction of LUS landmarks. The 14MB lightweight YOLOv5s network achieves 123 FPS while running in a Quadro P4000 GPU. The tool is available for usage and analysis upon request from the authors.
△ Less
Submitted 21 June, 2022;
originally announced June 2022.
-
Patch Based Transformation for Minimum Variance Beamformer Image Approximation Using Delay and Sum Pipeline
Authors:
Sairoop Bodepudi,
A N Madhavanunni,
Mahesh Raveendranatha Panicker
Abstract:
In the recent past, there have been several efforts in accelerating computationally heavy beamforming algorithms such as minimum variance distortionless response (MVDR) beamforming to achieve real-time performance comparable to the popular delay and sum (DAS) beamforming. This has been achieved using a variety of neural network architectures ranging from fully connected neural networks (FCNNs), co…
▽ More
In the recent past, there have been several efforts in accelerating computationally heavy beamforming algorithms such as minimum variance distortionless response (MVDR) beamforming to achieve real-time performance comparable to the popular delay and sum (DAS) beamforming. This has been achieved using a variety of neural network architectures ranging from fully connected neural networks (FCNNs), convolutional neural networks (CNNs) and general adversarial networks (GANs). However most of these approaches are working with optimizations considering image level losses and hence require a significant amount of dataset to ensure that the process of beamforming is learned. In this work, a patch level U-Net based neural network is proposed, where the delay compensated radio frequency (RF) patch for a fixed region in space (e.g. 32x32) is transformed through a U-Net architecture and multiplied with DAS apodization weights and optimized for similarity with MVDR image of the patch. Instead of framing the beamforming problem as a regression problem to estimate the apodization weights, the proposed approach treats the non-linear transformation of the RF data space that can account for the data driven weight adaptation done by the MVDR approach in the parameters of the network. In this way, it is also observed that by restricting the input to a patch the model will learn the beamforming pipeline as an image non-linear transformation problem.
△ Less
Submitted 19 October, 2021;
originally announced October 2021.
-
Exploring Novel Pooling Strategies for Edge Preserved Feature Maps in Convolutional Neural Networks
Authors:
Adithya Sineesh,
Mahesh Raveendranatha Panicker
Abstract:
With the introduction of anti-aliased convolutional neural networks (CNN), there has been some resurgence in relooking the way pooling is done in CNNs. The fundamental building block of the anti-aliased CNN has been the application of Gaussian smoothing before the pooling operation to reduce the distortion due to aliasing thereby making CNNs shift invariant. Wavelet based approaches have also been…
▽ More
With the introduction of anti-aliased convolutional neural networks (CNN), there has been some resurgence in relooking the way pooling is done in CNNs. The fundamental building block of the anti-aliased CNN has been the application of Gaussian smoothing before the pooling operation to reduce the distortion due to aliasing thereby making CNNs shift invariant. Wavelet based approaches have also been proposed as a possibility of additional noise removal capability and gave interesting results for even segmentation tasks. However, all the approaches proposed completely remove the high frequency components under the assumption that they are noise. However, by removing high frequency components, the edges in the feature maps are also smoothed. In this work, an exhaustive analysis of the edge preserving pooling options for classification, segmentation and autoencoders are presented. Two novel pooling approaches are presented such as Laplacian-Gaussian Concatenation with Attention (LGCA) pooling and Wavelet based approximate-detailed coefficient concatenation with attention (WADCA) pooling. The results suggest that the proposed pooling approaches outperform the conventional pooling as well as blur pooling for classification, segmentation and autoencoders.
△ Less
Submitted 17 October, 2021;
originally announced October 2021.
-
Physics Driven Domain Specific Transporter Framework with Attention Mechanism for Ultrasound Imaging
Authors:
Arpan Tripathi,
Abhilash Rakkunedeth,
Mahesh Raveendranatha Panicker,
Jack Zhang,
Naveenjyote Boora,
Jessica Knight,
Jacob Jaremko,
Yale Tung Chen,
Kiran Vishnu Narayan,
Kesavadas C
Abstract:
Most applications of deep learning techniques in medical imaging are supervised and require a large number of labeled data which is expensive and requires many hours of careful annotation by experts. In this paper, we propose an unsupervised, physics driven domain specific transporter framework with an attention mechanism to identify relevant key points with applications in ultrasound imaging. The…
▽ More
Most applications of deep learning techniques in medical imaging are supervised and require a large number of labeled data which is expensive and requires many hours of careful annotation by experts. In this paper, we propose an unsupervised, physics driven domain specific transporter framework with an attention mechanism to identify relevant key points with applications in ultrasound imaging. The proposed framework identifies key points that provide a concise geometric representation highlighting regions with high structural variation in ultrasound videos. We incorporate physics driven domain specific information as a feature probability map and use the radon transform to highlight features in specific orientations. The proposed framework has been trained on130 Lung ultrasound (LUS) videos and 113 Wrist ultrasound (WUS) videos and validated on 100 Lung ultrasound (LUS) videos and 58 Wrist ultrasound (WUS) videos acquired from multiple centers across the globe. Images from both datasets were independently assessed by experts to identify clinically relevant features such as A-lines, B-lines and pleura from LUS and radial metaphysis, radial epiphysis and carpal bones from WUS videos. The key points detected from both datasets showed high sensitivity (LUS = 99\% , WUS = 74\%) in detecting the image landmarks identified by experts. Also, on employing for classification of the given lung image into normal and abnormal classes, the proposed approach, even with no prior training, achieved an average accuracy of 97\% and an average F1-score of 95\% respectively on the task of co-classification with 3 fold cross-validation. With the purely unsupervised nature of the proposed approach, we expect the key point detection approach to increase the applicability of ultrasound in various examination performed in emergency and point of care.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
Unsupervised multi-latent space reinforcement learning framework for video summarization in ultrasound imaging
Authors:
Roshan P Mathews,
Mahesh Raveendranatha Panicker,
Abhilash R Hareendranathan,
Yale Tung Chen,
Jacob L Jaremko,
Brian Buchanan,
Kiran Vishnu Narayan,
Kesavadas C,
Greeta Mathews
Abstract:
The COVID-19 pandemic has highlighted the need for a tool to speed up triage in ultrasound scans and provide clinicians with fast access to relevant information. The proposed video-summarization technique is a step in this direction that provides clinicians access to relevant key-frames from a given ultrasound scan (such as lung ultrasound) while reducing resource, storage and bandwidth requiremen…
▽ More
The COVID-19 pandemic has highlighted the need for a tool to speed up triage in ultrasound scans and provide clinicians with fast access to relevant information. The proposed video-summarization technique is a step in this direction that provides clinicians access to relevant key-frames from a given ultrasound scan (such as lung ultrasound) while reducing resource, storage and bandwidth requirements. We propose a new unsupervised reinforcement learning (RL) framework with novel rewards that facilitates unsupervised learning avoiding tedious and impractical manual labelling for summarizing ultrasound videos to enhance its utility as a triage tool in the emergency department (ED) and for use in telemedicine. Using an attention ensemble of encoders, the high dimensional image is projected into a low dimensional latent space in terms of: a) reduced distance with a normal or abnormal class (classifier encoder), b) following a topology of landmarks (segmentation encoder), and c) the distance or topology agnostic latent representation (convolutional autoencoders). The decoder is implemented using a bi-directional long-short term memory (Bi-LSTM) which utilizes the latent space representation from the encoder. Our new paradigm for video summarization is capable of delivering classification labels and segmentation of key landmarks for each of the summarized keyframes. Validation is performed on lung ultrasound (LUS) dataset, that typically represent potential use cases in telemedicine and ED triage acquired from different medical centers across geographies (India, Spain and Canada).
△ Less
Submitted 3 September, 2021;
originally announced September 2021.
-
A Nonlinear Beamforming for Enhanced Spatiotemporal Sensitivity in High Frame Rate Ultrasound Flow Imaging
Authors:
A. N. Madhavanunni,
Mahesh Raveendranatha Panicker
Abstract:
Typically, an ultrasound flow imaging system employs the conventional delay and sum (DAS) beamformer due to its inherent low complexity. But the conventional DAS technique offers poor contrast, low imaging resolution, and limited spatiotemporal sensitivity. This article attempts to improve the spatiotemporal sensitivity of conventional flow imaging with a novel multiply and sum based nonlinear hig…
▽ More
Typically, an ultrasound flow imaging system employs the conventional delay and sum (DAS) beamformer due to its inherent low complexity. But the conventional DAS technique offers poor contrast, low imaging resolution, and limited spatiotemporal sensitivity. This article attempts to improve the spatiotemporal sensitivity of conventional flow imaging with a novel multiply and sum based nonlinear high-resolution (NLHR) beamforming approach. The major advantages of the proposed beamformer are the harmonic generation and the enhanced coherence in beamformed signals that improve the spatiotemporal sensitivity towards flow transients. We demonstrate the proposed beamformer for a directional cross-correlation as well as an autocorrelation based velocity estimator with simulated parabolic flow profiles of different velocities and flow directions, an in-vitro rotating disk dataset, and pulsatile flow experiments. The sensitivity of NLHR beamforming towards the flow transients is validated in-vitro with a sudden reversal of flow direction and air bubble tracking experiments. The comparison between the time-frequency plots of DAS and NLHR beamforming indicates that the impulsive spatiotemporal changes induced by the flow of air bubbles are clearly characterized by nonlinear beamforming than that of DAS beamforming. Furthermore, better spatiotemporal velocity tracking of a single air bubble and a clear distinguishability between the tracking of two proximal air bubbles are observed in-vitro. Preliminary studies on the in-vivo carotid data also show comparable, if not better, results than that of the DAS algorithm. Detailed results for each test case in simulation, phantom, and in-vivo studies are available as movies with the supplementary material and online.
△ Less
Submitted 23 June, 2022; v1 submitted 5 August, 2021;
originally announced August 2021.
-
An Angle Independent Depth Aware Fusion Beamforming Approach for Ultrafast Ultrasound Flow Imaging
Authors:
A. N. Madhavanunni,
Mahesh Raveendranatha Panicker
Abstract:
In the case of vector flow imaging systems, the most employed flow estimation techniques are the directional beamforming based cross correlation and the triangulation-based autocorrelation. However, the directional beamforming-based techniques require an additional angle estimator and are not reliable if the flow angle is not constant throughout the region of interest. On the other hand, estimates…
▽ More
In the case of vector flow imaging systems, the most employed flow estimation techniques are the directional beamforming based cross correlation and the triangulation-based autocorrelation. However, the directional beamforming-based techniques require an additional angle estimator and are not reliable if the flow angle is not constant throughout the region of interest. On the other hand, estimates with triangulation-based techniques are prone to large bias and variance at low imaging depths due to limited angle for left and right apertures. In view of this, a novel angle independent depth aware fusion beamforming approach is proposed and evaluated in this paper. The hypothesis behind the proposed approach is that the peripheral flows are transverse in nature, where directional beamforming can be employed without the need of an angle estimator and the deeper flows being non-transverse and directional, triangulation-based vector flow imaging can be employed. In the simulation study, an overall 67.62% and 74.71% reduction in magnitude bias along with a slight reduction in the standard deviation are observed with the proposed fusion beamforming approach when compared to triangulation-based beamforming and directional beamforming, respectively, when implemented individually. The efficacy of the proposed approach is demonstrated with in-vivo experiments.
△ Less
Submitted 6 June, 2022; v1 submitted 5 August, 2021;
originally announced August 2021.
-
Introducing Introspective Transmission for Reflection Characterization in High Frame-Rate Ultrasound Imaging
Authors:
Gayathri Malamal,
Mahesh Raveendranatha Panicker
Abstract:
In ultrasound imaging, most of the transmit and receive beamforming schemes assume a homogenous diffuse medium and are evaluated based on contrast, temporal and spatial resolutions. However, most medium are constituted by both diffuse and specular regions and the assumption of a homogeneous medium does not hold good in all cases. Eventhough, there are some adaptive beamforming approaches proposed…
▽ More
In ultrasound imaging, most of the transmit and receive beamforming schemes assume a homogenous diffuse medium and are evaluated based on contrast, temporal and spatial resolutions. However, most medium are constituted by both diffuse and specular regions and the assumption of a homogeneous medium does not hold good in all cases. Eventhough, there are some adaptive beamforming approaches proposed in literature, they are mostly for receive beamforming. This study is aimed at investigating the relevance of transmission schemes in characterizing the diffuse and specular reflections, particularly at high frame rates. The transmit wavefront interaction behavior on the tissue interfaces for two high frame-rate transmission modalities, i.e. conventional synthetic transmit aperture imaging and multi-angle plane-wave imaging, are analyzed for multiple in-vitro and in-vivo radio-frequency datasets. Two novel visualization perspectives are proposed called contour isolines and directivity variance to understand the wave interaction with different tissue interfaces by considering the scalar and vector aspects of the reflected intensities respectively. We also rationalize the relevance of choosing the appropriate receive beamforming scheme according to the transmission modality through a comparison of delay and sum, filtered delay multiply and sum, minimum variance distortionless response, and specular beamforming algorithms. It is found that a synergistic blend of transmit and receive beamforming schemes adaptive to the tissue is inevitable to avoid any misdiagnosis.
△ Less
Submitted 16 July, 2021;
originally announced July 2021.
-
Hand-Drawn Electrical Circuit Recognition using Object Detection and Node Recognition
Authors:
Rachala Rohith Reddy,
Mahesh Raveendranatha Panicker
Abstract:
With the recent developments in neural networks, there has been a resurgence in algorithms for the automatic generation of simulation ready electronic circuits from hand-drawn circuits. However, most of the approaches in literature were confined to classify different types of electrical components and only a few of those methods have shown a way to rebuild the circuit schematic from the scanned im…
▽ More
With the recent developments in neural networks, there has been a resurgence in algorithms for the automatic generation of simulation ready electronic circuits from hand-drawn circuits. However, most of the approaches in literature were confined to classify different types of electrical components and only a few of those methods have shown a way to rebuild the circuit schematic from the scanned image, which is extremely important for further automation of netlist generation. This paper proposes a real-time algorithm for the automatic recognition of hand-drawn electrical circuits based on object detection and circuit node recognition. The proposed approach employs You Only Look Once version 5 (YOLOv5) for detection of circuit components and a novel Hough transform based approach for node recognition. Using YOLOv5 object detection algorithm, a mean average precision (mAP0.5) of 98.2% is achieved in detecting the components. The proposed method is also able to rebuild the circuit schematic with 80% accuracy with a near-real time performance of 0.33s per schematic generation.
△ Less
Submitted 27 November, 2021; v1 submitted 22 June, 2021;
originally announced June 2021.
-
Towards Fast Region Adaptive Ultrasound Beamformer for Plane Wave Imaging Using Convolutional Neural Networks
Authors:
Roshan P Mathews,
Mahesh Raveendranatha Panicker
Abstract:
Automatic learning algorithms for improving the image quality of diagnostic B-mode ultrasound (US) images have been gaining popularity in the recent past. In this work, a novel convolutional neural network (CNN) is trained using time of flight corrected in-vivo receiver data of plane wave transmit to produce corresponding high-quality minimum variance distortion less response (MVDR) beamformed ima…
▽ More
Automatic learning algorithms for improving the image quality of diagnostic B-mode ultrasound (US) images have been gaining popularity in the recent past. In this work, a novel convolutional neural network (CNN) is trained using time of flight corrected in-vivo receiver data of plane wave transmit to produce corresponding high-quality minimum variance distortion less response (MVDR) beamformed image. A comprehensive performance comparison in terms of qualitative and quantitative measures for fully connected neural network (FCNN), the proposed CNN architecture, MVDR and Delay and Sum (DAS) using the dataset from Plane wave Imaging Challenge in Ultrasound (PICMUS) is also reported in this work. The CNN architecture could leverage the spatial information and will be more region adaptive during the beamforming process. This is evident from the improvement seen over the baseline FCNN approach and conventional MVDR beamformer, both in resolution and contrast with an improvement of 6 dB in CNR using only zero-angle transmission over the baseline. With the observed reduction in the requirement of number of angles to produce similar image metrics would prove advantageous in providing a possibility for higher frame rates.
△ Less
Submitted 17 August, 2021; v1 submitted 13 June, 2021;
originally announced June 2021.
-
Learning the Imaging Landmarks: Unsupervised Key point Detection in Lung Ultrasound Videos
Authors:
Arpan Tripathi,
Mahesh Raveendranatha Panicker,
Abhilash R Hareendranathan,
Yale Tung Chen,
Jacob L Jaremko,
Kiran Vishnu Narayan,
Kesavadas C
Abstract:
Lung ultrasound (LUS) is an increasingly popular diagnostic imaging modality for continuous and periodic monitoring of lung infection, given its advantages of non-invasiveness, non-ionizing nature, portability and easy disinfection. The major landmarks assessed by clinicians for triaging using LUS are pleura, A and B lines. There have been many efforts for the automatic detection of these landmark…
▽ More
Lung ultrasound (LUS) is an increasingly popular diagnostic imaging modality for continuous and periodic monitoring of lung infection, given its advantages of non-invasiveness, non-ionizing nature, portability and easy disinfection. The major landmarks assessed by clinicians for triaging using LUS are pleura, A and B lines. There have been many efforts for the automatic detection of these landmarks. However, restricting to a few pre-defined landmarks may not reveal the actual imaging biomarkers particularly in case of new pathologies like COVID-19. Rather, the identification of key landmarks should be driven by data given the availability of a plethora of neural network algorithms. This work is a first of its kind attempt towards unsupervised detection of the key LUS landmarks in LUS videos of COVID-19 subjects during various stages of infection. We adapted the relatively newer approach of transporter neural networks to automatically mark and track pleura, A and B lines based on their periodic motion and relatively stable appearance in the videos. Initial results on unsupervised pleura detection show an accuracy of 91.8% employing 1081 LUS video frames.
△ Less
Submitted 13 June, 2021;
originally announced June 2021.
-
An Approach Towards Physics Informed Lung Ultrasound Image Scoring Neural Network for Diagnostic Assistance in COVID-19
Authors:
Mahesh Raveendranatha Panicker,
Yale Tung Chen,
Gayathri M,
Madhavanunni A N,
Kiran Vishnu Narayan,
C Kesavadas,
A P Vinod
Abstract:
Ultrasound is fast becoming an inevitable diagnostic tool for regular and continuous monitoring of the lung with the recent outbreak of COVID-19. In this work, a novel approach is presented to extract acoustic propagation-based features to automatically highlight the region below pleura, which is an important landmark in lung ultrasound (LUS). Subsequently, a multichannel input formed by using the…
▽ More
Ultrasound is fast becoming an inevitable diagnostic tool for regular and continuous monitoring of the lung with the recent outbreak of COVID-19. In this work, a novel approach is presented to extract acoustic propagation-based features to automatically highlight the region below pleura, which is an important landmark in lung ultrasound (LUS). Subsequently, a multichannel input formed by using the acoustic physics-based feature maps is fused to train a neural network, referred to as LUSNet, to classify the LUS images into five classes of varying severity of lung infection to track the progression of COVID-19. In order to ensure that the proposed approach is agnostic to the type of acquisition, the LUSNet, which consists of a U-net architecture is trained in an unsupervised manner with the acoustic feature maps to ensure that the encoder-decoder architecture is learning features in the pleural region of interest. A novel combination of the U-net output and the U-net encoder output is employed for the classification of severity of infection in the lung. A detailed analysis of the proposed approach on LUS images over the infection to full recovery period of ten confirmed COVID-19 subjects shows an average five-fold cross-validation accuracy, sensitivity, and specificity of 97%, 93%, and 98% respectively over 5000 frames of COVID-19 videos. The analysis also shows that, when the input dataset is limited and diverse as in the case of COVID-19 pandemic, an aided effort of combining acoustic propagation-based features along with the gray scale images, as proposed in this work, improves the performance of the neural network significantly and also aids the labelling and triaging process.
△ Less
Submitted 13 June, 2021;
originally announced June 2021.
-
Domain Specific Transporter Framework to Detect Fractures in Ultrasound
Authors:
Arpan Tripathi,
Abhilash Rakkunedeth,
Mahesh Raveendranatha Panicker,
Jack Zhang,
Naveenjyote Boora,
Jacob Jaremko
Abstract:
Ultrasound examination for detecting fractures is ideally suited for Emergency Departments (ED) as it is relatively fast, safe (from ionizing radiation), has dynamic imaging capability and is easily portable. High interobserver variability in manual assessment of ultrasound scans has piqued research interest in automatic assessment techniques using Deep Learning (DL). Most DL techniques are superv…
▽ More
Ultrasound examination for detecting fractures is ideally suited for Emergency Departments (ED) as it is relatively fast, safe (from ionizing radiation), has dynamic imaging capability and is easily portable. High interobserver variability in manual assessment of ultrasound scans has piqued research interest in automatic assessment techniques using Deep Learning (DL). Most DL techniques are supervised and are trained on large numbers of labeled data which is expensive and requires many hours of careful annotation by experts. In this paper, we propose an unsupervised, domain specific transporter framework to identify relevant keypoints from wrist ultrasound scans. Our framework provides a concise geometric representation highlighting regions with high structural variation in a 3D ultrasound (3DUS) sequence. We also incorporate domain specific information represented by instantaneous local phase (LP) which detects bone features from 3DUS. We validate the technique on 3DUS videos obtained from 30 subjects. Each ultrasound scan was independently assessed by three readers to identify fractures along with the corresponding x-ray. Saliency of keypoints detected in the image\ are compared against manual assessment based on distance from relevant features.The transporter neural network was able to accurately detect 180 out of 250 bone regions sampled from wrist ultrasound videos. We expect this technique to increase the applicability of ultrasound in fracture detection.
△ Less
Submitted 9 June, 2021;
originally announced June 2021.
-
Subject Independent Emotion Recognition using EEG Signals Employing Attention Driven Neural Networks
Authors:
Arjun,
Aniket Singh Rajpoot,
Mahesh Raveendranatha Panicker
Abstract:
In the recent past, deep learning-based approaches have significantly improved the classification accuracy when compared to classical signal processing and machine learning based frameworks. But most of them were subject-dependent studies which were not able to generalize on the subject-independent tasks due to the inter-subject variability present in EEG data. In this work, a novel deep learning…
▽ More
In the recent past, deep learning-based approaches have significantly improved the classification accuracy when compared to classical signal processing and machine learning based frameworks. But most of them were subject-dependent studies which were not able to generalize on the subject-independent tasks due to the inter-subject variability present in EEG data. In this work, a novel deep learning framework capable of doing subject-independent emotion recognition is presented, consisting of two parts. First, an unsupervised Long Short-Term Memory (LSTM) with channel-attention autoencoder is proposed for getting a subject-invariant latent vector subspace i.e., intrinsic variables present in the EEG data of each individual. Secondly, a convolutional neural network (CNN) with attention framework is presented for performing the task of subject-independent emotion recognition on the encoded lower dimensional latent space representations obtained from the proposed LSTM with channel-attention autoencoder. With the attention mechanism, the proposed approach could highlight the significant time-segments of the EEG signal, which contributes to the emotion under consideration as validated by the results. The proposed approach has been validated using publicly available datasets for EEG signals such as DEAP dataset, SEED dataset and CHB-MIT dataset. The proposed end-to-end deep learning framework removes the requirement of different hand engineered features and provides a single comprehensive task agnostic EEG analysis tool capable of performing various kinds of EEG analysis on subject independent data.
△ Less
Submitted 20 December, 2021; v1 submitted 7 June, 2021;
originally announced June 2021.
