-
LaMoD: Latent Motion Diffusion Model For Myocardial Strain Generation
Authors:
Jiarui Xing,
Nivetha Jayakumar,
Nian Wu,
Yu Wang,
Frederick H. Epstein,
Miaomiao Zhang
Abstract:
Motion and deformation analysis of cardiac magnetic resonance (CMR) imaging videos is crucial for assessing myocardial strain of patients with abnormal heart functions. Recent advances in deep learning-based image registration algorithms have shown promising results in predicting motion fields from routinely acquired CMR sequences. However, their accuracy often diminishes in regions with subtle ap…
▽ More
Motion and deformation analysis of cardiac magnetic resonance (CMR) imaging videos is crucial for assessing myocardial strain of patients with abnormal heart functions. Recent advances in deep learning-based image registration algorithms have shown promising results in predicting motion fields from routinely acquired CMR sequences. However, their accuracy often diminishes in regions with subtle appearance change, with errors propagating over time. Advanced imaging techniques, such as displacement encoding with stimulated echoes (DENSE) CMR, offer highly accurate and reproducible motion data but require additional image acquisition, which poses challenges in busy clinical flows. In this paper, we introduce a novel Latent Motion Diffusion model (LaMoD) to predict highly accurate DENSE motions from standard CMR videos. More specifically, our method first employs an encoder from a pre-trained registration network that learns latent motion features (also considered as deformation-based shape features) from image sequences. Supervised by the ground-truth motion provided by DENSE, LaMoD then leverages a probabilistic latent diffusion model to reconstruct accurate motion from these extracted features. Experimental results demonstrate that our proposed method, LaMoD, significantly improves the accuracy of motion analysis in standard CMR images; hence improving myocardial strain analysis in clinical settings for cardiac patients. Our code will be publicly available on upon acceptance.
△ Less
Submitted 2 July, 2024;
originally announced July 2024.
-
An end-to-end deep learning pipeline to derive blood input with partial volume corrections for automated parametric brain PET map**
Authors:
Rugved Chavan,
Gabriel Hyman,
Zoraiz Qureshi,
Nivetha Jayakumar,
William Terrell,
Stuart Berr,
David Schiff,
Megan Wardius,
Nathan Fountain,
Thomas Muttikkal,
Mark Quigg,
Miaomiao Zhang,
Bijoy Kundu
Abstract:
Dynamic 2-[18F] fluoro-2-deoxy-D-glucose positron emission tomography (dFDG-PET) for human brain imaging has considerable clinical potential, yet its utilization remains limited. A key challenge in the quantitative analysis of dFDG-PET is characterizing a patient-specific blood input function, traditionally reliant on invasive arterial blood sampling. This research introduces a novel approach empl…
▽ More
Dynamic 2-[18F] fluoro-2-deoxy-D-glucose positron emission tomography (dFDG-PET) for human brain imaging has considerable clinical potential, yet its utilization remains limited. A key challenge in the quantitative analysis of dFDG-PET is characterizing a patient-specific blood input function, traditionally reliant on invasive arterial blood sampling. This research introduces a novel approach employing non-invasive deep learning model-based computations from the internal carotid arteries (ICA) with partial volume (PV) corrections, thereby eliminating the need for invasive arterial sampling. We present an end-to-end pipeline incorporating a 3D U-Net based ICA-net for ICA segmentation, alongside a Recurrent Neural Network (RNN) based MCIF-net for the derivation of a model-corrected blood input function (MCIF) with PV corrections. The developed 3D U-Net and RNN was trained and validated using a 5-fold cross-validation approach on 50 human brain FDG PET datasets. The ICA-net achieved an average Dice score of 82.18% and an Intersection over Union of 68.54% across all tested scans. Furthermore, the MCIF-net exhibited a minimal root mean squared error of 0.0052. The application of this pipeline to ground truth data for dFDG-PET brain scans resulted in the precise localization of seizure onset regions, which contributed to a successful clinical outcome, with the patient achieving a seizure-free state after treatment. These results underscore the efficacy of the ICA-net and MCIF-net deep learning pipeline in learning the ICA structure's distribution and automating MCIF computation with PV corrections. This advancement marks a significant leap in non-invasive neuroimaging.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
SADIR: Shape-Aware Diffusion Models for 3D Image Reconstruction
Authors:
Nivetha Jayakumar,
Tonmoy Hossain,
Miaomiao Zhang
Abstract:
3D image reconstruction from a limited number of 2D images has been a long-standing challenge in computer vision and image analysis. While deep learning-based approaches have achieved impressive performance in this area, existing deep networks often fail to effectively utilize the shape structures of objects presented in images. As a result, the topology of reconstructed objects may not be well pr…
▽ More
3D image reconstruction from a limited number of 2D images has been a long-standing challenge in computer vision and image analysis. While deep learning-based approaches have achieved impressive performance in this area, existing deep networks often fail to effectively utilize the shape structures of objects presented in images. As a result, the topology of reconstructed objects may not be well preserved, leading to the presence of artifacts such as discontinuities, holes, or mismatched connections between different parts. In this paper, we propose a shape-aware network based on diffusion models for 3D image reconstruction, named SADIR, to address these issues. In contrast to previous methods that primarily rely on spatial correlations of image intensities for 3D reconstruction, our model leverages shape priors learned from the training data to guide the reconstruction process. To achieve this, we develop a joint learning network that simultaneously learns a mean shape under deformation models. Each reconstructed image is then considered as a deformed variant of the mean shape. We validate our model, SADIR, on both brain and cardiac magnetic resonance images (MRIs). Experimental results show that our method outperforms the baselines with lower reconstruction error and better preservation of the shape structure of objects within the images.
△ Less
Submitted 3 October, 2023; v1 submitted 6 September, 2023;
originally announced September 2023.
-
Multimodal Deep Learning to Differentiate Tumor Recurrence from Treatment Effect in Human Glioblastoma
Authors:
Tonmoy Hossain,
Zoraiz Qureshi,
Nivetha Jayakumar,
Thomas Eluvathingal Muttikkal,
Sohil Patel,
David Schiff,
Miaomiao Zhang,
Bijoy Kundu
Abstract:
Differentiating tumor progression (TP) from treatment-related necrosis (TN) is critical for clinical management decisions in glioblastoma (GBM). Dynamic FDG PET (dPET), an advance from traditional static FDG PET, may prove advantageous in clinical staging. dPET includes novel methods of a model-corrected blood input function that accounts for partial volume averaging to compute parametric maps tha…
▽ More
Differentiating tumor progression (TP) from treatment-related necrosis (TN) is critical for clinical management decisions in glioblastoma (GBM). Dynamic FDG PET (dPET), an advance from traditional static FDG PET, may prove advantageous in clinical staging. dPET includes novel methods of a model-corrected blood input function that accounts for partial volume averaging to compute parametric maps that reveal kinetic information. In a preliminary study, a convolution neural network (CNN) was trained to predict classification accuracy between TP and TN for $35$ brain tumors from $26$ subjects in the PET-MR image space. 3D parametric PET Ki (from dPET), traditional static PET standardized uptake values (SUV), and also the brain tumor MR voxels formed the input for the CNN. The average test accuracy across all leave-one-out cross-validation iterations adjusting for class weights was $0.56$ using only the MR, $0.65$ using only the SUV, and $0.71$ using only the Ki voxels. Combining SUV and MR voxels increased the test accuracy to $0.62$. On the other hand, MR and Ki voxels increased the test accuracy to $0.74$. Thus, dPET features alone or with MR features in deep learning models would enhance prediction accuracy in differentiating TP vs TN in GBM.
△ Less
Submitted 27 February, 2023;
originally announced February 2023.
-
Label-free incoherent super-resolution optical microscopy
Authors:
Nikhil Jayakumar,
Luis E. Villegas-Hernández,
Weisong Zhao,
Hong Mao,
Firehun T Dullo,
Jean-Claude Tinguley,
Krizia Sagini,
Alicia Llorente,
Balpreet Singh Ahluwalia
Abstract:
The photo-kinetics of fluorescent molecules has enabled the circumvention of far-field optical diffraction-limit. Despite its enormous potential, the necessity to label the sample may adversely influence the delicate biology under investigation. Thus, continued development efforts are needed to surpass the far-field label-free diffraction barrier. The coherence of the detected light in label-free…
▽ More
The photo-kinetics of fluorescent molecules has enabled the circumvention of far-field optical diffraction-limit. Despite its enormous potential, the necessity to label the sample may adversely influence the delicate biology under investigation. Thus, continued development efforts are needed to surpass the far-field label-free diffraction barrier. The coherence of the detected light in label-free mode hinders the application of existing super-resolution methods based on incoherent fluorescence imaging. In this article, we present the physics and propose a methodology to circumvent this challenge by exploiting the photoluminescence of silicon nitride waveguides for near-field illumination of unlabeled samples. The technique is abbreviated EPSLON, Evanescently decaying Photoluminescence Scattering enables Label-free Optical Nanoscopy. We demonstrate that such an illumination has properties that mimics the photo-kinetics of nano-sized fluorescent molecules. This allows to develop a label-free incoherent system that is linear in intensity, and stable with time thereby permitting the application of techniques like structured illumination microscopy (SIM) and intensity-fluctuation based optical nanoscopy (IFON) in label-free mode to circumvent the diffraction limit. We experimentally demonstrate labelfree super-resolution imaging of nanobeads (polystyrene and gold), extra-cellular vesicles, rat kidney sections and human placenta tissue.
△ Less
Submitted 7 November, 2023; v1 submitted 9 January, 2023;
originally announced January 2023.
-
Ramanujan's type of product of theta functions and its applications
Authors:
D. J. Prabhakaran,
N. Jayakumar,
K. Ranjithkumar
Abstract:
In this paper, we initiate a generous amount of new-found general theorems for explicit evaluations of product of the theta functions $b_{m, n}$ using Kronecker's limit formula and other various novel explicit evaluations that were introduced thereupon. Also, we have obtained a few novel values of Ramanujan's class invariant $g_n$ using new-found values of $b_{m, n}$. Eventually, we have shown tha…
▽ More
In this paper, we initiate a generous amount of new-found general theorems for explicit evaluations of product of the theta functions $b_{m, n}$ using Kronecker's limit formula and other various novel explicit evaluations that were introduced thereupon. Also, we have obtained a few novel values of Ramanujan's class invariant $g_n$ using new-found values of $b_{m, n}$. Eventually, we have shown that $b_{m, n}$ is the unit in certain algebraic number fields.
△ Less
Submitted 8 December, 2021;
originally announced December 2021.
-
Label-free chip-based evanescent light scattering super-resolution and superior-contrast optical microscopy (cELS)
Authors:
Nikhil Jayakumar,
Firehun T Dullo,
Vishesh Dubey,
Azeem Ahmad Ahmad,
Jennifer Cauzzo,
Eduarda Mazagao Guerreiro,
Omri Snir,
Natasa Skalko-Basnet,
Krishna Agarwal,
Balpreet Singh Ahluwalia
Abstract:
Chip-based Evanescent Light Scattering (cELS) utilizes the multiple modes of a high-index contrast optical waveguide for near-field illumination of unlabeled samples, thereby repositioning the highest spatial frequencies of the sample into the far-field. The multiple modes scattering off the sample with different phase differences is engineered to have random spatial distributions within the integ…
▽ More
Chip-based Evanescent Light Scattering (cELS) utilizes the multiple modes of a high-index contrast optical waveguide for near-field illumination of unlabeled samples, thereby repositioning the highest spatial frequencies of the sample into the far-field. The multiple modes scattering off the sample with different phase differences is engineered to have random spatial distributions within the integration time of the camera, mitigating the coherent speckle noise. This enables label-free superior-contrast imaging of weakly scattering nanosized specimens such as extra-cellular vesicles (EVs) and liposomes, dynamics of living HeLa cells etc. The article explains and validates experimentally the physics behind cELS by demonstrating a multi-moded straight waveguide as a partially coherent light source. For isotropic super-resolution, spatially incoherent light engineered via multiple-arms waveguide chip and intensity-fluctuation based algorithms are used. The proof-of-concept results are demonstrated on 100 nm polystyrene beads and resolution improvement of close to 2X is shown. cELS also realizes (2-10)X more contrast as opposed to conventional imaging techniques. In addition, cELS platform is miniaturized and enables large field-of-view imaging compared to state of the art label-free techniques. cELS holds a potential for label-free super-resolution imaging of nanosized biological specimens at high-throughput.
△ Less
Submitted 24 February, 2022; v1 submitted 24 August, 2021;
originally announced August 2021.
-
Demystifying speckle field quantitative phase microscopy
Authors:
Azeem Ahmad,
Nikhil Jayakumar,
Balpreet Singh Ahluwalia
Abstract:
Quantitative phase microscopy (QPM) has found significant applications in the field of biomedical imaging which works on the principle of interferometry. The theory behind achieving interference in QPM with conventional light sources such as white light and lasers is very well developed. Recently, the use of dynamic speckle illumination (DSI) in QPM has attracted attention due to its advantages ov…
▽ More
Quantitative phase microscopy (QPM) has found significant applications in the field of biomedical imaging which works on the principle of interferometry. The theory behind achieving interference in QPM with conventional light sources such as white light and lasers is very well developed. Recently, the use of dynamic speckle illumination (DSI) in QPM has attracted attention due to its advantages over conventional light sources such as high spatial phase sensitivity, single shot, scalable field of view (FOV) and resolution. However, the understanding behind obtaining interference fringes in QPM with DSI has not been convincingly covered previously. This imposes a constraint on obtaining interference fringes in QPM using DSI and limits its widespread penetration in the field of biomedical imaging. The present article provides the basic understanding of DSI through both simulation and experiments that is essential to build interference optical microscopy systems such as QPM, digital holographic microscopy and optical coherence tomography. Using the developed theory of DSI we demonstrate its capabilities of using non-identical objective lenses in both arms of the interference microscopy without degrading the interference fringe contrast and providing the flexibility to use user-defined microscope objective lens. It is also demonstrated that the interference fringes are not washed out over a large range of optical path difference (OPD) between the object and the reference arm providing competitive edge over low temporal coherence light sources. The theory and explanation developed here would enable wider penetration of DSI based QPM for applications in biology and material sciences.
△ Less
Submitted 22 July, 2021;
originally announced July 2021.
-
High throughput spatially sensitive single-shot quantitative phase microscopy
Authors:
Azeem Ahmad,
Vishesh Dubey,
Nikhil Jayakumar,
Anowarul Habib,
Ankit Butola,
Mona Nystad,
Ganesh Acharya,
Purusotam Basnet,
Dalip Singh Mehta,
Balpreet Singh Ahluwalia
Abstract:
High space-bandwidth product with high spatial phase sensitivity is indispensable for a single-shot quantitative phase microscopy (QPM) system. It opens avenue for widespread applications of QPM in the field of biomedical imaging. Temporally low coherence length light sources are generally implemented to achieve high spatial phase sensitivity in QPM at the cost of either reduced temporal resolutio…
▽ More
High space-bandwidth product with high spatial phase sensitivity is indispensable for a single-shot quantitative phase microscopy (QPM) system. It opens avenue for widespread applications of QPM in the field of biomedical imaging. Temporally low coherence length light sources are generally implemented to achieve high spatial phase sensitivity in QPM at the cost of either reduced temporal resolution or smaller field of view (FOV). On the contrary, high temporal coherence light sources like lasers are capable of exploiting the full FOV of the QPM systems at the expense of less spatial phase sensitivity. In the present work, we employed pseudo-thermal light source (PTLS) in QPM which overcomes the limitations of conventional light sources. The capabilities of PTLS over conventional light sources are systematically studied and demonstrated on various test objects like USAF resolution chart and thin optical waveguide (height ~ 8 nm). The spatial phase sensitivity of QPM in case of PTLS is measured to be equivalent to that for white light source. The high-speed and large FOV capabilities of PTLS based QPM is demonstrated by high-speed imaging of live sperm cells that is limited by the camera speed and by imaging extra-ordinary large FOV phase imaging on histopathology placenta tissue samples.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
On-chip TIRF nanoscopy by applying Haar wavelet kernel analysis on intensity fluctuations induced by chip illumination
Authors:
Nikhil Jayakumar,
Øystein I Helle,
Krishna Agarwal,
Balpreet Singh Ahluwalia
Abstract:
Photonic-chip based TIRF illumination has been used to demonstrate several on-chip optical nanoscopy methods. The sample is illuminated by the evanescent field generated by the electromagnetic wave modes guided inside the optical waveguide. In addition to the photokinetics of the fluorophores, the waveguide modes can be further exploited for introducing controlled intensity fluctuations for exploi…
▽ More
Photonic-chip based TIRF illumination has been used to demonstrate several on-chip optical nanoscopy methods. The sample is illuminated by the evanescent field generated by the electromagnetic wave modes guided inside the optical waveguide. In addition to the photokinetics of the fluorophores, the waveguide modes can be further exploited for introducing controlled intensity fluctuations for exploitation by techniques such as super-resolution optical fluctuation imaging (SOFI). However, the problem of non-uniform illumination pattern generated by the modes contribute to artifacts in the reconstructed image. To alleviate this problem, we propose to perform Haar wavelet kernel (HAWK) analysis on the original image stack prior to the application of (SOFI). HAWK produces a computational image stack with higher spatio-temporal sparsity than the original stack. In the case of multimoded non-uniform illumination patterns, HAWK processing bre aks the mode pattern while introducing spatio-temporal sparsity, thereby differentially affecting the non-uniformity of the illumination. Consequently, this assists nanoscopy methods such as SOFI to better support super-resolution, which is otherwise compromised due to spatial correlation of the mode patterns in the raw image. Furthermore, applying HAWK prior to SOFI alleviates the problem of artifacts due to non-uniform illumination without degrading temporal resolution. Our experimental results demonstrate resolution enhancement as well as reduction in artifacts through the combination of HAWK and SOFI.
△ Less
Submitted 25 July, 2020;
originally announced July 2020.
-
A transparent waveguide chip for versatile TIRF-based microscopy and nanoscopy
Authors:
Anish Priyadarshi,
Firehun Tsige Dullo,
Deanna L. Wolfson,
Azeem Ahmad,
Nikhil Jayakumar,
Vishesh Dubey,
Jean-Claude Tinguely,
Balpreet Singh Ahluwalia,
Ganapathy Senthil Murugan
Abstract:
Total internal reflection fluorescence microscopy (TIRF) has enabled low-background, live-cell friendly imaging of cell surfaces and other thin samples thanks to the shallow penetration of the evanescent light field into the sample. The implementation of TIRF on optical waveguide chips (c-TIRF) has overcome historical limitations on the magnification and field of view (FOV) compared to lens-based…
▽ More
Total internal reflection fluorescence microscopy (TIRF) has enabled low-background, live-cell friendly imaging of cell surfaces and other thin samples thanks to the shallow penetration of the evanescent light field into the sample. The implementation of TIRF on optical waveguide chips (c-TIRF) has overcome historical limitations on the magnification and field of view (FOV) compared to lens-based TIRF, and further allows the light to be guided in complicated patterns that can be used for advanced imaging techniques or selective stimulation of the sample. However, the opacity of the chips themselves has thus far precluded their use on inverted microscopes and complicated sample preparation and handling. In this work, we introduce a new platform for c-TIRF imaging based on a transparent substrate, which is fully compatible with sample handling and imaging procedures commonly used with a standard #1.5 glass coverslip, and is fabricated using standard complementary metal-oxide-semiconductor (CMOS) techniques, which can easily be scaled up for mass production. We demonstrate its performance on synthetic and biological samples using both upright and inverted microscopes, and show how it can be extended to super-resolution applications, achieving a resolution of 116 nm using super resolution radial fluctuations (SRRF). These new chips retain the scalable FOV of opaque chip-based TIRF and the high axial resolution of TIRF, and have the versatility to be used with many different objective lenses, microscopy methods, and handling techniques. We thus see c-TIRF as a technology primed for widespread adoption, increasing both TIRF's accessibility to users and the range of applications that can benefit from it.
△ Less
Submitted 1 July, 2020; v1 submitted 11 June, 2020;
originally announced June 2020.
-
Performance evaluation of organic emulsion liquid membrane on phenol removal
Authors:
Y. S. Ng,
N. S. Jayakumar,
M. A. Hashim
Abstract:
The percentage removal of phenol from aqueous solution by emulsion liquid membrane and emulsion leakage was investigated experimentally for various parameters such as membrane:internal phase ratio, membrane:external phase ratio, emulsification speed, emulsification time, carrier concentration, surfactant concentration and internal agent concentration. These parameters strongly influence the percen…
▽ More
The percentage removal of phenol from aqueous solution by emulsion liquid membrane and emulsion leakage was investigated experimentally for various parameters such as membrane:internal phase ratio, membrane:external phase ratio, emulsification speed, emulsification time, carrier concentration, surfactant concentration and internal agent concentration. These parameters strongly influence the percentage removal of phenol and emulsion leakage. Under optimum membrane properties, the percentage removal of phenol was as high as 98.33%, with emulsion leakage of 1.25%. It was also found that the necessity of carrier for enhancing phenol removal was strongly dependent on the internal agent concentration.
△ Less
Submitted 30 November, 2014;
originally announced December 2014.
-
Behavior of hydrophobic ionic liquids as liquid membranes on phenol removal: Experimental study and optimization
Authors:
Y. S. Ng,
N. S. Jayakumar,
M. A. Hashim
Abstract:
Room temperature ionic liquids show potential as an alternative to conventional organic membrane solvents mainly due to their properties of low vapor pressure, low volatility and they are often stable. In the present work, the technical feasibilities of room temperature ionic liquids as bulk liquid membranes for phenol removal were investigated experimentally. Three ionic liquids with high hydroph…
▽ More
Room temperature ionic liquids show potential as an alternative to conventional organic membrane solvents mainly due to their properties of low vapor pressure, low volatility and they are often stable. In the present work, the technical feasibilities of room temperature ionic liquids as bulk liquid membranes for phenol removal were investigated experimentally. Three ionic liquids with high hydrophobicity were used and their phenol removal efficiency, membrane stability and membrane loss were studied. Besides that, the effects of several parameters, namely feed phase pH, feed concentration, NaOH concentration and stirring speeds on the performance of best ionic liquid membrane were also evaluated. Lastly, an optimization study on bulk ionic liquid membrane was conducted and the maximum phenol removal efficiency was compared with the organic liquid membranes. The preliminary study shows that high phenol extraction and strip** efficiencies of 96.21% and 98.10%, respectively can be achieved by ionic liquid membrane with a low membrane loss which offers a better choice to organic membrane solvents.
△ Less
Submitted 30 November, 2014;
originally announced December 2014.