-
Hypothesis-Driven Deep Learning for Out of Distribution Detection
Authors:
Yasith Jayawardana,
Azeem Ahmad,
Balpreet S. Ahluwalia,
Rafi Ahmad,
Sampath Jayarathna,
Dushan N. Wadduwage
Abstract:
Predictions of opaque black-box systems are frequently deployed in high-stakes applications such as healthcare. For such applications, it is crucial to assess how models handle samples beyond the domain of training data. While several metrics and tests exist to detect out-of-distribution (OoD) data from in-distribution (InD) data to a deep neural network (DNN), their performance varies significant…
▽ More
Predictions of opaque black-box systems are frequently deployed in high-stakes applications such as healthcare. For such applications, it is crucial to assess how models handle samples beyond the domain of training data. While several metrics and tests exist to detect out-of-distribution (OoD) data from in-distribution (InD) data to a deep neural network (DNN), their performance varies significantly across datasets, models, and tasks, which limits their practical use. In this paper, we propose a hypothesis-driven approach to quantify whether a new sample is InD or OoD. Given a trained DNN and some input, we first feed the input through the DNN and compute an ensemble of OoD metrics, which we term latent responses. We then formulate the OoD detection problem as a hypothesis test between latent responses of different groups, and use permutation-based resampling to infer the significance of the observed latent responses under a null hypothesis. We adapt our method to detect an unseen sample of bacteria to a trained deep learning model, and show that it reveals interpretable differences between InD and OoD latent responses. Our work has implications for systematic novelty detection and informed decision-making from classifiers trained on a subset of labels.
△ Less
Submitted 20 March, 2024;
originally announced March 2024.
-
Label-free incoherent super-resolution optical microscopy
Authors:
Nikhil Jayakumar,
Luis E. Villegas-Hernández,
Weisong Zhao,
Hong Mao,
Firehun T Dullo,
Jean-Claude Tinguley,
Krizia Sagini,
Alicia Llorente,
Balpreet Singh Ahluwalia
Abstract:
The photo-kinetics of fluorescent molecules has enabled the circumvention of far-field optical diffraction-limit. Despite its enormous potential, the necessity to label the sample may adversely influence the delicate biology under investigation. Thus, continued development efforts are needed to surpass the far-field label-free diffraction barrier. The coherence of the detected light in label-free…
▽ More
The photo-kinetics of fluorescent molecules has enabled the circumvention of far-field optical diffraction-limit. Despite its enormous potential, the necessity to label the sample may adversely influence the delicate biology under investigation. Thus, continued development efforts are needed to surpass the far-field label-free diffraction barrier. The coherence of the detected light in label-free mode hinders the application of existing super-resolution methods based on incoherent fluorescence imaging. In this article, we present the physics and propose a methodology to circumvent this challenge by exploiting the photoluminescence of silicon nitride waveguides for near-field illumination of unlabeled samples. The technique is abbreviated EPSLON, Evanescently decaying Photoluminescence Scattering enables Label-free Optical Nanoscopy. We demonstrate that such an illumination has properties that mimics the photo-kinetics of nano-sized fluorescent molecules. This allows to develop a label-free incoherent system that is linear in intensity, and stable with time thereby permitting the application of techniques like structured illumination microscopy (SIM) and intensity-fluctuation based optical nanoscopy (IFON) in label-free mode to circumvent the diffraction limit. We experimentally demonstrate labelfree super-resolution imaging of nanobeads (polystyrene and gold), extra-cellular vesicles, rat kidney sections and human placenta tissue.
△ Less
Submitted 7 November, 2023; v1 submitted 9 January, 2023;
originally announced January 2023.
-
Hilbert phase microscopy based on pseudo thermal illumination in Linnik configuration
Authors:
Mikołaj Rogalski,
Maria Cywińska,
Azeem Ahmad,
Krzysztof Patorski,
Vicente Micó,
Balpreet S. Ahluwalia,
Maciej Trusiak
Abstract:
Quantitative phase microscopy (QPM) is often based on recording an object-reference interference pattern and its further phase demodulation. We propose Pseudo Hilbert Phase Microscopy (PHPM) where we combine pseudo thermal light source illumination and Hilbert spiral transform phase demodulation to achieve hybrid hardware-software-driven noise robustness and increase in resolution of single-shot c…
▽ More
Quantitative phase microscopy (QPM) is often based on recording an object-reference interference pattern and its further phase demodulation. We propose Pseudo Hilbert Phase Microscopy (PHPM) where we combine pseudo thermal light source illumination and Hilbert spiral transform phase demodulation to achieve hybrid hardware-software-driven noise robustness and increase in resolution of single-shot coherent QPM. Those advantageous features stem from physically altering the laser spatial coherence and numerically restoring spectrally overlapped object spatial frequencies. Capabilities of the PHPM are demonstrated analyzing calibrated phase targets and live HeLa cells in comparison with laser illumination and phase demodulation via temporal phase shifting and Fourier transform techniques. Performed studies verified unique ability of the PHPM to couple single-shot imaging, noise minimization, and preservation of phase details.
△ Less
Submitted 20 September, 2022;
originally announced September 2022.
-
Transmission Structured Illumination Microscopy using Tilt-mirror Assembly
Authors:
Krishnendu Samanta,
Azeem Ahmad,
Jean-Claude Tinguely,
Balpreet Singh Ahluwalia,
Joby Joseph
Abstract:
We present experimental demonstration of tilt-mirror assisted transmission structured illumination microscopy (tSIM) that offers a large field of view super resolution imaging. An assembly of custom-designed tilt-mirrors are employed as the illumination module where the sample is excited with the interference of two beams reflected from the opposite pair of mirror facets. Tunable frequency structu…
▽ More
We present experimental demonstration of tilt-mirror assisted transmission structured illumination microscopy (tSIM) that offers a large field of view super resolution imaging. An assembly of custom-designed tilt-mirrors are employed as the illumination module where the sample is excited with the interference of two beams reflected from the opposite pair of mirror facets. Tunable frequency structured patterns are generated by changing the mirror-tilt angle and the hexagonal-symmetric arrangement is considered for the isotropic resolution in three orientations. Utilizing high numerical aperture (NA) objective in standard SIM provides super-resolution compromising with the field-of-view (FOV). Employing low NA (20X/0.4) objective lens detection, we experimentally demonstrate ~ (0.56mm x 0.35mm) size single FOV image with ~1.7- and ~2.4-fold resolution improvement (exploiting various illumination by tuning tilt-mirrors) over the diffraction limit. The results are verified both for the fluorescent beads as well as biological samples. The tSIM geometry decouples the illumination and the collection light paths consequently enabling free change of the imaging objective lens without influencing the spatial frequency of the illumination pattern that are defined by the tilt-mirrors. The large and scalable FoV supported by tSIM will find usage for applications where scanning large areas are necessary as in pathology and applications where images must be correlated both in space and time.
△ Less
Submitted 16 August, 2022;
originally announced August 2022.
-
Deep Optical Coding Design in Computational Imaging
Authors:
Henry Arguello,
Jorge Bacca,
Hasindu Kariyawasam,
Edwin Vargas,
Miguel Marquez,
Ramith Hettiarachchi,
Hans Garcia,
Kithmini Herath,
Udith Haputhanthri,
Balpreet Singh Ahluwalia,
Peter So,
Dushan N. Wadduwage,
Chamira U. S. Edussooriya
Abstract:
Computational optical imaging (COI) systems leverage optical coding elements (CE) in their setups to encode a high-dimensional scene in a single or multiple snapshots and decode it by using computational algorithms. The performance of COI systems highly depends on the design of its main components: the CE pattern and the computational method used to perform a given task. Conventional approaches re…
▽ More
Computational optical imaging (COI) systems leverage optical coding elements (CE) in their setups to encode a high-dimensional scene in a single or multiple snapshots and decode it by using computational algorithms. The performance of COI systems highly depends on the design of its main components: the CE pattern and the computational method used to perform a given task. Conventional approaches rely on random patterns or analytical designs to set the distribution of the CE. However, the available data and algorithm capabilities of deep neural networks (DNNs) have opened a new horizon in CE data-driven designs that jointly consider the optical encoder and computational decoder. Specifically, by modeling the COI measurements through a fully differentiable image formation model that considers the physics-based propagation of light and its interaction with the CEs, the parameters that define the CE and the computational decoder can be optimized in an end-to-end (E2E) manner. Moreover, by optimizing just CEs in the same framework, inference tasks can be performed from pure optics. This work surveys the recent advances on CE data-driven design and provides guidelines on how to parametrize different optical elements to include them in the E2E framework. Since the E2E framework can handle different inference applications by changing the loss function and the DNN, we present low-level tasks such as spectral imaging reconstruction or high-level tasks such as pose estimation with privacy preserving enhanced by using optimal task-based optical architectures. Finally, we illustrate classification and 3D object recognition applications performed at the speed of the light using all-optics DNN.
△ Less
Submitted 17 August, 2022; v1 submitted 27 June, 2022;
originally announced July 2022.
-
From Hours to Seconds: Towards 100x Faster Quantitative Phase Imaging via Differentiable Microscopy
Authors:
Udith Haputhanthri,
Kithmini Herath,
Ramith Hettiarachchi,
Hasindu Kariyawasam,
Azeem Ahmad,
Balpreet S. Ahluwalia,
Chamira U. S. Edussooriya,
Dushan N. Wadduwage
Abstract:
With applications ranging from metabolomics to histopathology, quantitative phase microscopy (QPM) is a powerful label-free imaging modality. Despite significant advances in fast multiplexed imaging sensors and deep-learning-based inverse solvers, the throughput of QPM is currently limited by the speed of electronic hardware. Complementarily, to improve throughput further, here we propose to acqui…
▽ More
With applications ranging from metabolomics to histopathology, quantitative phase microscopy (QPM) is a powerful label-free imaging modality. Despite significant advances in fast multiplexed imaging sensors and deep-learning-based inverse solvers, the throughput of QPM is currently limited by the speed of electronic hardware. Complementarily, to improve throughput further, here we propose to acquire images in a compressed form such that more information can be transferred beyond the existing electronic hardware bottleneck. To this end, we present a learnable optical compression-decompression framework that learns content-specific features. The proposed differentiable quantitative phase microscopy ($\partial μ$) first uses learnable optical feature extractors as image compressors. The intensity representation produced by these networks is then captured by the imaging sensor. Finally, a reconstruction network running on electronic hardware decompresses the QPM images. In numerical experiments, the proposed system achieves compression of $\times$ 64 while maintaining the SSIM of $\sim 0.90$ and PSNR of $\sim 30$ dB on cells. The results demonstrated by our experiments open up a new pathway for achieving end-to-end optimized (i.e., optics and electronic) compact QPM systems that may provide unprecedented throughput improvements.
△ Less
Submitted 9 October, 2023; v1 submitted 23 May, 2022;
originally announced May 2022.
-
Differentiable Microscopy Designs an All Optical Phase Retrieval Microscope
Authors:
Kithmini Herath,
Udith Haputhanthri,
Ramith Hettiarachchi,
Hasindu Kariyawasam,
Raja N. Ahmad,
Azeem Ahmad,
Balpreet S. Ahluwalia,
Chamira U. S. Edussooriya,
Dushan N. Wadduwage
Abstract:
Since the late 16th century, scientists have continuously innovated and developed new microscope types for various applications. Creating a new architecture from the ground up requires substantial scientific expertise and creativity, often spanning years or even decades. In this study, we propose an alternative approach called "Differentiable Microscopy," which introduces a top-down design paradig…
▽ More
Since the late 16th century, scientists have continuously innovated and developed new microscope types for various applications. Creating a new architecture from the ground up requires substantial scientific expertise and creativity, often spanning years or even decades. In this study, we propose an alternative approach called "Differentiable Microscopy," which introduces a top-down design paradigm for optical microscopes. Using all-optical phase retrieval as an illustrative example, we demonstrate the effectiveness of data-driven microscopy design through $\partialμ$. Furthermore, we conduct comprehensive comparisons with competing methods, showcasing the consistent superiority of our learned designs across multiple datasets, including biological samples. To substantiate our ideas, we experimentally validate the functionality of one of the learned designs, providing a proof of concept. The proposed differentiable microscopy framework supplements the creative process of designing new optical systems and would perhaps lead to unconventional but better optical designs.
△ Less
Submitted 24 August, 2023; v1 submitted 28 March, 2022;
originally announced March 2022.
-
Surface acoustic waves inside polystyrene microparticles through photoacoustic microscopy
Authors:
Abhishek Ranjan,
Anowarul Habib,
Azeem Ahmad,
Balpreet Singh Ahluwalia,
Frank Melandsø
Abstract:
We demonstrate surface acoustic waves inside polystyrene microspheres of different sizes experimentally through photoacoustic microscopy and validate the experimental result with simulation. A novel method for sample preparation of a lifted sample is also presented where the microparticles are suspended in agarose above the surface of the petridish. Another objective of this study was to investiga…
▽ More
We demonstrate surface acoustic waves inside polystyrene microspheres of different sizes experimentally through photoacoustic microscopy and validate the experimental result with simulation. A novel method for sample preparation of a lifted sample is also presented where the microparticles are suspended in agarose above the surface of the petridish. Another objective of this study was to investigate the results with different laser focus hitting on the microparticles and their impact on photoacoustic images and photoacoustic signals. An absorbing microsphere is excited with a pulsed laser of wavelength 532 nm and the photoacoustic signal is detected using a 40 MHz transducer. On analyzing the photoacoustic signals from microspheres, we find the signature of surface acoustic waves.
△ Less
Submitted 20 March, 2022; v1 submitted 31 January, 2022;
originally announced February 2022.
-
Label-free chip-based evanescent light scattering super-resolution and superior-contrast optical microscopy (cELS)
Authors:
Nikhil Jayakumar,
Firehun T Dullo,
Vishesh Dubey,
Azeem Ahmad Ahmad,
Jennifer Cauzzo,
Eduarda Mazagao Guerreiro,
Omri Snir,
Natasa Skalko-Basnet,
Krishna Agarwal,
Balpreet Singh Ahluwalia
Abstract:
Chip-based Evanescent Light Scattering (cELS) utilizes the multiple modes of a high-index contrast optical waveguide for near-field illumination of unlabeled samples, thereby repositioning the highest spatial frequencies of the sample into the far-field. The multiple modes scattering off the sample with different phase differences is engineered to have random spatial distributions within the integ…
▽ More
Chip-based Evanescent Light Scattering (cELS) utilizes the multiple modes of a high-index contrast optical waveguide for near-field illumination of unlabeled samples, thereby repositioning the highest spatial frequencies of the sample into the far-field. The multiple modes scattering off the sample with different phase differences is engineered to have random spatial distributions within the integration time of the camera, mitigating the coherent speckle noise. This enables label-free superior-contrast imaging of weakly scattering nanosized specimens such as extra-cellular vesicles (EVs) and liposomes, dynamics of living HeLa cells etc. The article explains and validates experimentally the physics behind cELS by demonstrating a multi-moded straight waveguide as a partially coherent light source. For isotropic super-resolution, spatially incoherent light engineered via multiple-arms waveguide chip and intensity-fluctuation based algorithms are used. The proof-of-concept results are demonstrated on 100 nm polystyrene beads and resolution improvement of close to 2X is shown. cELS also realizes (2-10)X more contrast as opposed to conventional imaging techniques. In addition, cELS platform is miniaturized and enables large field-of-view imaging compared to state of the art label-free techniques. cELS holds a potential for label-free super-resolution imaging of nanosized biological specimens at high-throughput.
△ Less
Submitted 24 February, 2022; v1 submitted 24 August, 2021;
originally announced August 2021.
-
Demystifying speckle field quantitative phase microscopy
Authors:
Azeem Ahmad,
Nikhil Jayakumar,
Balpreet Singh Ahluwalia
Abstract:
Quantitative phase microscopy (QPM) has found significant applications in the field of biomedical imaging which works on the principle of interferometry. The theory behind achieving interference in QPM with conventional light sources such as white light and lasers is very well developed. Recently, the use of dynamic speckle illumination (DSI) in QPM has attracted attention due to its advantages ov…
▽ More
Quantitative phase microscopy (QPM) has found significant applications in the field of biomedical imaging which works on the principle of interferometry. The theory behind achieving interference in QPM with conventional light sources such as white light and lasers is very well developed. Recently, the use of dynamic speckle illumination (DSI) in QPM has attracted attention due to its advantages over conventional light sources such as high spatial phase sensitivity, single shot, scalable field of view (FOV) and resolution. However, the understanding behind obtaining interference fringes in QPM with DSI has not been convincingly covered previously. This imposes a constraint on obtaining interference fringes in QPM using DSI and limits its widespread penetration in the field of biomedical imaging. The present article provides the basic understanding of DSI through both simulation and experiments that is essential to build interference optical microscopy systems such as QPM, digital holographic microscopy and optical coherence tomography. Using the developed theory of DSI we demonstrate its capabilities of using non-identical objective lenses in both arms of the interference microscopy without degrading the interference fringe contrast and providing the flexibility to use user-defined microscope objective lens. It is also demonstrated that the interference fringes are not washed out over a large range of optical path difference (OPD) between the object and the reference arm providing competitive edge over low temporal coherence light sources. The theory and explanation developed here would enable wider penetration of DSI based QPM for applications in biology and material sciences.
△ Less
Submitted 22 July, 2021;
originally announced July 2021.
-
Roadmap on multimode light sha**
Authors:
Marco Piccardo,
Vincent Ginis,
Andrew Forbes,
Simon Mahler,
Asher A. Friesem,
Nir Davidson,
Haoran Ren,
Ahmed H. Dorrah,
Federico Capasso,
Firehun T. Dullo,
Balpreet S. Ahluwalia,
Antonio Ambrosio,
Sylvain Gigan,
Nicolas Treps,
Markus Hiekkamäki,
Robert Fickler,
Michael Kues,
David Moss,
Roberto Morandotti,
Johann Riemensberger,
Tobias J. Kippenberg,
Jérôme Faist,
Giacomo Scalari,
Nathalie Picqué,
Theodor W. Hänsch
, et al. (13 additional authors not shown)
Abstract:
Our ability to generate new distributions of light has been remarkably enhanced in recent years. At the most fundamental level, these light patterns are obtained by ingeniously combining different electromagnetic modes. Interestingly, the modal superposition occurs in the spatial, temporal as well as spatio-temporal domain. This generalized concept of structured light is being applied across the e…
▽ More
Our ability to generate new distributions of light has been remarkably enhanced in recent years. At the most fundamental level, these light patterns are obtained by ingeniously combining different electromagnetic modes. Interestingly, the modal superposition occurs in the spatial, temporal as well as spatio-temporal domain. This generalized concept of structured light is being applied across the entire spectrum of optics: generating classical and quantum states of light, harnessing linear and nonlinear light-matter interactions, and advancing applications in microscopy, spectroscopy, holography, communication, and synchronization. This Roadmap highlights the common roots of these different techniques and thus establishes links between research areas that complement each other seamlessly. We provide an overview of all these areas, their backgrounds, current research, and future developments. We highlight the power of multimodal light manipulation and want to inspire new eclectic approaches in this vibrant research community.
△ Less
Submitted 8 April, 2021;
originally announced April 2021.
-
Study of waveguide background at visible wavelengths for on-chip nanoscopy
Authors:
David A. Coucheron,
Øystien I. Helle,
James S. Wilkinson,
Ganapathy Senthil Murugan,
Carlos Domínguez,
Hallvar Angelskår,
Balpreet S. Ahluwalia
Abstract:
On-chip super-resolution optical microscopy is an emerging field relying on waveguide excitation with visible light. Here, we investigate two commonly used high-refractive index waveguide platforms, tantalum pentoxide (Ta$_2$O$_5$) and silicon nitride (Si$_3$N$_4$), with respect to their background with excitation in the range 488-640 nm. The background strength from these waveguides were estimate…
▽ More
On-chip super-resolution optical microscopy is an emerging field relying on waveguide excitation with visible light. Here, we investigate two commonly used high-refractive index waveguide platforms, tantalum pentoxide (Ta$_2$O$_5$) and silicon nitride (Si$_3$N$_4$), with respect to their background with excitation in the range 488-640 nm. The background strength from these waveguides were estimated by imaging fluorescent beads. The spectral dependence of the background from these waveguide platforms was also measured. For 640 nm wavelength excitation both the materials had a weak background, but the background increases progressively for shorter wavelengths for Si3N4. We further explored the effect of the waveguide background on localization precision of single molecule localization for direct stochastic optical reconstruction microscopy (dSTORM). An increase in background for Si$_3$N$_4$ at 488 nm is shown to reduce the localization precision and thus the resolution of the reconstructed images. The localization precision at 640 nm was very similar for both the materials. Thus, for shorter wavelength applications Ta$_2$O$_5$ is preferable. Reducing the background from Si$_3$N$_4$ at shorter wavelengths via improved fabrication will be worth pursuing.
△ Less
Submitted 25 January, 2021;
originally announced January 2021.
-
High throughput spatially sensitive single-shot quantitative phase microscopy
Authors:
Azeem Ahmad,
Vishesh Dubey,
Nikhil Jayakumar,
Anowarul Habib,
Ankit Butola,
Mona Nystad,
Ganesh Acharya,
Purusotam Basnet,
Dalip Singh Mehta,
Balpreet Singh Ahluwalia
Abstract:
High space-bandwidth product with high spatial phase sensitivity is indispensable for a single-shot quantitative phase microscopy (QPM) system. It opens avenue for widespread applications of QPM in the field of biomedical imaging. Temporally low coherence length light sources are generally implemented to achieve high spatial phase sensitivity in QPM at the cost of either reduced temporal resolutio…
▽ More
High space-bandwidth product with high spatial phase sensitivity is indispensable for a single-shot quantitative phase microscopy (QPM) system. It opens avenue for widespread applications of QPM in the field of biomedical imaging. Temporally low coherence length light sources are generally implemented to achieve high spatial phase sensitivity in QPM at the cost of either reduced temporal resolution or smaller field of view (FOV). On the contrary, high temporal coherence light sources like lasers are capable of exploiting the full FOV of the QPM systems at the expense of less spatial phase sensitivity. In the present work, we employed pseudo-thermal light source (PTLS) in QPM which overcomes the limitations of conventional light sources. The capabilities of PTLS over conventional light sources are systematically studied and demonstrated on various test objects like USAF resolution chart and thin optical waveguide (height ~ 8 nm). The spatial phase sensitivity of QPM in case of PTLS is measured to be equivalent to that for white light source. The high-speed and large FOV capabilities of PTLS based QPM is demonstrated by high-speed imaging of live sperm cells that is limited by the camera speed and by imaging extra-ordinary large FOV phase imaging on histopathology placenta tissue samples.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
Soft thresholding schemes for multiple signal classification algorithm
Authors:
Sebastian Acuña,
Ida S. Opstad,
Fred Godtliebsen,
Balpreet Singh Ahluwalia,
Krishna Agarwal
Abstract:
Multiple signal classification algorithm (MUSICAL) exploits temporal fluctuations in fluorescence intensity to perform super-resolution microscopy by computing the value of a super-resolving indicator function across a fine sample grid. A key step in the algorithm is the separation of the measurements into signal and noise subspaces, based on a single user-specified parameter called the threshold.…
▽ More
Multiple signal classification algorithm (MUSICAL) exploits temporal fluctuations in fluorescence intensity to perform super-resolution microscopy by computing the value of a super-resolving indicator function across a fine sample grid. A key step in the algorithm is the separation of the measurements into signal and noise subspaces, based on a single user-specified parameter called the threshold. The resulting image is strongly sensitive to this parameter and the subjectivity arising from multiple practical factors makes it difficult to determine the right rule of selection. We address this issue by proposing soft thresholding schemes derived from a new generalized framework for indicator function design. We show that the new schemes significantly alleviate the subjectivity and sensitivity of hard thresholding while retaining the super-resolution ability. We also evaluate the trade-off between resolution and contrast and the out-of-focus light rejection using the various indicator functions. Through this, we create significant new insights into the use and further optimization of MUSICAL for a wide range of practical scenarios.
△ Less
Submitted 2 September, 2020;
originally announced September 2020.
-
Simulation-supervised deep learning for analysing organelles states and behaviour in living cells
Authors:
Arif Ahmed Sekh,
Ida S. Opstad,
Rohit Agarwal,
Asa Birna Birgisdottir,
Truls Myrmel,
Balpreet Singh Ahluwalia,
Krishna Agarwal,
Dilip K. Prasad
Abstract:
In many real-world scientific problems, generating ground truth (GT) for supervised learning is almost impossible. The causes include limitations imposed by scientific instrument, physical phenomenon itself, or the complexity of modeling. Performing artificial intelligence (AI) tasks such as segmentation, tracking, and analytics of small sub-cellular structures such as mitochondria in microscopy v…
▽ More
In many real-world scientific problems, generating ground truth (GT) for supervised learning is almost impossible. The causes include limitations imposed by scientific instrument, physical phenomenon itself, or the complexity of modeling. Performing artificial intelligence (AI) tasks such as segmentation, tracking, and analytics of small sub-cellular structures such as mitochondria in microscopy videos of living cells is a prime example. The 3D blurring function of microscope, digital resolution from pixel size, optical resolution due to the character of light, noise characteristics, and complex 3D deformable shapes of mitochondria, all contribute to making this problem GT hard. Manual segmentation of 100s of mitochondria across 1000s of frames and then across many such videos is not only herculean but also physically inaccurate because of the instrument and phenomena imposed limitations. Unsupervised learning produces less than optimal results and accuracy is important if inferences relevant to therapy are to be derived. In order to solve this unsurmountable problem, we bring modeling and deep learning to a nexus. We show that accurate physics based modeling of microscopy data including all its limitations can be the solution for generating simulated training datasets for supervised learning. We show here that our simulation-supervised segmentation approach is a great enabler for studying mitochondrial states and behaviour in heart muscle cells, where mitochondria have a significant role to play in the health of the cells. We report unprecedented mean IoU score of 91% for binary segmentation (19% better than the best performing unsupervised approach) of mitochondria in actual microscopy videos of living cells. We further demonstrate the possibility of performing multi-class classification, tracking, and morphology associated analytics at the scale of individual mitochondrion.
△ Less
Submitted 26 August, 2020;
originally announced August 2020.
-
Fluorescence fluctuations-based super-resolution microscopy techniques: an experimental comparative study
Authors:
Ida S. Opstad,
Sebastian Acuña,
Luís Enrique Villegas Hernandez,
Jennifer Cauzzo,
Nataša Škalko-Basnet,
Balpreet S. Ahluwalia,
Krishna Agarwal
Abstract:
Fluorescence fluctuations-based super-resolution microscopy (FF-SRM) is an emerging field promising low-cost and live-cell compatible imaging beyond the resolution of conventional optical microscopy. A comprehensive overview on how the nature of fluctuations, label density, out-of-focus light, sub-cellular dynamics, and the sample itself influence the reconstruction in FF-SRM is crucial to design…
▽ More
Fluorescence fluctuations-based super-resolution microscopy (FF-SRM) is an emerging field promising low-cost and live-cell compatible imaging beyond the resolution of conventional optical microscopy. A comprehensive overview on how the nature of fluctuations, label density, out-of-focus light, sub-cellular dynamics, and the sample itself influence the reconstruction in FF-SRM is crucial to design appropriate biological experiments. We have experimentally compared several of the recently developed FF-SRM techniques (namely ESI, bSOFI, SRRF, SACD, MUSICAL and HAWK) on widefield fluorescence image sequences of a diverse set of samples (namely liposomes, tissues, fixed and living cells), and on three-dimensional simulated data where the ground truth is available. The simulated microscopy data showed that the different techniques have different requirements for signal fluctuation to achieve their optimal performance. While different levels of signal fluctuations had little effect on the SRRF, ESI and SACD images, image reconstructions from both bSOFI and MUSICAL displayed a substantial improvement in their noise rejection, z-sectioning, and overall super-resolution capabilities.
△ Less
Submitted 20 August, 2020;
originally announced August 2020.
-
On-chip TIRF nanoscopy by applying Haar wavelet kernel analysis on intensity fluctuations induced by chip illumination
Authors:
Nikhil Jayakumar,
Øystein I Helle,
Krishna Agarwal,
Balpreet Singh Ahluwalia
Abstract:
Photonic-chip based TIRF illumination has been used to demonstrate several on-chip optical nanoscopy methods. The sample is illuminated by the evanescent field generated by the electromagnetic wave modes guided inside the optical waveguide. In addition to the photokinetics of the fluorophores, the waveguide modes can be further exploited for introducing controlled intensity fluctuations for exploi…
▽ More
Photonic-chip based TIRF illumination has been used to demonstrate several on-chip optical nanoscopy methods. The sample is illuminated by the evanescent field generated by the electromagnetic wave modes guided inside the optical waveguide. In addition to the photokinetics of the fluorophores, the waveguide modes can be further exploited for introducing controlled intensity fluctuations for exploitation by techniques such as super-resolution optical fluctuation imaging (SOFI). However, the problem of non-uniform illumination pattern generated by the modes contribute to artifacts in the reconstructed image. To alleviate this problem, we propose to perform Haar wavelet kernel (HAWK) analysis on the original image stack prior to the application of (SOFI). HAWK produces a computational image stack with higher spatio-temporal sparsity than the original stack. In the case of multimoded non-uniform illumination patterns, HAWK processing bre aks the mode pattern while introducing spatio-temporal sparsity, thereby differentially affecting the non-uniformity of the illumination. Consequently, this assists nanoscopy methods such as SOFI to better support super-resolution, which is otherwise compromised due to spatial correlation of the mode patterns in the raw image. Furthermore, applying HAWK prior to SOFI alleviates the problem of artifacts due to non-uniform illumination without degrading temporal resolution. Our experimental results demonstrate resolution enhancement as well as reduction in artifacts through the combination of HAWK and SOFI.
△ Less
Submitted 25 July, 2020;
originally announced July 2020.
-
Multi-modal on-chip nanoscopy and quantitative phase image reveals the morphology of liver sinusoidal enodthelial cells
Authors:
David A. Coucheron,
Ankit Butola,
Karolina Szafranska,
Azeem Ahmad,
Jean-Claude Tinguely,
Peter McCourt,
Paramasivam Senthilkumaran,
Dalip Singh Mehta,
Balpreet Singh Ahluwalia
Abstract:
Visualization of three-dimensional morphological changes in the subcellular structures of a biological specimen is one of the greatest challenges in life science. Despite conspicuous refinements in optical nanoscopy, determination of quantitative changes in subcellular structure, i.e., size and thickness, remains elusive. We present an integrated chip-based optical nanoscopy set-up that provides a…
▽ More
Visualization of three-dimensional morphological changes in the subcellular structures of a biological specimen is one of the greatest challenges in life science. Despite conspicuous refinements in optical nanoscopy, determination of quantitative changes in subcellular structure, i.e., size and thickness, remains elusive. We present an integrated chip-based optical nanoscopy set-up that provides a lateral optical resolution of 61 nm combined with a highly sensitive quantitative phase microscopy (QPM) system with a spatial phase sensitivity of $\pm$20 mrad. We use the system to obtain the 3D morphology of liver sinusoidal endothelial cells (LSECs) combined with super-resolved spatial information. LSECs have a unique morphology with nanopores that are present in the plasma membrane, called fenestration. The fenestrations are grouped in clusters called sieve plates, which are around 100 nm thick. Thus, imaging and quantification of fenestration and sieve plate thickness requires resolution and sensitivity of sub-100 nm along both lateral and axial directions. In the chip-based nanoscope, the optical waveguides are used both for hosting and illuminating the sample. A strong evanescent field is generated on top of the waveguide surface for single molecule fluorescence excitation. The fluorescence signal is captured by an upright microscope, which is converted into a Linnik-type interferometer to sequentially acquire both super-resolved images and quantitative phase information of the sample. The multi-modal microscope provided an estimate of the fenestration diameter of 124$\pm$41 nm and revealed the average estimated thickness of the sieve plates in the range of 91.2$\pm$43.5 nm for two different cells. The combination of these techniques offers visualization of both the lateral size (using nanoscopy) and the thickness map of sieve plates, i.e. discrete clusters fenestrations in QPM mode.
△ Less
Submitted 22 July, 2020;
originally announced July 2020.
-
High space-bandwidth in quantitative phase imaging using partially spatially coherent optical coherence microscopy and deep neural network
Authors:
Ankit Butola,
Sheetal Raosaheb Kanade,
Sunil Bhatt,
Vishesh Kumar Dubey,
Anand Kumar,
Azeem Ahmad,
Dilip K Prasad,
Paramasivam Senthilkumaran,
Balpreet Singh Ahluwalia,
Dalip Singh Mehta
Abstract:
Quantitative phase microscopy (QPM) is a label-free technique that enables to monitor morphological changes at subcellular level. The performance of the QPM system in terms of spatial sensitivity and resolution depends on the coherence properties of the light source and the numerical aperture (NA) of objective lenses. Here, we propose high space-bandwidth QPM using partially spatially coherent opt…
▽ More
Quantitative phase microscopy (QPM) is a label-free technique that enables to monitor morphological changes at subcellular level. The performance of the QPM system in terms of spatial sensitivity and resolution depends on the coherence properties of the light source and the numerical aperture (NA) of objective lenses. Here, we propose high space-bandwidth QPM using partially spatially coherent optical coherence microscopy (PSC-OCM) assisted with deep neural network. The PSC source synthesized to improve the spatial sensitivity of the reconstructed phase map from the interferometric images. Further, compatible generative adversarial network (GAN) is used and trained with paired low-resolution (LR) and high-resolution (HR) datasets acquired from PSC-OCM system. The training of the network is performed on two different types of samples i.e. mostly homogenous human red blood cells (RBC) and on highly heterogenous macrophages. The performance is evaluated by predicting the HR images from the datasets captured with low NA lens and compared with the actual HR phase images. An improvement of 9 times in space-bandwidth product is demonstrated for both RBC and macrophages datasets. We believe that the PSC-OCM+GAN approach would be applicable in single-shot label free tissue imaging, disease classification and other high-resolution tomography applications by utilizing the longitudinal spatial coherence properties of the light source.
△ Less
Submitted 5 July, 2020;
originally announced July 2020.
-
A transparent waveguide chip for versatile TIRF-based microscopy and nanoscopy
Authors:
Anish Priyadarshi,
Firehun Tsige Dullo,
Deanna L. Wolfson,
Azeem Ahmad,
Nikhil Jayakumar,
Vishesh Dubey,
Jean-Claude Tinguely,
Balpreet Singh Ahluwalia,
Ganapathy Senthil Murugan
Abstract:
Total internal reflection fluorescence microscopy (TIRF) has enabled low-background, live-cell friendly imaging of cell surfaces and other thin samples thanks to the shallow penetration of the evanescent light field into the sample. The implementation of TIRF on optical waveguide chips (c-TIRF) has overcome historical limitations on the magnification and field of view (FOV) compared to lens-based…
▽ More
Total internal reflection fluorescence microscopy (TIRF) has enabled low-background, live-cell friendly imaging of cell surfaces and other thin samples thanks to the shallow penetration of the evanescent light field into the sample. The implementation of TIRF on optical waveguide chips (c-TIRF) has overcome historical limitations on the magnification and field of view (FOV) compared to lens-based TIRF, and further allows the light to be guided in complicated patterns that can be used for advanced imaging techniques or selective stimulation of the sample. However, the opacity of the chips themselves has thus far precluded their use on inverted microscopes and complicated sample preparation and handling. In this work, we introduce a new platform for c-TIRF imaging based on a transparent substrate, which is fully compatible with sample handling and imaging procedures commonly used with a standard #1.5 glass coverslip, and is fabricated using standard complementary metal-oxide-semiconductor (CMOS) techniques, which can easily be scaled up for mass production. We demonstrate its performance on synthetic and biological samples using both upright and inverted microscopes, and show how it can be extended to super-resolution applications, achieving a resolution of 116 nm using super resolution radial fluctuations (SRRF). These new chips retain the scalable FOV of opaque chip-based TIRF and the high axial resolution of TIRF, and have the versatility to be used with many different objective lenses, microscopy methods, and handling techniques. We thus see c-TIRF as a technology primed for widespread adoption, increasing both TIRF's accessibility to users and the range of applications that can benefit from it.
△ Less
Submitted 1 July, 2020; v1 submitted 11 June, 2020;
originally announced June 2020.
-
High spatially sensitive quantitative phase imaging assisted with deep neural network for classification of human spermatozoa under stressed condition
Authors:
Ankit Butola,
Daria Popova,
Dilip K Prasad,
Azeem Ahmad,
Anowarul Habib,
Jean Claude Tinguely,
Purusotam Basnet,
Ganesh Acharya,
Paramasivam Senthilkumaran,
Dalip Singh Mehta,
Balpreet Singh Ahluwalia
Abstract:
Sperm cell motility and morphology observed under the bright field microscopy are the only criteria for selecting particular sperm cell during Intracytoplasmic Sperm Injection (ICSI) procedure of Assisted Reproductive Technology (ART). Several factors such as, oxidative stress, cryopreservation, heat, smoking and alcohol consumption, are negatively associated with the quality of sperm cell and fer…
▽ More
Sperm cell motility and morphology observed under the bright field microscopy are the only criteria for selecting particular sperm cell during Intracytoplasmic Sperm Injection (ICSI) procedure of Assisted Reproductive Technology (ART). Several factors such as, oxidative stress, cryopreservation, heat, smoking and alcohol consumption, are negatively associated with the quality of sperm cell and fertilization potential due to the changing of sub-cellular structures and functions which are overlooked. A bright field imaging contrast is insufficient to distinguish tiniest morphological cell features that might influence the fertilizing ability of sperm cell. We developed a partially spatially coherent digital holographic microscope (PSC-DHM) for quantitative phase imaging (QPI) in order to distinguish normal sperm cells from sperm cells under different stress conditions such as cryopreservation, exposure to hydrogen peroxide and ethanol without any labeling. Phase maps of 10,163 sperm cells (2,400 control cells, 2,750 spermatozoa after cryopreservation, 2,515 and 2,498 cells under hydrogen peroxide and ethanol respectively) are reconstructed using the data acquired from PSC-DHM system. Total of seven feedforward deep neural networks (DNN) were employed for the classification of the phase maps for normal and stress affected sperm cells. When validated against the test dataset, the DNN provided an average sensitivity, specificity and accuracy of 84.88%, 95.03% and 85%, respectively. The current approach DNN and QPI techniques of quantitative information can be applied for further improving ICSI procedure and the diagnostic efficiency for the classification of semen quality in regards to their fertilization potential and other biomedical applications in general.
△ Less
Submitted 18 February, 2020;
originally announced February 2020.
-
Photonic-chip assisted correlative light and electron microscopy
Authors:
Jean-Claude Tinguely,
Anna Maria Steyer,
Cristina Ionica Øie,
Øystein Ivar Helle,
Firehun Tsige Dullo,
Randi Olsen,
Peter McCourt,
Yannick Schwab,
Balpreet Singh Ahluwalia
Abstract:
Correlative light-electron microscopy (CLEM) unifies the versatility of light microscopy (LM) with the high resolution of electron microscopy (EM), allowing one to zoom into the complex organization of cells. Most CLEM techniques use ultrathin sections, and thus lack the 3D-EM structural information, and focusing on a very restricted field of view. Here, we introduce photonic chip assisted CLEM, e…
▽ More
Correlative light-electron microscopy (CLEM) unifies the versatility of light microscopy (LM) with the high resolution of electron microscopy (EM), allowing one to zoom into the complex organization of cells. Most CLEM techniques use ultrathin sections, and thus lack the 3D-EM structural information, and focusing on a very restricted field of view. Here, we introduce photonic chip assisted CLEM, enabling multi-modal total internal reflection fluorescence (TIRF) microscopy over large field of view and high precision localization of the target area of interest within EM. The chip-based direct stochastic optical reconstruction microscopy (dSTORM), and 3D high precision correlation of biological processes by focused ion beam-scanning electron microscopy (FIB-SEM) is further demonstrated. The core layer of the photonic chips are used as a substrate to hold, to illuminate and the cladding layer is used to enable high-precision landmarking of the sample through specially designed grid-like numbering systems. The landmarks are fabricated on the cladding of the photonic chips as extruding pillars from the waveguide surface, thus remaining visible for FIB-SEM after resin embedding during sample processing. Using this approach we demonstrate its applicability for tracking the area of interest, imaging the 3D structural organization of nano-sized morphological features on liver sinusoidal endothelial cells such as fenestrations, and correlating specific endo-lysosomal compartments with its cargo protein upon endocytosis. We envisage that photonic chip equipped with landmarks can be used in the future to automatize the work-flow for both LM and EM for high-throughput CLEM, providing the resolution needed for insights into the complex intracellular communication and the relation between morphology and function in health and disease.
△ Less
Submitted 16 November, 2019;
originally announced November 2019.
-
A Super-Condenser for Labelfree Nanoscopy
Authors:
Florian Ströhl,
Ida S. Opstad,
Jean-Claude Tinguely,
Firehun T. Dullo,
Ioanna Mela,
Johannes W. M. Osterrieth,
Balpreet S. Ahluwalia,
Clemens F. Kaminski
Abstract:
Labelfree nanoscopy encompasses optical imaging with resolution in the 100 nm range using visible wavelengths. Here, we present a labelfree nanoscopy method that combines Fourier ptychography with waveguide microscopy to realize a 'super-condenser' featuring maximally inclined coherent darkfield illumination with artificially stretched wave vectors due to large refractive indices of the employed S…
▽ More
Labelfree nanoscopy encompasses optical imaging with resolution in the 100 nm range using visible wavelengths. Here, we present a labelfree nanoscopy method that combines Fourier ptychography with waveguide microscopy to realize a 'super-condenser' featuring maximally inclined coherent darkfield illumination with artificially stretched wave vectors due to large refractive indices of the employed Si$_3$N$_4$ waveguide material. We produce the required coherent plane wave illumination for Fourier ptychography over imaging areas 400 $\mathrmμ$m$^2$ in size via adiabatically tapered single-mode waveguides and tackle the overlap constraints of the Fourier ptychography phase retrieval algorithm two-fold: firstly, the directionality of the illumination wave vector is changed sequentially via a multiplexed input structure of the waveguide chip layout and secondly, the wave vector modulus is shortend via step-wise increases of the illumination light wavelength over the visible spectrum. We validate the method via in silico and in vitro experiments and provide details on the underlying image formation theory as well as the reconstruction algorithm.
△ Less
Submitted 7 May, 2019;
originally announced May 2019.
-
Structured illumination microscopy using a photonic chip
Authors:
Øystein I. Helle,
Firehun T. Dullo,
Marcel Lahrberg,
Jean-Claude Tinguely,
Balpreet S. Ahluwalia
Abstract:
Structured illumination microscopy (SIM) enables live cell, super-resolution imaging at high speeds. SIM uses sophisticated optical systems to generate pre-determined excitation light patterns, and reconstruction algorithms to enhance the resolution by up to a factor of two. The optical set-up of SIM relies on delicate free-space optics to generate the light patterns, and a high numerical aperture…
▽ More
Structured illumination microscopy (SIM) enables live cell, super-resolution imaging at high speeds. SIM uses sophisticated optical systems to generate pre-determined excitation light patterns, and reconstruction algorithms to enhance the resolution by up to a factor of two. The optical set-up of SIM relies on delicate free-space optics to generate the light patterns, and a high numerical aperture objective lens to project the pattern on the sample. These arrangements are prone to miss-alignment, often with high costs, and with the final resolution-enhancement being limited by the numerical aperture of the collection optics. Here, we present a photonic-chip based total internal reflection fluorescence (TIRF)-SIM that greatly reduces the complexity of the optical setup needed to acquire TIRF-SIM images. This is achieved by taking out the light delivery from the microscope and transferring it to a photonic-chip. The conventional glass slide is replaced by the planar photonic chip, that both holds and illuminates the specimen. The chip is used to create a standing wave interference pattern, which illuminates the sample via evanescent fields. The phase of the interference pattern is controlled by the use of thermo-optical modulation, leaving the footprint of the light illumination path for the SIM system to around 4 by 4 cm$^2$. Furthermore, we show that by the use of the photonic-chip technology, the resolution enhancement of SIM can be increased above that of the conventional approach. In addition, by the separation of excitation and collection light paths the technology opens the possibility to use low numerical objective lenses, without sacrificing on the SIM resolution. Chip-based SIM represents a simple, stable and affordable approach, which could enable widespread penetration of the technique and might also open avenues for high throughput optical super-resolution microscopy.
△ Less
Submitted 13 March, 2019;
originally announced March 2019.
-
Deep learning architecture LightOCT for diagnostic decision support using optical coherence tomography images of biological samples
Authors:
Ankit Butola,
Dilip K. Prasad,
Azeem Ahmad,
Vishesh Dubey,
Darakhshan Qaiser,
Anurag Srivastava,
Paramsivam Senthilkumaran,
Balpreet Singh Ahluwalia,
Dalip Singh Mehta
Abstract:
Optical coherence tomography (OCT) is being increasingly adopted as a label-free and non-invasive technique for biomedical applications such as cancer and ocular disease diagnosis. Diagnostic information for these tissues is manifest in textural and geometric features of the OCT images, which are used by human expertise to interpret and triage. However, it suffers delays due to the long process of…
▽ More
Optical coherence tomography (OCT) is being increasingly adopted as a label-free and non-invasive technique for biomedical applications such as cancer and ocular disease diagnosis. Diagnostic information for these tissues is manifest in textural and geometric features of the OCT images, which are used by human expertise to interpret and triage. However, it suffers delays due to the long process of the conventional diagnostic procedure and shortage of human expertise. Here, a custom deep learning architecture, LightOCT, is proposed for the classification of OCT images into diagnostically relevant classes. LightOCT is a convolutional neural network with only two convolutional layers and a fully connected layer, but it is shown to provide excellent training and test results for diverse OCT image datasets. We show that LightOCT provides 98.9% accuracy in classifying 44 normal and 44 malignant (invasive ductal carcinoma) breast tissue volumetric OCT images. Also, >96% accuracy in classifying public datasets of ocular OCT images as normal, age-related macular degeneration and diabetic macular edema. Additionally, we show ~96% test accuracy for classifying retinal images as belonging to choroidal neovascularization, diabetic macular edema, drusen, and normal samples on a large public dataset of more than 100,000 images. The performance of the architecture is compared with transfer learning based deep neural networks. Through this, we show that LightOCT can provide significant diagnostic support for a variety of OCT images with sufficient training and minimal hyper-parameter tuning. The trained LightOCT networks for the three-classification problem will be released online to support transfer learning on other datasets.
△ Less
Submitted 6 July, 2020; v1 submitted 6 December, 2018;
originally announced December 2018.
-
Highly stable common-path quantitative phase microscope for biomedical imaging
Authors:
Azeem Ahmad,
Vishesh Dubey,
Ankit Butola,
Balpreet Singh Ahluwalia,
Dalip Singh Mehta
Abstract:
High temporal stability is the primary requirement of any quantitative phase microscope (QPM) systems for the early stage detection of various human related diseases. The high temporal stability of the system provides accurate measurement of membrane fluctuations of the biological cells, which can be good indicator of various diseases. We developed a single element highly stable common-path QPM sy…
▽ More
High temporal stability is the primary requirement of any quantitative phase microscope (QPM) systems for the early stage detection of various human related diseases. The high temporal stability of the system provides accurate measurement of membrane fluctuations of the biological cells, which can be good indicator of various diseases. We developed a single element highly stable common-path QPM system to obtain temporally stable holograms of the biological specimens. With the proposed system, the temporal stability is obtained ~ 15 mrad without using any vibration isolation table. The capability of the proposed system is demonstrated on USAF resolution chart, polystyrene spheres (dia. 4.5 micron) and human red blood cells (RBCs). The membrane fluctuation of healthy human RBCs is further successfully measured and found to be equal to 63 nm. Contrary to its counterparts, present system offers energy efficient, cost effective and simple way of generating object and reference beam for the development of common-path QPM.
△ Less
Submitted 3 December, 2018;
originally announced December 2018.
-
Sub-nanometer height sensitivity by phase shifting interference microscopy under ambient environmental fluctuations
Authors:
Azeem Ahmad,
Vishesh Dubey,
Ankit Butola,
Jean-Claude Tinguely,
Balpreet Singh Ahluwalia,
Dalip Singh Mehta
Abstract:
Phase shifting interferometric (PSI) techniques are among the most sensitive phase measurement methods. Owing to its high sensitivity, any minute phase change caused due to environmental instability results into, inaccurate phase measurement. Consequently, a well calibrated piezo electric transducer (PZT) and highly-stable environment is mandatory for measuring accurate phase map using PSI impleme…
▽ More
Phase shifting interferometric (PSI) techniques are among the most sensitive phase measurement methods. Owing to its high sensitivity, any minute phase change caused due to environmental instability results into, inaccurate phase measurement. Consequently, a well calibrated piezo electric transducer (PZT) and highly-stable environment is mandatory for measuring accurate phase map using PSI implementation. Here, we present a new method of recording temporal phase shifted interferograms and a numerical algorithm, which can retrieve phase maps of the samples with negligible errors under the ambient environmental fluctuations. The method is implemented by recording a video of continuous temporally phase shifted interferograms and phase shifts were calculated between all the data frames using newly developed algorithm with a high accuracy less than or equal to 5.5*10-4*pi rad. To demonstrate the robustness of the proposed method, a manual translation of the stage was employed to introduce continuous temporal phase shift between data frames. The developed algorithm is first verified by performing quantitative phase imaging of optical waveguide and red blood cells using uncalibrated PZT under the influence of vibrations/air turbulence and compared with the well calibrated PZT results. Furthermore, we demonstrated the potential of the proposed approach by acquiring the quantitative phase imaging of an optical waveguide with a rib height of only 2 nm. By using 12-bit CMOS camera the height of shallow rib waveguide is measured with a height sensitivity of 4 Angstrom without using PZT and in presence of environmental fluctuations.
△ Less
Submitted 2 December, 2018;
originally announced December 2018.
-
Chip-based Resonance Raman Spectroscopy Using Tantalum Pentoxide Waveguides
Authors:
David A. Coucheron,
Dushan N. Wadduwage,
G. Senthil Murugan,
Peter T. C. So,
Balpreet S. Ahluwalia
Abstract:
Blood analysis is an important diagnostic tool, as it provides a wealth of information about the patient health. Raman spectroscopy is a promising tool in blood analysis, but widespread clinical application is limited by its low signal strength, as well as complex and costly instrumentation. The growing field of waveguide-based Raman spectroscopy tries to solve these challenges by working towards…
▽ More
Blood analysis is an important diagnostic tool, as it provides a wealth of information about the patient health. Raman spectroscopy is a promising tool in blood analysis, but widespread clinical application is limited by its low signal strength, as well as complex and costly instrumentation. The growing field of waveguide-based Raman spectroscopy tries to solve these challenges by working towards fully integrated Raman sensors with increased interaction areas. In this work, we demonstrate on-chip resonance Raman measurements of hemoglobin, a crucial component of blood, at 532 nm excitation using a tantalum pentoxide (Ta2O5) waveguide platform. We have also characterized the background signal from Ta2O5 waveguide material when excited at 532 nm. In addition, we demonstrate spontaneous Raman measurements of iso-propanol and methanol using the same platform. Our results suggest that Ta2O5 is a promising waveguide platform for resonance Raman spectroscopy at 532 nm, and in particular for blood analysis.
△ Less
Submitted 11 November, 2018;
originally announced November 2018.
-
Characterization of color cross-talk of CCD detectors and its influence in multispectral quantitative phase imaging
Authors:
Azeem Ahmad,
Anand Kumar,
Vishesh Dubey,
Ankit Butola,
Balpreet Singh Ahluwalia,
Dalip Singh Mehta
Abstract:
Multi-spectral quantitative phase imaging (QPI) is an emerging imaging modality for wavelength dependent studies of several biological and industrial specimens. Simultaneous multi-spectral QPI is generally performed with color CCD cameras. However, color CCD cameras are suffered from the color crosstalk issue, which needed to be explored. Here, we present a new approach for accurately measuring th…
▽ More
Multi-spectral quantitative phase imaging (QPI) is an emerging imaging modality for wavelength dependent studies of several biological and industrial specimens. Simultaneous multi-spectral QPI is generally performed with color CCD cameras. However, color CCD cameras are suffered from the color crosstalk issue, which needed to be explored. Here, we present a new approach for accurately measuring the color crosstalk of 2D area detectors, without needing prior information about camera specifications. Color crosstalk of two different cameras commonly used in QPI, single chip CCD (1-CCD) and three chip CCD (3-CCD), is systematically studied and compared using compact interference microscopy. The influence of color crosstalk on the fringe width and the visibility of the monochromatic constituents corresponding to three color channels of white light interferogram are studied both through simulations and experiments. It is observed that presence of color crosstalk changes the fringe width and visibility over the imaging field of view. This leads to an unwanted non-uniform background error in the multi-spectral phase imaging of the specimens. It is demonstrated that the color crosstalk of the detector is the key limiting factor for phase measurement accuracy of simultaneous multi-spectral QPI systems.
△ Less
Submitted 5 October, 2018;
originally announced October 2018.
-
Study of longitudinal coherence properties of pseudo thermal light source as a function of source size and temporal coherence
Authors:
Azeem Ahmad,
Tanmoy Mahanty,
Vishesh Dubey,
Ankit Butola,
Balpreet Singh Ahluwalia,
Dalip Singh Mehta
Abstract:
In conventional OCT, broadband light sources are generally utilized to obtain high axial resolution due to their low temporal coherence (TC) length. Purely monochromatic (i.e., high TC length) light sources like laser cannot be implemented to acquire high resolution optically sectioned images of the specimen. Contrary to this, pseudo thermal light source having high TC and low spatial coherence (S…
▽ More
In conventional OCT, broadband light sources are generally utilized to obtain high axial resolution due to their low temporal coherence (TC) length. Purely monochromatic (i.e., high TC length) light sources like laser cannot be implemented to acquire high resolution optically sectioned images of the specimen. Contrary to this, pseudo thermal light source having high TC and low spatial coherence (SC) property can be employed to achieve high axial resolution comparable to broadband light source. In the present letter, a pseudo thermal light source is synthesized by passing a purely monochromatic laser beam through a rotating diffuser. The longitudinal coherence (LC) property of the pseudo thermal light source is studied as a function of source size and TC length. The LC length of the synthesized light source decreased as the source size increased. It is found that LC length of such light source becomes independent of the parent laser TC length for source size of greater than or equal to 3.3 mm and become almost constant at around 30 micron for both the lasers. Thus any monochromatic laser light source can be utilized to obtain high axial resolution in OCT system irrespective of its TC length. The maximum achievable axial resolution is found to be equal to 650 nm corresponding to 1.2 numerical aperture (NA) objective lens at 632 nm wavelength. The findings elucidate that pseudo thermal source being monochromatic in nature can improve the performance of existing OCT systems significantly.
△ Less
Submitted 3 October, 2018;
originally announced October 2018.