-
Computational interference microscopy enabled by deep learning
Authors:
Yuheng Jiao,
Yuchen R. He,
Mikhail E. Kandel,
Xiaojun Liu,
Wenlong Lu,
Gabriel Popescu
Abstract:
Quantitative phase imaging (QPI) has been widely applied in characterizing cells and tissues. Spatial light interference microscopy (SLIM) is a highly sensitive QPI method, due to its partially coherent illumination and common path interferometry geometry. However, its acquisition rate is limited because of the four-frame phase-shifting scheme. On the other hand, off-axis methods like diffraction…
▽ More
Quantitative phase imaging (QPI) has been widely applied in characterizing cells and tissues. Spatial light interference microscopy (SLIM) is a highly sensitive QPI method, due to its partially coherent illumination and common path interferometry geometry. However, its acquisition rate is limited because of the four-frame phase-shifting scheme. On the other hand, off-axis methods like diffraction phase microscopy (DPM), allows for single-shot QPI. However, the laser-based DPM system is plagued by spatial noise due to speckles and multiple reflections. In a parallel development, deep learning was proven valuable in the field of bioimaging, especially due to its ability to translate one form of contrast into another. Here, we propose using deep learning to produce synthetic, SLIM-quality, high-sensitivity phase maps from DPM, single-shot images as input. We used an inverted microscope with its two ports connected to the DPM and SLIM modules, such that we have access to the two types of images on the same field of view. We constructed a deep learning model based on U-net and trained on over 1,000 pairs of DPM and SLIM images. The model learned to remove the speckles in laser DPM and overcame the background phase noise in both the test set and new data. Furthermore, we implemented the neural network inference into the live acquisition software, which now allows a DPM user to observe in real-time an extremely low-noise phase image. We demonstrated this principle of computational interference microscopy (CIM) imaging using blood smears, as they contain both erythrocytes and leukocytes, in static and dynamic conditions.
△ Less
Submitted 17 December, 2020;
originally announced December 2020.
-
Quantifying myelin in brain tissue using color spatial light interference microscopy (cSLIM)
Authors:
Michael Fanous,
Megan P. Caputo,
Young Jae Lee,
Laurie A. Rund,
Catherine Best-Popescu,
Mikhail E. Kandel,
Rodney W. Johnson,
Tapas Das,
Matthew J. Kuchan,
Gabriel Popescu
Abstract:
Deficient myelination of the brain is associated with neurodevelopmental delays, particularly in high-risk infants, such as those born small in relation to their gestational age (SGA). New methods are needed to further study this condition. Here, we employ Color Spatial Light Interference Microscopy (cSLIM), which uses a brightfield objective and RGB camera to generate pathlength-maps with nanosca…
▽ More
Deficient myelination of the brain is associated with neurodevelopmental delays, particularly in high-risk infants, such as those born small in relation to their gestational age (SGA). New methods are needed to further study this condition. Here, we employ Color Spatial Light Interference Microscopy (cSLIM), which uses a brightfield objective and RGB camera to generate pathlength-maps with nanoscale sensitivity in conjunction with a regular brightfield image. Using tissue sections stained with Luxol Fast Blue, the myelin structures were segmented from a brightfield image. Using a binary mask, those portions were quantitatively analyzed in the corresponding phase maps. We first used the CLARITY method to remove tissue lipids and validate the sensitivity of cSLIM to lipid content. We then applied cSLIM to brain histology slices. These specimens are from a previous MRI study, which demonstrated that appropriate for gestational age (AGA) piglets have increased internal capsule myelination (ICM) compared to small for gestational age (SGA) piglets and that a hydrolyzed fat diet improved ICM in both. The identity of samples was blinded until after statistical analyses.
△ Less
Submitted 2 March, 2020;
originally announced March 2020.
-
Label-free colorectal cancer screening using deep learning and spatial light interference microscopy (SLIM)
Authors:
**gfang "Kelly" Zhang,
Yuchen R. He,
Nahil Sobh,
Gabriel Popescu
Abstract:
Current pathology workflow involves staining of thin tissue slices, which otherwise would be transparent, followed by manual investigation under the microscope by a trained pathologist. While the hematoxylin and eosin (H&E) stain is well-established and a cost-effective method for visualizing histology slides, its color variability across preparations and subjectivity across clinicians remain unad…
▽ More
Current pathology workflow involves staining of thin tissue slices, which otherwise would be transparent, followed by manual investigation under the microscope by a trained pathologist. While the hematoxylin and eosin (H&E) stain is well-established and a cost-effective method for visualizing histology slides, its color variability across preparations and subjectivity across clinicians remain unaddressed challenges. To mitigate these challenges, recently we have demonstrated that spatial light interference microscopy (SLIM) can provide a path to intrinsic, objective markers, that are independent of preparation and human bias. Additionally, the sensitivity of SLIM to collagen fibers yields information relevant to patient outcome, which is not available in H&E. Here, we show that deep learning and SLIM can form a powerful combination for screening applications: training on 1,660 SLIM images of colon glands and validating on 144 glands, we obtained a benign vs. cancer classification accuracy of 99%. We envision that the SLIM whole slide scanner presented here paired with artificial intelligence algorithms may prove valuable as a pre-screening method, economizing the clinician's time and effort.
△ Less
Submitted 28 February, 2020;
originally announced March 2020.
-
Quantitative Histopathology of Stained Tissues using Color Spatial Light Interference Microscopy (cSLIM)
Authors:
Hassaan Majeed,
Adib Keikhosravi,
Mikhail E. Kandel,
Tan H. Nguyen,
Yuming Liu,
Andre Kajdacsy-Balla,
Krishnarao Tangella,
Kevin W. Eliceiri,
Gabriel Popescu
Abstract:
Tissue biopsy evaluation in the clinic is in need of quantitative disease markers for diagnosis and, most importantly, prognosis. Among the new technologies, quantitative phase imaging (QPI) has demonstrated promise for histopathology because it reveals intrinsic tissue nanoarchitecture through the refractive index. However, a vast majority of past QPI investigations have relied on imaging unstain…
▽ More
Tissue biopsy evaluation in the clinic is in need of quantitative disease markers for diagnosis and, most importantly, prognosis. Among the new technologies, quantitative phase imaging (QPI) has demonstrated promise for histopathology because it reveals intrinsic tissue nanoarchitecture through the refractive index. However, a vast majority of past QPI investigations have relied on imaging unstained tissues, which disrupts the established specimen processing. Here we present color spatial light interference microscopy (cSLIM) as a new whole slide imaging modality that performs interferometric imaging with a color detector array. As a result, cSLIM yields in a single scan both the intrinsic tissue phase map and the standard color bright-field image, familiar to the pathologist. Our results on 196 breast cancer patients indicate that cSLIM can provide not only diagnostic but also prognostic information from the alignment of collagen fibers in the tumor microenvironment. The effects of staining on the tissue phase maps were corrected by a simple mathematical normalization. These characteristics are likely to reduce barriers to clinical translation for the new cSLIM technology.
△ Less
Submitted 10 June, 2018;
originally announced June 2018.
-
Optical excitation and detection of neuronal activity
Authors:
Chenfei Hu,
Richard Sam,
Mingguang Shan,
Viorel Nastasa,
Minqi Wang,
Taewoo Kim,
Martha Gillette,
Parijat Sengupta,
Gabriel Popescu
Abstract:
Optogenetics has emerged as an exciting tool for manipulating neural activity, which in turn, can modulate behavior in live organisms. However, detecting the response to the optical stimulation requires electrophysiology with physical contact or fluorescent imaging at target locations, which is often limited by photobleaching and phototoxicity. In this paper, we show that phase imaging can report…
▽ More
Optogenetics has emerged as an exciting tool for manipulating neural activity, which in turn, can modulate behavior in live organisms. However, detecting the response to the optical stimulation requires electrophysiology with physical contact or fluorescent imaging at target locations, which is often limited by photobleaching and phototoxicity. In this paper, we show that phase imaging can report the intracellular transport induced by optogenetic stimulation. We developed a multimodal instrument that can both stimulate cells with high spatial resolution and detect optical pathlength changes with nanometer scale sensitivity. We found that optical pathlength fluctuations following stimulation are consistent with active organelle transport. Furthermore, the results indicate a broadening in the transport velocity distribution, which is significantly higher in stimulated cells compared to optogenetically inactive cells. It is likely that this label-free, contactless measurement of optogenetic response will provide an enabling approach to neuroscience.
△ Less
Submitted 26 July, 2018; v1 submitted 27 October, 2017;
originally announced November 2017.
-
Label-free quantitative screening of breast tissue using Spatial Light Interference Microscopy (SLIM)
Authors:
Hassaan Majeed,
Tan Huu Nguyen,
Mikhail Eugene Kandel,
Andre Kajdacsy-Balla,
Gabriel Popescu
Abstract:
Breast cancer is the most common type of cancer among women worldwide. The standard histopathology of breast tissue, the primary means of disease diagnosis, involves manual microscopic examination of stained tissue by a pathologist. Because this method relies on qualitative information, it can result in inter-observer variation. Furthermore, for difficult cases the pathologist often needs addition…
▽ More
Breast cancer is the most common type of cancer among women worldwide. The standard histopathology of breast tissue, the primary means of disease diagnosis, involves manual microscopic examination of stained tissue by a pathologist. Because this method relies on qualitative information, it can result in inter-observer variation. Furthermore, for difficult cases the pathologist often needs additional markers of malignancy to help in making a diagnosis. We present a quantitative method for label-free tissue screening using Spatial Light Interference Microscopy (SLIM). By extracting tissue markers of malignancy based on the nanostructure revealed by the optical path-length, our method provides an objective and potentially automatable method for rapidly flagging suspicious tissue. We demonstrated our method by imaging a tissue microarray comprising 68 different subjects - 34 with malignant and 34 with benign tissues. Three-fold cross validation results showed a sensitivity of 94% and specificity of 85% for detecting cancer. The quantitative biomarkers we extract provide a repeatable and objective basis for determining malignancy. Thus, these disease signatures can be automatically classified through machine learning packages, since our images do not vary from scan to scan or instrument to instrument, i.e., they represent intrinsic physical attributes of the sample, independent of staining quality.
△ Less
Submitted 5 November, 2017;
originally announced November 2017.
