Artificial confocal microscopy for deep label-free imaging
Authors:
Xi Chen,
Mikhail E. Kandel,
Shenghua He,
Chenfei Hu,
Young Jae Lee,
Kathryn Sullivan,
Gregory Tracy,
Hee Jung Chung,
Hyun Joon Kong,
Mark Anastasio,
Gabriel Popescu
Abstract:
Widefield microscopy methods applied to optically thick specimens are faced with reduced contrast due to spatial crosstalk, in which the signal at each point is the result of a superposition from neighboring points that are simultaneously illuminated. In 1955, Marvin Minsky proposed confocal microscopy as a solution to this problem. Today, laser scanning confocal fluorescence microscopy is broadly…
▽ More
Widefield microscopy methods applied to optically thick specimens are faced with reduced contrast due to spatial crosstalk, in which the signal at each point is the result of a superposition from neighboring points that are simultaneously illuminated. In 1955, Marvin Minsky proposed confocal microscopy as a solution to this problem. Today, laser scanning confocal fluorescence microscopy is broadly used due to its high depth resolution and sensitivity, which come at the price of photobleaching, chemical, and photo-toxicity. Here, we present artificial confocal microscopy (ACM) to achieve confocal-level depth sectioning, sensitivity, and chemical specificity, on unlabeled specimens, nondestructively. We augmented a laser scanning confocal instrument with a quantitative phase imaging module, which provides optical pathlength maps of the specimen on the same field of view as the fluorescence channel. Using pairs of phase and fluorescence images, we trained a convolution neural network to translate the former into the latter. The training to infer a new tag is very practical as the input and ground truth data are intrinsically registered and the data acquisition is automated. Remarkably, the ACM images present significantly stronger depth sectioning than the input images, enabling us to recover confocal-like tomographic volumes of microspheres, hippocampal neurons in culture, and 3D liver cancer spheroids. By training on nucleus-specific tags, ACM allows for segmenting individual nuclei within dense spheroids for both cell counting and volume measurements. Furthermore, taking the estimated fluorescence volumes, as annotation for the phase data, we extracted dry mass information for individual nuclei. Finally, our results indicate that the network learning can be transferred between spheroids suspended in different media.
△ Less
Submitted 27 October, 2021;
originally announced October 2021.
Multiscale assay of unlabeled neurite dynamics using phase imaging with computational specificity (PICS)
Authors:
Mikhail E. Kandel,
Eunjae Kim,
Young Jae Lee,
Gregory Tracy,
Hee Jung Chung,
Gabriel Popescu
Abstract:
Primary neuronal cultures have been widely used to study neuronal morphology, neurophysiology, neurodegenerative processes, and molecular mechanism of synaptic plasticity underlying learning and memory. Yet, the unique behavioral properties of neurons make them challenging to study - with phenotypic differences expressed as subtle changes in neuronal arborization rather than easy to assay features…
▽ More
Primary neuronal cultures have been widely used to study neuronal morphology, neurophysiology, neurodegenerative processes, and molecular mechanism of synaptic plasticity underlying learning and memory. Yet, the unique behavioral properties of neurons make them challenging to study - with phenotypic differences expressed as subtle changes in neuronal arborization rather than easy to assay features such as cell count. The need to analyze morphology, growth, and intracellular transport has motivated the development of increasingly sophisticated microscopes and image analysis techniques. Due to its high-contrast, high-specificity output, many assays rely on confocal fluorescence microscopy, genetic methods, or antibody staining techniques. These approaches often limit the ability to measure quantitatively dynamic activity such as intracellular transport and growth. In this work, we describe a method for label-free live-cell cell imaging with antibody staining specificity by estimating the associated fluorescent signals via quantitative phase imaging and deep convolutional neural networks. This computationally inferred fluorescence image is then used to generate a semantic segmentation map, annotating subcellular compartments of live unlabeled neural cultures. These synthetic fluorescence maps were further applied to study the time-lapse development of hippocampal neurons, highlighting the relationships between the cellular dry mass production and the dynamic transport activity within the nucleus and neurites. Our implementation provides a high-throughput strategy to analyze neural network arborization dynamically, with high specificity and without the typical phototoxicity and photobleaching limitations associated with fluorescent markers.
△ Less
Submitted 2 August, 2020;
originally announced August 2020.
