Boosting 3D Neuron Segmentation with 2D Vision Transformer Pre-trained on Natural Images
Authors:
Yik San Cheng,
Runkai Zhao,
Heng Wang,
Hanchuan Peng,
Weidong Cai
Abstract:
Neuron reconstruction, one of the fundamental tasks in neuroscience, rebuilds neuronal morphology from 3D light microscope imaging data. It plays a critical role in analyzing the structure-function relationship of neurons in the nervous system. However, due to the scarcity of neuron datasets and high-quality SWC annotations, it is still challenging to develop robust segmentation methods for single…
▽ More
Neuron reconstruction, one of the fundamental tasks in neuroscience, rebuilds neuronal morphology from 3D light microscope imaging data. It plays a critical role in analyzing the structure-function relationship of neurons in the nervous system. However, due to the scarcity of neuron datasets and high-quality SWC annotations, it is still challenging to develop robust segmentation methods for single neuron reconstruction. To address this limitation, we aim to distill the consensus knowledge from massive natural image data to aid the segmentation model in learning the complex neuron structures. Specifically, in this work, we propose a novel training paradigm that leverages a 2D Vision Transformer model pre-trained on large-scale natural images to initialize our Transformer-based 3D neuron segmentation model with a tailored 2D-to-3D weight transferring strategy. Our method builds a knowledge sharing connection between the abundant natural and the scarce neuron image domains to improve the 3D neuron segmentation ability in a data-efficiency manner. Evaluated on a popular benchmark, BigNeuron, our method enhances neuron segmentation performance by 8.71% over the model trained from scratch with the same amount of training samples.
△ Less
Submitted 4 May, 2024;
originally announced May 2024.
Continuous Ultraviolet to Blue-Green Astrocomb
Authors:
Yuk Shan Cheng,
Kamalesh Dadi,
Toby Mitchell,
Samantha Thompson,
Nikolai Piskunov,
Lewis D. Wright,
Corin B. E. Gawith,
Richard A. McCracken,
Derryck T. Reid
Abstract:
The characterization of Earth-like exoplanets and precision tests of cosmological models using next-generation telescopes such as the ELT will demand precise calibration of astrophysical spectrographs in the visible region, where stellar absorption lines are most abundant. Astrocombs--lasers providing a broadband sequence of ultra-narrow, drift-free, regularly spaced optical frequencies on a multi…
▽ More
The characterization of Earth-like exoplanets and precision tests of cosmological models using next-generation telescopes such as the ELT will demand precise calibration of astrophysical spectrographs in the visible region, where stellar absorption lines are most abundant. Astrocombs--lasers providing a broadband sequence of ultra-narrow, drift-free, regularly spaced optical frequencies on a multi-GHz grid--promise an atomically-traceable, versatile calibration scale, but their realization is challenging because of the need for ultra-broadband frequency conversion of mode-locked infrared lasers into the blue-green region. Here, we introduce a new concept achieving a broad, continuous spectrum by combining second-harmonic generation and sum-frequency-mixing in an aperiodically-poled MgO:PPLN waveguide to generate gap-free 390-520 nm light from a 1 GHz Ti:sapphire laser frequency comb. We lock a low-dispersion Fabry-Perot etalon to extract a sub-comb of bandwidth from 392-472 nm with a spacing of 30 GHz, visualizing the thousands of resulting comb modes on a high resolution cross-dispersion spectrograph. Complementary experimental data and simulations demonstrate the effectiveness of the approach for eliminating the spectral gaps present in second-harmonic-only conversion, in which weaker fundamental frequencies are suppressed by the quadratic \{chi}^((2)) nonlinearity. Requiring only ~100 pJ pulse energies, our concept establishes a practical new route to broadband UV-visible generation at GHz repetition rates.
△ Less
Submitted 23 June, 2023;
originally announced June 2023.
