Real-time Neuron Segmentation for Voltage Imaging
Authors:
Yosuke Bando,
Ramdas Pillai,
Atsushi Kajita,
Farhan Abdul Hakeem,
Yves Quemener,
Hua-an Tseng,
Kiryl D. Piatkevich,
Changyang Linghu,
Xue Han,
Edward S. Boyden
Abstract:
In voltage imaging, where the membrane potentials of individual neurons are recorded at from hundreds to thousand frames per second using fluorescence microscopy, data processing presents a challenge. Even a fraction of a minute of recording with a limited image size yields gigabytes of video data consisting of tens of thousands of frames, which can be time-consuming to process. Moreover, millisec…
▽ More
In voltage imaging, where the membrane potentials of individual neurons are recorded at from hundreds to thousand frames per second using fluorescence microscopy, data processing presents a challenge. Even a fraction of a minute of recording with a limited image size yields gigabytes of video data consisting of tens of thousands of frames, which can be time-consuming to process. Moreover, millisecond-level short exposures lead to noisy video frames, obscuring neuron footprints especially in deep-brain samples where noisy signals are buried in background fluorescence. To address this challenge, we propose a fast neuron segmentation method able to detect multiple, potentially overlap**, spiking neurons from noisy video frames, and implement a data processing pipeline incorporating the proposed segmentation method along with GPU-accelerated motion correction. By testing on existing datasets as well as on new datasets we introduce, we show that our pipeline extracts neuron footprints that agree well with human annotation even from cluttered datasets, and demonstrate real-time processing of voltage imaging data on a single desktop computer for the first time.
△ Less
Submitted 25 March, 2024;
originally announced March 2024.
Quantized deep learning models on low-power edge devices for robotic systems
Authors:
Anugraha Sinha,
Naveen Kumar,
Murukesh Mohanan,
MD Muhaimin Rahman,
Yves Quemener,
Amina Mim,
Suzana Ilić
Abstract:
In this work, we present a quantized deep neural network deployed on a low-power edge device, inferring learned motor-movements of a suspended robot in a defined space. This serves as the fundamental building block for the original setup, a robotic system for farms or greenhouses aimed at a wide range of agricultural tasks. Deep learning on edge devices and its implications could have a substantia…
▽ More
In this work, we present a quantized deep neural network deployed on a low-power edge device, inferring learned motor-movements of a suspended robot in a defined space. This serves as the fundamental building block for the original setup, a robotic system for farms or greenhouses aimed at a wide range of agricultural tasks. Deep learning on edge devices and its implications could have a substantial impact on farming systems in the develo** world, leading not only to sustainable food production and income, but also increased data privacy and autonomy.
△ Less
Submitted 30 November, 2019;
originally announced December 2019.
