-
Deep Temporal Sequence Classification and Mathematical Modeling for Cell Tracking in Dense 3D Microscopy Videos of Bacterial Biofilms
Authors:
Tan** Taher Toma,
Yibo Wang,
Andreas Gahlmann,
Scott T. Acton
Abstract:
Automatic cell tracking in dense environments is plagued by inaccurate correspondences and misidentification of parent-offspring relationships. In this paper, we introduce a novel cell tracking algorithm named DenseTrack, which integrates deep learning with mathematical model-based strategies to effectively establish correspondences between consecutive frames and detect cell division events in cro…
▽ More
Automatic cell tracking in dense environments is plagued by inaccurate correspondences and misidentification of parent-offspring relationships. In this paper, we introduce a novel cell tracking algorithm named DenseTrack, which integrates deep learning with mathematical model-based strategies to effectively establish correspondences between consecutive frames and detect cell division events in crowded scenarios. We formulate the cell tracking problem as a deep learning-based temporal sequence classification task followed by solving a constrained one-to-one matching optimization problem exploiting the classifier's confidence scores. Additionally, we present an eigendecomposition-based cell division detection strategy that leverages knowledge of cellular geometry. The performance of the proposed approach has been evaluated by tracking densely packed cells in 3D time-lapse image sequences of bacterial biofilm development. The experimental results on simulated as well as experimental fluorescence image sequences suggest that the proposed tracking method achieves superior performance in terms of both qualitative and quantitative evaluation measures compared to recent state-of-the-art cell tracking approaches.
△ Less
Submitted 27 June, 2024;
originally announced June 2024.
-
SDDPM: Speckle Denoising Diffusion Probabilistic Models
Authors:
Soumee Guha,
Scott T. Acton
Abstract:
Coherent imaging systems, such as medical ultrasound and synthetic aperture radar (SAR), are subject to corruption from speckle due to sub-resolution scatterers. Since speckle is multiplicative in nature, the constituent image regions become corrupted to different extents. The task of denoising such images requires algorithms specifically designed for removing signal-dependent noise. This paper pr…
▽ More
Coherent imaging systems, such as medical ultrasound and synthetic aperture radar (SAR), are subject to corruption from speckle due to sub-resolution scatterers. Since speckle is multiplicative in nature, the constituent image regions become corrupted to different extents. The task of denoising such images requires algorithms specifically designed for removing signal-dependent noise. This paper proposes a novel image denoising algorithm for removing signal-dependent multiplicative noise with diffusion models, called Speckle Denoising Diffusion Probabilistic Models (SDDPM). We derive the mathematical formulations for the forward process, the reverse process, and the training objective. In the forward process, we apply multiplicative noise to a given image and prove that the forward process is Gaussian. We show that the reverse process is also Gaussian and the final training objective can be expressed as the Kullback Leibler (KL) divergence between the forward and reverse processes. As derived in the paper, the final denoising task is a single step process, thereby reducing the denoising time significantly. We have trained our model with natural land-use images and ultrasound images for different noise levels. Extensive experiments centered around two different applications show that SDDPM is robust and performs significantly better than the comparative models even when the images are severely corrupted.
△ Less
Submitted 17 November, 2023;
originally announced November 2023.
-
GlidarCo: gait recognition by 3D skeleton estimation and biometric feature correction of flash lidar data
Authors:
Nasrin Sadeghzadehyazdi,
Tamal Batabyal,
Nibir K. Dhar,
B. O. Familoni,
K. M. Iftekharuddin,
Scott T. Acton
Abstract:
Gait recognition using noninvasively acquired data has been attracting an increasing interest in the last decade. Among various modalities of data sources, it is experimentally found that the data involving skeletal representation are amenable for reliable feature compaction and fast processing. Model-based gait recognition methods that exploit features from a fitted model, like skeleton, are reco…
▽ More
Gait recognition using noninvasively acquired data has been attracting an increasing interest in the last decade. Among various modalities of data sources, it is experimentally found that the data involving skeletal representation are amenable for reliable feature compaction and fast processing. Model-based gait recognition methods that exploit features from a fitted model, like skeleton, are recognized for their view and scale-invariant properties. We propose a model-based gait recognition method, using sequences recorded by a single flash lidar. Existing state-of-the-art model-based approaches that exploit features from high quality skeletal data collected by Kinect and Mocap are limited to controlled laboratory environments. The performance of conventional research efforts is negatively affected by poor data quality. We address the problem of gait recognition under challenging scenarios, such as lower quality and noisy imaging process of lidar, that degrades the performance of state-of-the-art skeleton-based systems. We present GlidarCo to attain high accuracy on gait recognition under the described conditions. A filtering mechanism corrects faulty skeleton joint measurements, and robust statistics are integrated to conventional feature moments to encode the dynamic of the motion. As a comparison, length-based and vector-based features extracted from the noisy skeletons are investigated for outlier removal. Experimental results illustrate the efficacy of the proposed methodology in improving gait recognition given noisy low resolution lidar data.
△ Less
Submitted 20 May, 2019; v1 submitted 16 May, 2019;
originally announced May 2019.
-
Glidar3DJ: A View-Invariant gait identification via flash lidar data correction
Authors:
Nasrin Sadeghzadehyazdi,
Tamal Batabyal,
A. Glandon,
Nibir K. Dhar,
B. O. Familoni,
K. M. Iftekharuddin,
Scott T. Acton
Abstract:
Gait recognition is a leading remote-based identification method, suitable for real-world surveillance and medical applications. Model-based gait recognition methods have been particularly recognized due to their scale and view-invariant properties. We present the first model-based gait recognition methodology, $\mathcal{G}$lidar3DJ using a skeleton model extracted from sequences generated by a si…
▽ More
Gait recognition is a leading remote-based identification method, suitable for real-world surveillance and medical applications. Model-based gait recognition methods have been particularly recognized due to their scale and view-invariant properties. We present the first model-based gait recognition methodology, $\mathcal{G}$lidar3DJ using a skeleton model extracted from sequences generated by a single flash lidar camera. Existing successful model-based approaches take advantage of high quality skeleton data collected by Kinect and Mocap, for example, are not practicable for applications outside the laboratory. The low resolution and noisy imaging process of lidar negatively affects the performance of state-of-the-art skeleton-based systems, generating a significant number of outlier skeletons. We propose a rule-based filtering mechanism that adopts robust statistics to correct for skeleton joint measurements. Quantitative measurements validate the efficacy of the proposed method in improving gait recognition.
△ Less
Submitted 16 May, 2019; v1 submitted 2 May, 2019;
originally announced May 2019.
-
Hieroglyph: Hierarchical Glia Graph Skeletonization and Matching
Authors:
Tiffany T. Ly,
Tamal Batabyal,
Jeremy Thompson,
Tajie Harris,
Daniel S. Weller,
Scott T. Acton
Abstract:
Automatic 3D reconstruction of glia morphology is a powerful tool necessary for investigating the role of microglia in neurological disorders in the central nervous system. Current glia skeleton reconstruction techniques fail to capture an accurate tracing of the processes over time, useful for the study of the microglia motility and morphology in the brain during healthy and diseased states. We p…
▽ More
Automatic 3D reconstruction of glia morphology is a powerful tool necessary for investigating the role of microglia in neurological disorders in the central nervous system. Current glia skeleton reconstruction techniques fail to capture an accurate tracing of the processes over time, useful for the study of the microglia motility and morphology in the brain during healthy and diseased states. We propose Hieroglyph, a fully automatic temporal 3D skeleton reconstruction algorithm for glia imaged via 3D multiphoton microscopy. Hieroglyph yielded a 21% performance increase compared to state of the art automatic skeleton reconstruction methods and outperforms the state of the art in different measures of consistency on datasets of 3D images of microglia. The results from this method provide a 3D graph and digital reconstruction of glia useful for a myriad of morphological analyses that could impact studies in brain immunology and disease.
△ Less
Submitted 26 March, 2019;
originally announced March 2019.
-
Segmentation of Cortical Spreading Depression Wavefronts Through Local Similarity Metric
Authors:
M. Filip Sluzewski,
Petr Tvrdik,
Scott T. Acton
Abstract:
In this paper, we present a novel region-based segmentation method for cortical spreading depressions in 2-photon microscopy images. Fluorescent microscopy has become an important tool in neuroscience, but segmentation approaches are challenged by the opaque properties and structures of brain tissue. These challenges are made more extreme when segmenting events such as cortical spreading depressio…
▽ More
In this paper, we present a novel region-based segmentation method for cortical spreading depressions in 2-photon microscopy images. Fluorescent microscopy has become an important tool in neuroscience, but segmentation approaches are challenged by the opaque properties and structures of brain tissue. These challenges are made more extreme when segmenting events such as cortical spreading depressions, where low signal-to-noise ratios and intensity inhomogeneity dominate images. The method we propose uses a local intensity similarity measure that takes advantage of normalized Euclidean and geodesic distance maps of the image. This method provides a smooth segmentation boundary which is robust to the noise and inhomogeneity within cortical spreading depression images. Experimental results yielded a DICE index of 0.9859, an increase of 6% over the current state-of-the-art, and a reduction of root mean square error by 79.9%.
△ Less
Submitted 1 February, 2019;
originally announced February 2019.
-
LCuts: Linear Clustering of Bacteria using Recursive Graph Cuts
Authors:
Jie Wang,
Tamal Batabyal,
Mingxing Zhang,
Ji Zhang,
Arslan Aziz,
Andreas Gahlmann,
Scott T. Acton
Abstract:
Bacterial biofilm segmentation poses significant challenges due to lack of apparent structure, poor imaging resolution, limited contrast between conterminous cells and high density of cells that overlap. Although there exist bacterial segmentation algorithms in the existing art, they fail to delineate cells in dense biofilms, especially in 3D imaging scenarios in which the cells are growing and su…
▽ More
Bacterial biofilm segmentation poses significant challenges due to lack of apparent structure, poor imaging resolution, limited contrast between conterminous cells and high density of cells that overlap. Although there exist bacterial segmentation algorithms in the existing art, they fail to delineate cells in dense biofilms, especially in 3D imaging scenarios in which the cells are growing and subdividing in a complex manner. A graph-based data clustering method, LCuts, is presented with the application on bacterial cell segmentation. By constructing a weighted graph with node features in locations and principal orientations, the proposed method can automatically classify and detect differently oriented aggregations of linear structures (represent by bacteria in the application). The method assists in the assessment of several facets, such as bacterium tracking, cluster growth, and map** of migration patterns of bacterial biofilms. Quantitative and qualitative measures for 2D data demonstrate the superiority of proposed method over the state of the art. Preliminary 3D results exhibit reliable classification of the cells with 97% accuracy.
△ Less
Submitted 6 May, 2019; v1 submitted 31 January, 2019;
originally announced February 2019.
-
PrecoG: an efficient unitary split preconditioner for the transform-domain LMS filter via graph Laplacian regularization
Authors:
Tamal Batabyal,
Daniel S. Weller,
Jaideep Kapur,
Scott T. Acton
Abstract:
Transform-domain least mean squares (LMS) adaptive filters encompass the class of algorithms where the input data are subjected to a data-independent unitary transform followed by a power normalization stage as preprocessing steps. Because conventional transformations are not data-dependent, this preconditioning procedure was shown theoretically to improve the convergence of the LMS filter only fo…
▽ More
Transform-domain least mean squares (LMS) adaptive filters encompass the class of algorithms where the input data are subjected to a data-independent unitary transform followed by a power normalization stage as preprocessing steps. Because conventional transformations are not data-dependent, this preconditioning procedure was shown theoretically to improve the convergence of the LMS filter only for certain classes of input data. However, in reality if the class of input data is not known beforehand, it is difficult to decide which transformation to use. Thus, there is a need to devise a learning framework to obtain such a preconditioning transformation using input data prior to applying on the input data. It is hypothesized that the underlying topology of the data affects the selection of the transformation. With the input modeled as a weighted graph that mimics neuronal interactions, PrecoG obtains the desired transform by recursive estimation of the graph Laplacian matrix. Additionally, we show the efficacy of the transform as a generalized split preconditioner on a linear system of equations and in Hebb-LMS settings. In terms of the improvement of the condition number after applying the transformation, PrecoG performs significantly better than the existing state-of-the-art techniques that involve unitary and non-unitary transforms.
△ Less
Submitted 25 December, 2020; v1 submitted 11 December, 2018;
originally announced December 2018.
-
SITUP: Scale Invariant Tracking using Average Peak-to-Correlation Energy
Authors:
Haoyi Ma,
Scott T. Acton,
Zongli Lin
Abstract:
Robust and accurate scale estimation of a target object is a challenging task in visual object tracking. Most existing tracking methods cannot accommodate large scale variation in complex image sequences and thus result in inferior performance. In this paper, we propose to incorporate a novel criterion called the average peak-to-correlation energy into the multiresolution translation filter framew…
▽ More
Robust and accurate scale estimation of a target object is a challenging task in visual object tracking. Most existing tracking methods cannot accommodate large scale variation in complex image sequences and thus result in inferior performance. In this paper, we propose to incorporate a novel criterion called the average peak-to-correlation energy into the multiresolution translation filter framework to obtain robust and accurate scale estimation. The resulting system is named SITUP: Scale Invariant Tracking using Average Peak-to-Correlation Energy. SITUP effectively tackles the problem of fixed template size in standard discriminative correlation filter based trackers. Extensive empirical evaluation on the publicly available tracking benchmark datasets demonstrates that the proposed scale searching framework meets the demands of scale variation challenges effectively while providing superior performance over other scale adaptive variants of standard discriminative correlation filter based trackers. Also, SITUP obtains favorable performance compared to state-of-the-art trackers for various scenarios while operating in real-time on a single CPU.
△ Less
Submitted 7 December, 2018;
originally announced December 2018.
-
ElasticPath2Path: Automated morphological classification of neurons by elastic path matching
Authors:
Tamal Batabyal,
Scott T. Acton
Abstract:
In the study of neurons, morphology influences function. The complexity in the structure of neurons poses a challenge in the identification and analysis of similar and dissimilar neuronal cells. Existing methodologies carry out structural and geometrical simplifications, which substantially change the morphological statistics. Using digitally-reconstructed neurons, we extend the work of Path2Path…
▽ More
In the study of neurons, morphology influences function. The complexity in the structure of neurons poses a challenge in the identification and analysis of similar and dissimilar neuronal cells. Existing methodologies carry out structural and geometrical simplifications, which substantially change the morphological statistics. Using digitally-reconstructed neurons, we extend the work of Path2Path as ElasticPath2Path, which seamlessly integrates the graph-theoretic and differential-geometric frameworks. By decomposing a neuron into a set of paths, we derive graph metrics, which are path concurrence and path hierarchy. Next, we model each path as an elastic string to compute the geodesic distance between the paths of a pair of neurons. Later, we formulate the problem of finding the distance between two neurons as a path assignment problem with a cost function combining the graph metrics and the geodesic deformation of paths. ElasticPath2Path is shown to have superior performance over the state of the art.
△ Less
Submitted 19 February, 2018;
originally announced February 2018.
-
OSLO: Automatic Cell Counting and Segmentation for Oligodendrocyte Progenitor Cells
Authors:
Haoyi Ma,
Rebecca Beiter,
Alban Gaultier,
Scott T. Acton,
Zongli Lin
Abstract:
Reliable cell counting and segmentation of oligodendrocyte progenitor cells (OPCs) are critical image analysis steps that could potentially unlock mysteries regarding OPC function during pathology. We propose a saliency-based method to detect OPCs and use a marker-controlled watershed algorithm to segment the OPCs. This method first implements frequency-tuned saliency detection on separate channel…
▽ More
Reliable cell counting and segmentation of oligodendrocyte progenitor cells (OPCs) are critical image analysis steps that could potentially unlock mysteries regarding OPC function during pathology. We propose a saliency-based method to detect OPCs and use a marker-controlled watershed algorithm to segment the OPCs. This method first implements frequency-tuned saliency detection on separate channels to obtain regions of cell candidates. Final detection results and internal markers can be computed by combining information from separate saliency maps. An optimal saliency level for OPCs (OSLO) is highlighted in this work. Here, watershed segmentation is performed efficiently with effective internal markers. Experiments show that our method outperforms existing methods in terms of accuracy.
△ Less
Submitted 5 June, 2018; v1 submitted 14 February, 2018;
originally announced February 2018.
-
Nonlinear Shape Regression For Filtering Segmentation Results From Calcium Imaging
Authors:
Jie Wang,
Zhongxiao Fu,
Nasrin Sadeghzadehyazdi,
Jonathan Kipnis,
Scott T. Acton
Abstract:
A shape filter is presented to repair segmentation results obtained in calcium imaging of neurons in vivo. This post-segmentation algorithm can automatically smooth the shapes obtained from a preliminary segmentation, while precluding the cases where two neurons are counted as one combined component. The shape filter is realized using a square-root velocity to project the shapes on a shape manifol…
▽ More
A shape filter is presented to repair segmentation results obtained in calcium imaging of neurons in vivo. This post-segmentation algorithm can automatically smooth the shapes obtained from a preliminary segmentation, while precluding the cases where two neurons are counted as one combined component. The shape filter is realized using a square-root velocity to project the shapes on a shape manifold in which distances between shapes are based on elastic changes. Two data-driven weighting methods are proposed to achieve a trade-off between shape smoothness and consistency with the data. Intuitive comparisons of proposed methods via projection onto Cartesian maps demonstrate the smoothing ability of the shape filter. Quantitative measures also prove the superiority of our methods over models that do not employ any weighting criterion.
△ Less
Submitted 1 June, 2018; v1 submitted 14 February, 2018;
originally announced February 2018.
-
The Coupled TuFF-BFF Algorithm for Automatic 3D Segmentation of Microglia
Authors:
Tiffany Ly,
Jeremy Thompson,
Tajie Harris,
Scott T. Acton
Abstract:
We propose an automatic 3D segmentation algorithm for multiphoton microscopy images of microglia. Our method is capable of segmenting tubular and blob-like structures from noisy images. Current segmentation techniques and software fail to capture the fine processes and soma of the microglia cells, useful for the study of the microglia role in the brain during healthy and diseased states. Our coupl…
▽ More
We propose an automatic 3D segmentation algorithm for multiphoton microscopy images of microglia. Our method is capable of segmenting tubular and blob-like structures from noisy images. Current segmentation techniques and software fail to capture the fine processes and soma of the microglia cells, useful for the study of the microglia role in the brain during healthy and diseased states. Our coupled tubularity flow field (TuFF)-blob flow field (BFF) method evolves a level set toward the object boundary using the directional tubularity and blobness measure of 3D images. Our method found a 20% performance increase against state of the art segmentation methods on a dataset of 3D images of microglia even in images with intensity heterogeneity throughout the object. The coupled TuFF-BFF segmentation results also yielded 40% improvement in accuracy for the ramification index of the processes, which displays the efficacy of our method.
△ Less
Submitted 12 February, 2018;
originally announced February 2018.
