-
Guided Proofreading of Automatic Segmentations for Connectomics
Authors:
Daniel Haehn,
Verena Kaynig,
James Tompkin,
Jeff W. Lichtman,
Hanspeter Pfister
Abstract:
Automatic cell image segmentation methods in connectomics produce merge and split errors, which require correction through proofreading. Previous research has identified the visual search for these errors as the bottleneck in interactive proofreading. To aid error correction, we develop two classifiers that automatically recommend candidate merges and splits to the user. These classifiers use a co…
▽ More
Automatic cell image segmentation methods in connectomics produce merge and split errors, which require correction through proofreading. Previous research has identified the visual search for these errors as the bottleneck in interactive proofreading. To aid error correction, we develop two classifiers that automatically recommend candidate merges and splits to the user. These classifiers use a convolutional neural network (CNN) that has been trained with errors in automatic segmentations against expert-labeled ground truth. Our classifiers detect potentially-erroneous regions by considering a large context region around a segmentation boundary. Corrections can then be performed by a user with yes/no decisions, which reduces variation of information 7.5x faster than previous proofreading methods. We also present a fully-automatic mode that uses a probability threshold to make merge/split decisions. Extensive experiments using the automatic approach and comparing performance of novice and expert users demonstrate that our method performs favorably against state-of-the-art proofreading methods on different connectomics datasets.
△ Less
Submitted 3 April, 2017;
originally announced April 2017.
-
RhoanaNet Pipeline: Dense Automatic Neural Annotation
Authors:
Seymour Knowles-Barley,
Verena Kaynig,
Thouis Ray Jones,
Alyssa Wilson,
Joshua Morgan,
Dongil Lee,
Daniel Berger,
Narayanan Kasthuri,
Jeff W. Lichtman,
Hanspeter Pfister
Abstract:
Reconstructing a synaptic wiring diagram, or connectome, from electron microscopy (EM) images of brain tissue currently requires many hours of manual annotation or proofreading (Kasthuri and Lichtman, 2010; Lichtman and Sanes, 2008; Seung, 2009). The desire to reconstruct ever larger and more complex networks has pushed the collection of ever larger EM datasets. A cubic millimeter of raw imaging d…
▽ More
Reconstructing a synaptic wiring diagram, or connectome, from electron microscopy (EM) images of brain tissue currently requires many hours of manual annotation or proofreading (Kasthuri and Lichtman, 2010; Lichtman and Sanes, 2008; Seung, 2009). The desire to reconstruct ever larger and more complex networks has pushed the collection of ever larger EM datasets. A cubic millimeter of raw imaging data would take up 1 PB of storage and present an annotation project that would be impractical without relying heavily on automatic segmentation methods. The RhoanaNet image processing pipeline was developed to automatically segment large volumes of EM data and ease the burden of manual proofreading and annotation. Based on (Kaynig et al., 2015), we updated every stage of the software pipeline to provide better throughput performance and higher quality segmentation results. We used state of the art deep learning techniques to generate improved membrane probability maps, and Gala (Nunez-Iglesias et al., 2014) was used to agglomerate 2D segments into 3D objects.
We applied the RhoanaNet pipeline to four densely annotated EM datasets, two from mouse cortex, one from cerebellum and one from mouse lateral geniculate nucleus (LGN). All training and test data is made available for benchmark comparisons. The best segmentation results obtained gave $V^\text{Info}_\text{F-score}$ scores of 0.9054 and 09182 for the cortex datasets, 0.9438 for LGN, and 0.9150 for Cerebellum.
The RhoanaNet pipeline is open source software. All source code, training data, test data, and annotations for all four benchmark datasets are available at www.rhoana.org.
△ Less
Submitted 21 November, 2016;
originally announced November 2016.
-
Icon: An Interactive Approach to Train Deep Neural Networks for Segmentation of Neuronal Structures
Authors:
Felix Gonda,
Verena Kaynig,
Ray Thouis,
Daniel Haehn,
Jeff Lichtman,
Toufiq Parag,
Hanspeter Pfister
Abstract:
We present an interactive approach to train a deep neural network pixel classifier for the segmentation of neuronal structures. An interactive training scheme reduces the extremely tedious manual annotation task that is typically required for deep networks to perform well on image segmentation problems. Our proposed method employs a feedback loop that captures sparse annotations using a graphical…
▽ More
We present an interactive approach to train a deep neural network pixel classifier for the segmentation of neuronal structures. An interactive training scheme reduces the extremely tedious manual annotation task that is typically required for deep networks to perform well on image segmentation problems. Our proposed method employs a feedback loop that captures sparse annotations using a graphical user interface, trains a deep neural network based on recent and past annotations, and displays the prediction output to users in almost real-time. Our implementation of the algorithm also allows multiple users to provide annotations in parallel and receive feedback from the same classifier. Quick feedback on classifier performance in an interactive setting enables users to identify and label examples that are more important than others for segmentation purposes. Our experiments show that an interactively-trained pixel classifier produces better region segmentation results on Electron Microscopy (EM) images than those generated by a network of the same architecture trained offline on exhaustive ground-truth labels.
△ Less
Submitted 27 October, 2016;
originally announced October 2016.
-
Large-Scale Automatic Reconstruction of Neuronal Processes from Electron Microscopy Images
Authors:
Verena Kaynig,
Amelio Vazquez-Reina,
Seymour Knowles-Barley,
Mike Roberts,
Thouis R. Jones,
Narayanan Kasthuri,
Eric Miller,
Jeff Lichtman,
Hanspeter Pfister
Abstract:
Automated sample preparation and electron microscopy enables acquisition of very large image data sets. These technical advances are of special importance to the field of neuroanatomy, as 3D reconstructions of neuronal processes at the nm scale can provide new insight into the fine grained structure of the brain. Segmentation of large-scale electron microscopy data is the main bottleneck in the an…
▽ More
Automated sample preparation and electron microscopy enables acquisition of very large image data sets. These technical advances are of special importance to the field of neuroanatomy, as 3D reconstructions of neuronal processes at the nm scale can provide new insight into the fine grained structure of the brain. Segmentation of large-scale electron microscopy data is the main bottleneck in the analysis of these data sets. In this paper we present a pipeline that provides state-of-the art reconstruction performance while scaling to data sets in the GB-TB range. First, we train a random forest classifier on interactive sparse user annotations. The classifier output is combined with an anisotropic smoothing prior in a Conditional Random Field framework to generate multiple segmentation hypotheses per image. These segmentations are then combined into geometrically consistent 3D objects by segmentation fusion. We provide qualitative and quantitative evaluation of the automatic segmentation and demonstrate large-scale 3D reconstructions of neuronal processes from a $\mathbf{27,000}$ $\mathbf{μm^3}$ volume of brain tissue over a cube of $\mathbf{30 \; μm}$ in each dimension corresponding to 1000 consecutive image sections. We also introduce Mojo, a proofreading tool including semi-automated correction of merge errors based on sparse user scribbles.
△ Less
Submitted 28 March, 2013;
originally announced March 2013.
-
Visualization in Connectomics
Authors:
Hanspeter Pfister,
Verena Kaynig,
Charl P. Botha,
Stefan Bruckner,
Vincent J. Dercksen,
Hans-Christian Hege,
Jos B. T. M. Roerdink
Abstract:
Connectomics is a field of neuroscience that analyzes neuronal connections. A connectome is a complete map of a neuronal system, comprising all neuronal connections between its structures. The term "connectome" is close to the word "genome" and implies completeness of all neuronal connections, in the same way as a genome is a complete listing of all nucleotide sequences. The goal of connectomics i…
▽ More
Connectomics is a field of neuroscience that analyzes neuronal connections. A connectome is a complete map of a neuronal system, comprising all neuronal connections between its structures. The term "connectome" is close to the word "genome" and implies completeness of all neuronal connections, in the same way as a genome is a complete listing of all nucleotide sequences. The goal of connectomics is to create a complete representation of the brain's wiring. Such a representation is believed to increase our understanding of how functional brain states emerge from their underlying anatomical structure. Furthermore, it can provide important information for the cure of neuronal dysfunctions like schizophrenia or autism. In this paper, we review the current state-of-the-art of visualization and image processing techniques in the field of connectomics and describe some remaining challenges.
△ Less
Submitted 7 August, 2012; v1 submitted 7 June, 2012;
originally announced June 2012.
