Showing 1–21 of 21 results for author: Amunts, K

Analyzing Regional Organization of the Human Hippocampus in 3D-PLI Using Contrastive Learning and Geometric Unfolding

Authors: Alexander Oberstrass, Jordan DeKraker, Nicola Palomero-Gallagher, Sascha E. A. Muenzing, Alan C. Evans, Markus Axer, Katrin Amunts, Timo Dickscheid

Abstract: Understanding the cortical organization of the human brain requires interpretable descriptors for distinct structural and functional imaging data. 3D polarized light imaging (3D-PLI) is an imaging modality for visualizing fiber architecture in postmortem brains with high resolution that also captures the presence of cell bodies, for example, to identify hippocampal subfields. The rich texture in 3… ▽ More Understanding the cortical organization of the human brain requires interpretable descriptors for distinct structural and functional imaging data. 3D polarized light imaging (3D-PLI) is an imaging modality for visualizing fiber architecture in postmortem brains with high resolution that also captures the presence of cell bodies, for example, to identify hippocampal subfields. The rich texture in 3D-PLI images, however, makes this modality particularly difficult to analyze and best practices for characterizing architectonic patterns still need to be established. In this work, we demonstrate a novel method to analyze the regional organization of the human hippocampus in 3D-PLI by combining recent advances in unfolding methods with deep texture features obtained using a self-supervised contrastive learning approach. We identify clusters in the representations that correspond well with classical descriptions of hippocampal subfields, lending validity to the developed methodology. △ Less

Submitted 27 February, 2024; originally announced February 2024.

Comments: Accepted to ISBI 2024

Self-Supervised Representation Learning for Nerve Fiber Distribution Patterns in 3D-PLI

Authors: Alexander Oberstrass, Sascha E. A. Muenzing, Meiqi Niu, Nicola Palomero-Gallagher, Christian Schiffer, Markus Axer, Katrin Amunts, Timo Dickscheid

Abstract: A comprehensive understanding of the organizational principles in the human brain requires, among other factors, well-quantifiable descriptors of nerve fiber architecture. Three-dimensional polarized light imaging (3D-PLI) is a microscopic imaging technique that enables insights into the fine-grained organization of myelinated nerve fibers with high resolution. Descriptors characterizing the fiber… ▽ More A comprehensive understanding of the organizational principles in the human brain requires, among other factors, well-quantifiable descriptors of nerve fiber architecture. Three-dimensional polarized light imaging (3D-PLI) is a microscopic imaging technique that enables insights into the fine-grained organization of myelinated nerve fibers with high resolution. Descriptors characterizing the fiber architecture observed in 3D-PLI would enable downstream analysis tasks such as multimodal correlation studies, clustering, and map**. However, best practices for observer-independent characterization of fiber architecture in 3D-PLI are not yet available. To this end, we propose the application of a fully data-driven approach to characterize nerve fiber architecture in 3D-PLI images using self-supervised representation learning. We introduce a 3D-Context Contrastive Learning (CL-3D) objective that utilizes the spatial neighborhood of texture examples across histological brain sections of a 3D reconstructed volume to sample positive pairs for contrastive learning. We combine this sampling strategy with specifically designed image augmentations to gain robustness to typical variations in 3D-PLI parameter maps. The approach is demonstrated for the 3D reconstructed occipital lobe of a vervet monkey brain. We show that extracted features are highly sensitive to different configurations of nerve fibers, yet robust to variations between consecutive brain sections arising from histological processing. We demonstrate their practical applicability for retrieving clusters of homogeneous fiber architecture and performing data mining for interactively selected templates of specific components of fiber architecture such as U-fibers. △ Less

Submitted 30 January, 2024; originally announced January 2024.

Denoising Diffusion Probabilistic Models for Image Inpainting of Cell Distributions in the Human Brain

Authors: Jan-Oliver Kropp, Christian Schiffer, Katrin Amunts, Timo Dickscheid

Abstract: Recent advances in imaging and high-performance computing have made it possible to image the entire human brain at the cellular level. This is the basis to study the multi-scale architecture of the brain regarding its subdivision into brain areas and nuclei, cortical layers, columns, and cell clusters down to single cell morphology Methods for brain map** and cell segmentation exploit such image… ▽ More Recent advances in imaging and high-performance computing have made it possible to image the entire human brain at the cellular level. This is the basis to study the multi-scale architecture of the brain regarding its subdivision into brain areas and nuclei, cortical layers, columns, and cell clusters down to single cell morphology Methods for brain map** and cell segmentation exploit such images to enable rapid and automated analysis of cytoarchitecture and cell distribution in complete series of histological sections. However, the presence of inevitable processing artifacts in the image data caused by missing sections, tears in the tissue, or staining variations remains the primary reason for gaps in the resulting image data. To this end we aim to provide a model that can fill in missing information in a reliable way, following the true cell distribution at different scales. Inspired by the recent success in image generation, we propose a denoising diffusion probabilistic model (DDPM), trained on light-microscopic scans of cell-body stained sections. We extend this model with the RePaint method to impute missing or replace corrupted image data. We show that our trained DDPM is able to generate highly realistic image information for this purpose, generating plausible cell statistics and cytoarchitectonic patterns. We validate its outputs using two established downstream task models trained on the same data. △ Less

Submitted 28 November, 2023; originally announced November 2023.

Comments: Submitted to ISBI-2024

GORDA: Graph-based ORientation Distribution Analysis of SLI scatterometry Patterns of Nerve Fibres

Authors: Esteban Vaca, Miriam Menzel, Katrin Amunts, Markus Axer, Timo Dickscheid

Abstract: Scattered Light Imaging (SLI) is a novel approach for microscopically revealing the fibre architecture of unstained brain sections. The measurements are obtained by illuminating brain sections from different angles and measuring the transmitted (scattered) light under normal incidence. The evaluation of scattering profiles commonly relies on a peak picking technique and feature extraction from the… ▽ More Scattered Light Imaging (SLI) is a novel approach for microscopically revealing the fibre architecture of unstained brain sections. The measurements are obtained by illuminating brain sections from different angles and measuring the transmitted (scattered) light under normal incidence. The evaluation of scattering profiles commonly relies on a peak picking technique and feature extraction from the peaks, which allows quantitative determination of parallel and crossing in-plane nerve fibre directions for each image pixel. However, the estimation of the 3D orientation of the fibres cannot be assessed with the traditional methodology. We propose an unsupervised learning approach using spherical convolutions for estimating the 3D orientation of neural fibres, resulting in a more detailed interpretation of the fibre orientation distributions in the brain. △ Less

Submitted 12 April, 2022; originally announced April 2022.

Comments: 5 pages, 3 figures, 1 table

Automated computation of nerve fibre inclinations from 3D polarised light imaging measurements of brain tissue

Authors: Miriam Menzel, Jan A. Reuter, David Gräßel, Irene Costantini, Katrin Amunts, Markus Axer

Abstract: The method 3D polarised light imaging (3D-PLI) measures the birefringence of histological brain sections to determine the spatial course of nerve fibres (myelinated axons). While the in-plane fibre directions can be determined with high accuracy, the computation of the out-of-plane fibre inclinations is more challenging because they are derived from the strength of the birefringence signals (retar… ▽ More The method 3D polarised light imaging (3D-PLI) measures the birefringence of histological brain sections to determine the spatial course of nerve fibres (myelinated axons). While the in-plane fibre directions can be determined with high accuracy, the computation of the out-of-plane fibre inclinations is more challenging because they are derived from the strength of the birefringence signals (retardation), which depends e.g. on the amount of nerve fibres. One possibility to improve the accuracy is to consider the average transmitted light intensity (transmittance weighting). The current procedure requires effortful manual adjustment of parameters and anatomical knowledge. Here, we introduce an automated, optimised computation of the fibre inclinations, allowing for a much faster, reproducible determination of fibre orientations in 3D-PLI. Depending on the degree of myelination, the algorithm uses different models (transmittance-weighted, unweighted, or a linear combination), allowing to go beyond traditional definitions of white and grey matter and account for regionally specific behaviour. As the algorithm is parallelised and GPU optimised, and uses images from standard 3D-PLI (retardation and transmittance), it can be applied to large data sets, also from previous measurements. The functionality is demonstrated on unstained coronal and sagittal histological sections of vervet monkey and rat brains. △ Less

Submitted 1 March, 2022; v1 submitted 26 November, 2021; originally announced November 2021.

Comments: 15 pages, 7 figures

Journal ref: Scientific Reports (2022) 12:4328

Scatterometry Measurements with Scattered Light Imaging Enable New Insights into the Nerve Fiber Architecture of the Brain

Authors: Miriam Menzel, Marouan Ritzkowski, Jan André Reuter, David Gräßel, Katrin Amunts, Markus Axer

Abstract: The correct reconstruction of individual (crossing) nerve fibers is a prerequisite when constructing a detailed network model of the brain. The recently developed technique Scattered Light Imaging (SLI) allows the reconstruction of crossing nerve fiber pathways in whole brain tissue samples with micrometer resolution: The individual fiber orientations are determined by illuminating unstained histo… ▽ More The correct reconstruction of individual (crossing) nerve fibers is a prerequisite when constructing a detailed network model of the brain. The recently developed technique Scattered Light Imaging (SLI) allows the reconstruction of crossing nerve fiber pathways in whole brain tissue samples with micrometer resolution: The individual fiber orientations are determined by illuminating unstained histological brain sections from different directions, measuring the transmitted scattered light under normal incidence, and studying the light intensity profiles of each pixel in the resulting image series. So far, SLI measurements were performed with a fixed polar angle of illumination and a small number of illumination directions, providing only an estimate of the nerve fiber directions and limited information about the underlying tissue structure. Here, we use an LED display with individually controllable light-emitting diodes to measure the full distribution of scattered light behind the sample (scattering pattern) for each image pixel at once, enabling scatterometry measurements of whole brain tissue samples. We compare our results to coherent Fourier scatterometry (raster-scanning the sample with a non-focused laser beam) and previous SLI measurements with fixed polar angle of illumination, using sections from a vervet monkey brain and human optic tracts. Finally, we present SLI scatterometry measurements of a human brain section with 3 $μ$m in-plane resolution, demonstrating that the technique is a powerful approach to gain new insights into the nerve fiber architecture of the human brain. △ Less

Submitted 27 November, 2021; v1 submitted 30 August, 2021; originally announced August 2021.

Comments: 14 pages, 8 figures

Journal ref: Frontiers in Neuroanatomy 15:767223 (2021)

Contour Proposal Networks for Biomedical Instance Segmentation

Authors: Eric Upschulte, Stefan Harmeling, Katrin Amunts, Timo Dickscheid

Abstract: We present a conceptually simple framework for object instance segmentation called Contour Proposal Network (CPN), which detects possibly overlap** objects in an image while simultaneously fitting closed object contours using an interpretable, fixed-sized representation based on Fourier Descriptors. The CPN can incorporate state of the art object detection architectures as backbone networks into… ▽ More We present a conceptually simple framework for object instance segmentation called Contour Proposal Network (CPN), which detects possibly overlap** objects in an image while simultaneously fitting closed object contours using an interpretable, fixed-sized representation based on Fourier Descriptors. The CPN can incorporate state of the art object detection architectures as backbone networks into a single-stage instance segmentation model that can be trained end-to-end. We construct CPN models with different backbone networks, and apply them to instance segmentation of cells in datasets from different modalities. In our experiments, we show CPNs that outperform U-Nets and Mask R-CNNs in instance segmentation accuracy, and present variants with execution times suitable for real-time applications. The trained models generalize well across different domains of cell types. Since the main assumption of the framework are closed object contours, it is applicable to a wide range of detection problems also outside the biomedical domain. An implementation of the model architecture in PyTorch is freely available. △ Less

Submitted 7 April, 2021; originally announced April 2021.

2D histology meets 3D topology: Cytoarchitectonic brain map** with Graph Neural Networks

Authors: Christian Schiffer, Stefan Harmeling, Katrin Amunts, Timo Dickscheid

Abstract: Cytoarchitecture describes the spatial organization of neuronal cells in the brain, including their arrangement into layers and columns with respect to cell density, orientation, or presence of certain cell types. It allows to segregate the brain into cortical areas and subcortical nuclei, links structure with connectivity and function, and provides a microstructural reference for human brain atla… ▽ More Cytoarchitecture describes the spatial organization of neuronal cells in the brain, including their arrangement into layers and columns with respect to cell density, orientation, or presence of certain cell types. It allows to segregate the brain into cortical areas and subcortical nuclei, links structure with connectivity and function, and provides a microstructural reference for human brain atlases. Map** boundaries between areas requires to scan histological sections at microscopic resolution. While recent high-throughput scanners allow to scan a complete human brain in the order of a year, it is practically impossible to delineate regions at the same pace using the established gold standard method. Researchers have recently addressed cytoarchitectonic map** of cortical regions with deep neural networks, relying on image patches from individual 2D sections for classification. However, the 3D context, which is needed to disambiguate complex or obliquely cut brain regions, is not taken into account. In this work, we combine 2D histology with 3D topology by reformulating the map** task as a node classification problem on an approximate 3D midsurface mesh through the isocortex. We extract deep features from cortical patches in 2D histological sections which are descriptive of cytoarchitecture, and assign them to the corresponding nodes on the 3D mesh to construct a large attributed graph. By solving the brain map** problem on this graph using graph neural networks, we obtain significantly improved classification results. The proposed framework lends itself nicely to integration of additional neuroanatomical priors for map**. △ Less

Submitted 9 March, 2021; originally announced March 2021.

Brain Modelling as a Service: The Virtual Brain on EBRAINS

Authors: Michael Schirner, Lia Domide, Dionysios Perdikis, Paul Triebkorn, Leon Stefanovski, Roopa Pai, Paula Popa, Bogdan Valean, Jessica Palmer, Chloê Langford, André Blickensdörfer, Michiel van der Vlag, Sandra Diaz-Pier, Alexander Peyser, Wouter Klijn, Dirk Pleiter, Anne Nahm, Oliver Schmid, Marmaduke Woodman, Lyuba Zehl, Jan Fousek, Spase Petkoski, Lionel Kusch, Meysam Hashemi, Daniele Marinazzo , et al. (19 additional authors not shown)

Abstract: The Virtual Brain (TVB) is now available as open-source cloud ecosystem on EBRAINS, a shared digital research platform for brain science. It offers services for constructing, simulating and analysing brain network models (BNMs) including the TVB network simulator; magnetic resonance imaging (MRI) processing pipelines to extract structural and functional connectomes; multiscale co-simulation of spi… ▽ More The Virtual Brain (TVB) is now available as open-source cloud ecosystem on EBRAINS, a shared digital research platform for brain science. It offers services for constructing, simulating and analysing brain network models (BNMs) including the TVB network simulator; magnetic resonance imaging (MRI) processing pipelines to extract structural and functional connectomes; multiscale co-simulation of spiking and large-scale networks; a domain specific language for automatic high-performance code generation from user-specified models; simulation-ready BNMs of patients and healthy volunteers; Bayesian inference of epilepsy spread; data and code for mouse brain simulation; and extensive educational material. TVB cloud services facilitate reproducible online collaboration and discovery of data assets, models, and software embedded in scalable and secure workflows, a precondition for research on large cohort data sets, better generalizability and clinical translation. △ Less

Submitted 29 March, 2021; v1 submitted 11 February, 2021; originally announced February 2021.

Contrastive Representation Learning for Whole Brain Cytoarchitectonic Map** in Histological Human Brain Sections

Authors: Christian Schiffer, Katrin Amunts, Stefan Harmeling, Timo Dickscheid

Abstract: Cytoarchitectonic maps provide microstructural reference parcellations of the brain, describing its organization in terms of the spatial arrangement of neuronal cell bodies as measured from histological tissue sections. Recent work provided the first automatic segmentations of cytoarchitectonic areas in the visual system using Convolutional Neural Networks. We aim to extend this approach to become… ▽ More Cytoarchitectonic maps provide microstructural reference parcellations of the brain, describing its organization in terms of the spatial arrangement of neuronal cell bodies as measured from histological tissue sections. Recent work provided the first automatic segmentations of cytoarchitectonic areas in the visual system using Convolutional Neural Networks. We aim to extend this approach to become applicable to a wider range of brain areas, envisioning a solution for map** the complete human brain. Inspired by recent success in image classification, we propose a contrastive learning objective for encoding microscopic image patches into robust microstructural features, which are efficient for cytoarchitectonic area classification. We show that a model pre-trained using this learning task outperforms a model trained from scratch, as well as a model pre-trained on a recently proposed auxiliary task. We perform cluster analysis in the feature space to show that the learned representations form anatomically meaningful groups. △ Less

Submitted 28 January, 2021; v1 submitted 25 November, 2020; originally announced November 2020.

Comments: Accepted to ISBI 2021

Convolutional Neural Networks for cytoarchitectonic brain map** at large scale

Authors: Christian Schiffer, Hannah Spitzer, Kai Kiwitz, Nina Unger, Konrad Wagstyl, Alan C. Evans, Stefan Harmeling, Katrin Amunts, Timo Dickscheid

Abstract: Human brain atlases provide spatial reference systems for data characterizing brain organization at different levels, coming from different brains. Cytoarchitecture is a basic principle of the microstructural organization of the brain, as regional differences in the arrangement and composition of neuronal cells are indicators of changes in connectivity and function. Automated scanning procedures a… ▽ More Human brain atlases provide spatial reference systems for data characterizing brain organization at different levels, coming from different brains. Cytoarchitecture is a basic principle of the microstructural organization of the brain, as regional differences in the arrangement and composition of neuronal cells are indicators of changes in connectivity and function. Automated scanning procedures and observer-independent methods are prerequisites to reliably identify cytoarchitectonic areas, and to achieve reproducible models of brain segregation. Time becomes a key factor when moving from the analysis of single regions of interest towards high-throughput scanning of large series of whole-brain sections. Here we present a new workflow for map** cytoarchitectonic areas in large series of cell-body stained histological sections of human postmortem brains. It is based on a Deep Convolutional Neural Network (CNN), which is trained on a pair of section images with annotations, with a large number of un-annotated sections in between. The model learns to create all missing annotations in between with high accuracy, and faster than our previous workflow based on observer-independent map**. The new workflow does not require preceding 3D-reconstruction of sections, and is robust against histological artefacts. It processes large data sets with sizes in the order of multiple Terabytes efficiently. The workflow was integrated into a web interface, to allow access without expertise in deep learning and batch computing. Applying deep neural networks for cytoarchitectonic map** opens new perspectives to enable high-resolution models of brain areas, introducing CNNs to identify borders of brain areas. △ Less

Submitted 25 November, 2020; originally announced November 2020.

Comments: Preprint submitted to NeuroImage

Scattered Light Imaging: Resolving the substructure of nerve fiber crossings in whole brain sections with micrometer resolution

Authors: Miriam Menzel, Jan André Reuter, David Gräßel, Mike Huwer, Philipp Schlömer, Katrin Amunts, Markus Axer

Abstract: For develo** a detailed network model of the brain based on image reconstructions, it is necessary to spatially resolve crossing nerve fibers. The accuracy hereby depends on many factors, including the spatial resolution of the imaging technique. 3D Polarized Light Imaging (3D-PLI) allows the three-dimensional reconstruction of nerve fiber tracts in whole brain sections with micrometer in-plane… ▽ More For develo** a detailed network model of the brain based on image reconstructions, it is necessary to spatially resolve crossing nerve fibers. The accuracy hereby depends on many factors, including the spatial resolution of the imaging technique. 3D Polarized Light Imaging (3D-PLI) allows the three-dimensional reconstruction of nerve fiber tracts in whole brain sections with micrometer in-plane resolution, but leaves uncertainties in pixels containing crossing fibers. Here we introduce Scattered Light Imaging (SLI) to resolve the substructure of nerve fiber crossings. The measurement is performed on the same unstained histological brain sections as in 3D-PLI. By illuminating the brain sections from different angles and measuring the transmitted (scattered) light under normal incidence, SLI provides information about the underlying nerve fiber structure. A fully automated evaluation of the resulting light intensity profiles has been developed, allowing the user to extract various characteristics, like the individual directions of in-plane crossing nerve fibers, for each image pixel at once. We validate the reconstructed nerve fiber directions against results from previous simulation studies, scatterometry measurements, and fiber directions obtained from 3D-PLI. We demonstrate in different brain samples (human optic tracts, vervet monkey brain, rat brain) that the 2D fiber directions can be reliably reconstructed for up to three crossing nerve fiber bundles in each image pixel with an in-plane resolution of up to 6.5 $μ$m. We show that SLI also yields reliable fiber directions in brain regions with low 3D-PLI signals coming from regions with a low density of myelinated nerve fibers or out-of-plane fibers. In combination with 3D-PLI, the technique can be used for a full reconstruction of the three-dimensional nerve fiber architecture in the brain. △ Less

Submitted 2 February, 2021; v1 submitted 3 August, 2020; originally announced August 2020.

Comments: 30 pages, 16 figures

Journal ref: NeuroImage 233, 117952 (2021)

Dense Fiber Modeling for 3D-Polarized Light Imaging Simulations

Authors: Felix Matuschke, Kévin Ginsburger, Cyril Poupon, Katrin Amunts, Markus Axer

Abstract: 3D-Polarized Light Imaging (3D-PLI) is a neuroimaging technique used to study the structural connectivity of the human brain at the meso- and microscale. In 3D-PLI, the complex nerve fiber architecture of the brain is characterized by 3D orientation vector fields that are derived from birefringence measurements of unstained histological brain sections by means of an effective physical model. To… ▽ More 3D-Polarized Light Imaging (3D-PLI) is a neuroimaging technique used to study the structural connectivity of the human brain at the meso- and microscale. In 3D-PLI, the complex nerve fiber architecture of the brain is characterized by 3D orientation vector fields that are derived from birefringence measurements of unstained histological brain sections by means of an effective physical model. To optimize the physical model and to better understand the underlying microstructure, numerical simulations are essential tools to optimize the used physical model and to understand the underlying microstructure in detail. The simulations rely on predefined configurations of nerve fiber models (e.g. crossing, kissing, or complex intermingling), their physical properties, as well as the physical properties of the employed optical system to model the entire 3D-PLI measurement. By comparing the simulation and experimental results, possible misinterpretations in the fiber reconstruction process of 3D-PLI can be identified. Here, we focus on fiber modeling with a specific emphasize on the generation of dense fiber distributions as found in the human brain's white matter. A new algorithm will be introduced that allows to control possible intersections of computationally grown fiber structures. △ Less

Submitted 29 January, 2019; originally announced January 2019.

Journal ref: Advances in Parallel Computing: Future Trends of HPC in a Disruptive Scenario (2019): 240-253. Amsterdam: IOS Press, Advances in Parallel Computing 34

Towards ultra-high resolution 3D reconstruction of a whole rat brain from 3D-PLI data

Authors: Sharib Ali, Martin Schober, Philipp Schlöme, Katrin Amunts, Markus Axer, Karl Rohr

Abstract: 3D reconstruction of the fiber connectivity of the rat brain at microscopic scale enables gaining detailed insight about the complex structural organization of the brain. We introduce a new method for registration and 3D reconstruction of high- and ultra-high resolution (64 $μ$m and 1.3 $μ$m pixel size) histological images of a Wistar rat brain acquired by 3D polarized light imaging (3D-PLI). Our… ▽ More 3D reconstruction of the fiber connectivity of the rat brain at microscopic scale enables gaining detailed insight about the complex structural organization of the brain. We introduce a new method for registration and 3D reconstruction of high- and ultra-high resolution (64 $μ$m and 1.3 $μ$m pixel size) histological images of a Wistar rat brain acquired by 3D polarized light imaging (3D-PLI). Our method exploits multi-scale and multi-modal 3D-PLI data up to cellular resolution. We propose a new feature transform-based similarity measure and a weighted regularization scheme for accurate and robust non-rigid registration. To transform the 1.3 $μ$m ultra-high resolution data to the reference blockface images a feature-based registration method followed by a non-rigid registration is proposed. Our approach has been successfully applied to 278 histological sections of a rat brain and the performance has been quantitatively evaluated using manually placed landmarks by an expert. △ Less

Submitted 29 July, 2018; originally announced July 2018.

Comments: 9 pages, Accepted at 2nd International Workshop on Connectomics in NeuroImaging (CNI), MICCAI'2018

Diattenuation Imaging reveals different brain tissue properties

Authors: Miriam Menzel, Markus Axer, Katrin Amunts, Hans De Raedt, Kristel Michielsen

Abstract: When transmitting polarised light through histological brain sections, different types of diattenuation (polarisation-dependent attenuation of light) can be observed: In some brain regions, the light is minimally attenuated when it is polarised parallel to the nerve fibres (referred to as D+), in others, it is maximally attenuated (referred to as D-). The underlying mechanisms of these effects and… ▽ More When transmitting polarised light through histological brain sections, different types of diattenuation (polarisation-dependent attenuation of light) can be observed: In some brain regions, the light is minimally attenuated when it is polarised parallel to the nerve fibres (referred to as D+), in others, it is maximally attenuated (referred to as D-). The underlying mechanisms of these effects and their relationship to tissue properties were so far unknown. Here, we demonstrate in experimental studies that diattenuation of both types D+ and D- can be observed in brain tissue samples from different species (rodent, monkey, and human) and that the strength and type of diattenuation depend on the nerve fibre orientations. By combining finite-difference time-domain simulations and analytical modelling, we explain the observed diattenuation effects and show that they are caused both by anisotropic absorption (dichroism) and by anisotropic light scattering. Our studies demonstrate that the diattenuation signal depends not only on the nerve fibre orientations but also on other brain tissue properties like tissue homogeneity, fibre size, and myelin sheath thickness. This allows to use the diattenuation signal to distinguish between brain regions with different tissue properties and establishes Diattenuation Imaging as a valuable imaging technique. △ Less

Submitted 4 January, 2019; v1 submitted 20 June, 2018; originally announced June 2018.

Comments: 18 pages, 9 figures

Journal ref: Scientific Reports 9(1939)

Finite-Difference Time-Domain simulations of transmission microscopy enable a better interpretation of 3D nerve fiber architectures in the brain

Authors: Miriam Menzel, Markus Axer, Hans De Raedt, Irene Costantini, Ludovico Silvestri, Francesco S. Pavone, Katrin Amunts, Kristel Michielsen

Abstract: In many laboratories, conventional bright-field transmission microscopes are available to study the structure and organization principles of fibrous tissue samples, but they usually provide only 2D information. To access the third (out-of-plane) dimension, more advanced techniques are employed. An example is 3D Polarized Light Imaging (3D-PLI), which measures the birefringence of histological brai… ▽ More In many laboratories, conventional bright-field transmission microscopes are available to study the structure and organization principles of fibrous tissue samples, but they usually provide only 2D information. To access the third (out-of-plane) dimension, more advanced techniques are employed. An example is 3D Polarized Light Imaging (3D-PLI), which measures the birefringence of histological brain sections to derive the spatial nerve fiber orientations. Here, we show how light scattering in transmission microscopy measurements can be leveraged to gain 3D structural information about fibrous tissue samples like brain tissue. For this purpose, we developed a simulation framework using finite-difference time-domain (FDTD) simulations and high performance computing, which can easily be adapted to other microscopy techniques and tissue types with comparable fibrous structures (e.g., muscle fibers, collagen, or artificial fibers). As conventional bright-field transmission microscopy provides usually only 2D information about tissue structures, a three-dimensional reconstruction of fibers across several sections is difficult. By combining our simulations with experimental studies, we show that the polarization-independent transmitted light intensity (transmittance) contains 3D information: We demonstrate in several experimental studies on brain sections from different species (rodent, monkey, human) that the transmittance decreases significantly (by more than 50%) with the increasing out-of-plane angle of the nerve fibers. Our FDTD simulations show that this decrease is mainly caused by polarization-independent light scattering in combination with the finite numerical aperture of the imaging system. This allows to use standard transmission microscopy techniques to obtain 3D information about the fiber inclination and to detect steep fibers, without need for additional measurements. △ Less

Submitted 31 July, 2019; v1 submitted 19 June, 2018; originally announced June 2018.

Comments: 33 pages, 19 figures

Journal ref: Phys. Rev. X 10, 021002 (2020)

Improving Cytoarchitectonic Segmentation of Human Brain Areas with Self-supervised Siamese Networks

Authors: Hannah Spitzer, Kai Kiwitz, Katrin Amunts, Stefan Harmeling, Timo Dickscheid

Abstract: Cytoarchitectonic parcellations of the human brain serve as anatomical references in multimodal atlas frameworks. They are based on analysis of cell-body stained histological sections and the identification of borders between brain areas. The de-facto standard involves a semi-automatic, reproducible border detection, but does not scale with high-throughput imaging in large series of sections at mi… ▽ More Cytoarchitectonic parcellations of the human brain serve as anatomical references in multimodal atlas frameworks. They are based on analysis of cell-body stained histological sections and the identification of borders between brain areas. The de-facto standard involves a semi-automatic, reproducible border detection, but does not scale with high-throughput imaging in large series of sections at microscopical resolution. Automatic parcellation, however, is extremely challenging due to high variation in the data, and the need for a large field of view at microscopic resolution. The performance of a recently proposed Convolutional Neural Network model that addresses this problem especially suffers from the naturally limited amount of expert annotations for training. To circumvent this limitation, we propose to pre-train neural networks on a self-supervised auxiliary task, predicting the 3D distance between two patches sampled from the same brain. Compared to a random initialization, fine-tuning from these networks results in significantly better segmentations. We show that the self-supervised model has implicitly learned to distinguish several cortical brain areas -- a strong indicator that the proposed auxiliary task is appropriate for cytoarchitectonic map**. △ Less

Submitted 13 June, 2018; originally announced June 2018.

Comments: Accepted at MICCAI 2018

Parcellation of Visual Cortex on high-resolution histological Brain Sections using Convolutional Neural Networks

Authors: Hannah Spitzer, Katrin Amunts, Stefan Harmeling, Timo Dickscheid

Abstract: Microscopic analysis of histological sections is considered the "gold standard" to verify structural parcellations in the human brain. Its high resolution allows the study of laminar and columnar patterns of cell distributions, which build an important basis for the simulation of cortical areas and networks. However, such cytoarchitectonic map** is a semiautomatic, time consuming process that do… ▽ More Microscopic analysis of histological sections is considered the "gold standard" to verify structural parcellations in the human brain. Its high resolution allows the study of laminar and columnar patterns of cell distributions, which build an important basis for the simulation of cortical areas and networks. However, such cytoarchitectonic map** is a semiautomatic, time consuming process that does not scale with high throughput imaging. We present an automatic approach for parcellating histological sections at 2um resolution. It is based on a convolutional neural network that combines topological information from probabilistic atlases with the texture features learned from high-resolution cell-body stained images. The model is applied to visual areas and trained on a sparse set of partial annotations. We show how predictions are transferable to new brains and spatially consistent across sections. △ Less

Submitted 30 May, 2017; originally announced May 2017.

Comments: Accepted for oral presentation at International Symposium of Biomedical Imaging (ISBI) 2017

Diattenuation of Brain Tissue and its Impact on 3D Polarized Light Imaging

Authors: Miriam Menzel, Julia Reckfort, Daniel Weigand, Hasan Köse, Katrin Amunts, Markus Axer

Abstract: 3D-Polarized Light Imaging (3D-PLI) reconstructs nerve fibers in histological brain sections by measuring their birefringence. This study investigates another effect caused by the optical anisotropy of brain tissue - diattenuation. Based on numerical and experimental studies and a complete analytical description of the optical system, the diattenuation was determined to be below 4 % in rat brain t… ▽ More 3D-Polarized Light Imaging (3D-PLI) reconstructs nerve fibers in histological brain sections by measuring their birefringence. This study investigates another effect caused by the optical anisotropy of brain tissue - diattenuation. Based on numerical and experimental studies and a complete analytical description of the optical system, the diattenuation was determined to be below 4 % in rat brain tissue. It was demonstrated that the diattenuation effect has negligible impact on the fiber orientations derived by 3D-PLI. The diattenuation signal, however, was found to highlight different anatomical structures that cannot be distinguished with current imaging techniques, which makes Diattenuation Imaging a promising extension to 3D-PLI. △ Less

Submitted 12 June, 2017; v1 submitted 13 March, 2017; originally announced March 2017.

Comments: 32 pages, 15 figures

Journal ref: Biomed. Opt. Express 8(7), 3163-3197 (2017)

Grand Challenges for Global Brain Sciences

Authors: Joshua T. Vogelstein, Katrin Amunts, Andreas Andreou, Dora Angelaki, Giorgio Ascoli, Cori Bargmann, Randal Burns, Corrado Cali, Frances Chance, Miyoung Chun, George Church, Hollis Cline, Todd Coleman, Stephanie de La Rochefoucauld, Winfried Denk, Ana Belen Elgoyhen, Ralph Etienne Cummings, Alan Evans, Kenneth Harris, Michael Hausser, Sean Hill, Samuel Inverso, Chad Jackson, Viren Jain, Rob Kass , et al. (37 additional authors not shown)

Abstract: The next grand challenges for society and science are in the brain sciences. A collection of 60+ scientists from around the world, together with 10+ observers from national, private, and foundations, spent two days together discussing the top challenges that we could solve as a global community in the next decade. We eventually settled on three challenges, spanning anatomy, physiology, and medicin… ▽ More The next grand challenges for society and science are in the brain sciences. A collection of 60+ scientists from around the world, together with 10+ observers from national, private, and foundations, spent two days together discussing the top challenges that we could solve as a global community in the next decade. We eventually settled on three challenges, spanning anatomy, physiology, and medicine. Addressing all three challenges requires novel computational infrastructure. The group proposed the advent of The International Brain Station (TIBS), to address these challenges, and launch brain sciences to the next level of understanding. △ Less

Submitted 27 October, 2016; v1 submitted 23 August, 2016; originally announced August 2016.

Comments: 6 pages

A Jones matrix formalism for simulating three-dimensional polarized light imaging of brain tissue

Authors: Miriam Menzel, Kristel Michielsen, Hans De Raedt, Julia Reckfort, Katrin Amunts, Markus Axer

Abstract: The neuroimaging technique three-dimensional polarized light imaging (3D-PLI) provides a high-resolution reconstruction of nerve fibres in human post-mortem brains. The orientations of the fibres are derived from birefringence measurements of histological brain sections assuming that the nerve fibres - consisting of an axon and a surrounding myelin sheath - are uniaxial birefringent and that the m… ▽ More The neuroimaging technique three-dimensional polarized light imaging (3D-PLI) provides a high-resolution reconstruction of nerve fibres in human post-mortem brains. The orientations of the fibres are derived from birefringence measurements of histological brain sections assuming that the nerve fibres - consisting of an axon and a surrounding myelin sheath - are uniaxial birefringent and that the measured optic axis is oriented in direction of the nerve fibres (macroscopic model). Although experimental studies support this assumption, the molecular structure of the myelin sheath suggests that the birefringence of a nerve fibre can be described more precisely by multiple optic axes oriented radially around the fibre axis (microscopic model). In this paper, we compare the use of the macroscopic and the microscopic model for simulating 3D-PLI by means of the Jones matrix formalism. The simulations show that the macroscopic model ensures a reliable estimation of the fibre orientations as long as the polarimeter does not resolve structures smaller than the diameter of single fibres. In the case of fibre bundles, polarimeters with even higher resolutions can be used without losing reliability. When taking the myelin density into account, the derived fibre orientations are considerably improved. △ Less

Submitted 9 October, 2015; v1 submitted 9 June, 2015; originally announced June 2015.

Comments: 20 pages, 8 figures

Journal ref: Menzel M, Michielsen K, De Raedt H, Reckfort J, Amunts K, Axer M. 2015 A Jones matrix formalism for simulating three-dimensional polarized light imaging of brain tissue. J. R. Soc. Interface 12: 20150734