-
SYNTA: A novel approach for deep learning-based image analysis in muscle histopathology using photo-realistic synthetic data
Authors:
Leonid Mill,
Oliver Aust,
Jochen A. Ackermann,
Philipp Burger,
Monica Pascual,
Katrin Palumbo-Zerr,
Gerhard Krönke,
Stefan Uderhardt,
Georg Schett,
Christoph S. Clemen,
Rolf Schröder,
Christian Holtzhausen,
Samir Jabari,
Andreas Maier,
Anika Grüneboom
Abstract:
Artificial intelligence (AI), machine learning, and deep learning (DL) methods are becoming increasingly important in the field of biomedical image analysis. However, to exploit the full potential of such methods, a representative number of experimentally acquired images containing a significant number of manually annotated objects is needed as training data. Here we introduce SYNTA (synthetic dat…
▽ More
Artificial intelligence (AI), machine learning, and deep learning (DL) methods are becoming increasingly important in the field of biomedical image analysis. However, to exploit the full potential of such methods, a representative number of experimentally acquired images containing a significant number of manually annotated objects is needed as training data. Here we introduce SYNTA (synthetic data) as a novel approach for the generation of synthetic, photo-realistic, and highly complex biomedical images as training data for DL systems. We show the versatility of our approach in the context of muscle fiber and connective tissue analysis in histological sections. We demonstrate that it is possible to perform robust and expert-level segmentation tasks on previously unseen real-world data, without the need for manual annotations using synthetic training data alone. Being a fully parametric technique, our approach poses an interpretable and controllable alternative to Generative Adversarial Networks (GANs) and has the potential to significantly accelerate quantitative image analysis in a variety of biomedical applications in microscopy and beyond.
△ Less
Submitted 3 January, 2024; v1 submitted 29 July, 2022;
originally announced July 2022.
-
Synthetic Image Rendering Solves Annotation Problem in Deep Learning Nanoparticle Segmentation
Authors:
Leonid Mill,
David Wolff,
Nele Gerrits,
Patrick Philipp,
Lasse Kling,
Florian Vollnhals,
Andrew Ignatenko,
Christian Jaremenko,
Yixing Huang,
Olivier De Castro,
Jean-Nicolas Audinot,
Inge Nelissen,
Tom Wirtz,
Andreas Maier,
Silke Christiansen
Abstract:
Nanoparticles occur in various environments as a consequence of man-made processes, which raises concerns about their impact on the environment and human health. To allow for proper risk assessment, a precise and statistically relevant analysis of particle characteristics (such as e.g. size, shape and composition) is required that would greatly benefit from automated image analysis procedures. Whi…
▽ More
Nanoparticles occur in various environments as a consequence of man-made processes, which raises concerns about their impact on the environment and human health. To allow for proper risk assessment, a precise and statistically relevant analysis of particle characteristics (such as e.g. size, shape and composition) is required that would greatly benefit from automated image analysis procedures. While deep learning shows impressive results in object detection tasks, its applicability is limited by the amount of representative, experimentally collected and manually annotated training data. Here, we present an elegant, flexible and versatile method to bypass this costly and tedious data acquisition process. We show that using a rendering software allows to generate realistic, synthetic training data to train a state-of-the art deep neural network. Using this approach, we derive a segmentation accuracy that is comparable to man-made annotations for toxicologically relevant metal-oxide nanoparticle ensembles which we chose as examples. Our study paves the way towards the use of deep learning for automated, high-throughput particle detection in a variety of imaging techniques such as microscopies and spectroscopies, for a wide variety of studies and applications, including the detection of plastic micro- and nanoparticles.
△ Less
Submitted 20 November, 2020;
originally announced November 2020.
-
Cephalogram Synthesis and Landmark Detection in Dental Cone-Beam CT Systems
Authors:
Yixing Huang,
Fuxin Fan,
Christopher Syben,
Philipp Roser,
Leonid Mill,
Andreas Maier
Abstract:
Due to the lack of standardized 3D cephalometric analytic methodology, 2D cephalograms synthesized from 3D cone-beam computed tomography (CBCT) volumes are widely used for cephalometric analysis in dental CBCT systems. However, compared with conventional X-ray film based cephalograms, such synthetic cephalograms lack image contrast and resolution. In addition, the radiation dose during the scan fo…
▽ More
Due to the lack of standardized 3D cephalometric analytic methodology, 2D cephalograms synthesized from 3D cone-beam computed tomography (CBCT) volumes are widely used for cephalometric analysis in dental CBCT systems. However, compared with conventional X-ray film based cephalograms, such synthetic cephalograms lack image contrast and resolution. In addition, the radiation dose during the scan for 3D reconstruction causes potential health risks. In this work, we propose a sigmoid-based intensity transform that uses the nonlinear optical property of X-ray films to increase image contrast of synthetic cephalograms. To improve image resolution, super resolution deep learning techniques are investigated. For low dose purpose, the pixel-to-pixel generative adversarial network (pix2pixGAN) is proposed for 2D cephalogram synthesis directly from two CBCT projections. For landmark detection in the synthetic cephalograms, an efficient automatic landmark detection method using the combination of LeNet-5 and ResNet50 is proposed. Our experiments demonstrate the efficacy of pix2pixGAN in 2D cephalogram synthesis, achieving an average peak signal-to-noise ratio (PSNR) value of 33.8 with reference to the cephalograms synthesized from 3D CBCT volumes. Pix2pixGAN also achieves the best performance in super resolution, achieving an average PSNR value of 32.5 without the introduction of checkerboard or jagging artifacts. Our proposed automatic landmark detection method achieves 86.7% successful detection rate in the 2 mm clinical acceptable range on the ISBI Test1 data, which is comparable to the state-of-the-art methods. The method trained on conventional cephalograms can be directly applied to landmark detection in the synthetic cephalograms, achieving 93.0% and 80.7% successful detection rate in 4 mm precision range for synthetic cephalograms from 3D volumes and 2D projections respectively.
△ Less
Submitted 20 March, 2021; v1 submitted 9 September, 2020;
originally announced September 2020.
-
Learning with Known Operators reduces Maximum Training Error Bounds
Authors:
Andreas K. Maier,
Christopher Syben,
Bernhard Stimpel,
Tobias Würfl,
Mathis Hoffmann,
Frank Schebesch,
Weilin Fu,
Leonid Mill,
Lasse Kling,
Silke Christiansen
Abstract:
We describe an approach for incorporating prior knowledge into machine learning algorithms. We aim at applications in physics and signal processing in which we know that certain operations must be embedded into the algorithm. Any operation that allows computation of a gradient or sub-gradient towards its inputs is suited for our framework. We derive a maximal error bound for deep nets that demonst…
▽ More
We describe an approach for incorporating prior knowledge into machine learning algorithms. We aim at applications in physics and signal processing in which we know that certain operations must be embedded into the algorithm. Any operation that allows computation of a gradient or sub-gradient towards its inputs is suited for our framework. We derive a maximal error bound for deep nets that demonstrates that inclusion of prior knowledge results in its reduction. Furthermore, we also show experimentally that known operators reduce the number of free parameters. We apply this approach to various tasks ranging from CT image reconstruction over vessel segmentation to the derivation of previously unknown imaging algorithms. As such the concept is widely applicable for many researchers in physics, imaging, and signal processing. We assume that our analysis will support further investigation of known operators in other fields of physics, imaging, and signal processing.
△ Less
Submitted 3 July, 2019;
originally announced July 2019.
-
Low X-Ray Luminosity Galaxy Clusters: Main goals, sample selection, photometric and spectroscopic observations
Authors:
J. L. Nilo Castellón,
M. V. Alonso,
D. García Lambas,
Carlos Valotto,
A. L. O' Mill,
H. Cuevas,
E. R. Carrasco,
A. Ramírez,
J. M. Astudillo,
F. Ramos,
M. Jaque,
N. Ulloa,
Y. Órdenes
Abstract:
We present the study of nineteen low X-ray luminosity galaxy clusters (L$_X \sim$ 0.5--45 $\times$ $10^{43}$ erg s$^{-1}$), selected from the ROSAT Position Sensitive Proportional Counters (PSPC) Pointed Observations (Vikhlinin et al. 1998) and the revised version of Mullis et al. (2003) in the redshift range of 0.16 to 0.7. This is the introductory paper of a series presenting the sample selectio…
▽ More
We present the study of nineteen low X-ray luminosity galaxy clusters (L$_X \sim$ 0.5--45 $\times$ $10^{43}$ erg s$^{-1}$), selected from the ROSAT Position Sensitive Proportional Counters (PSPC) Pointed Observations (Vikhlinin et al. 1998) and the revised version of Mullis et al. (2003) in the redshift range of 0.16 to 0.7. This is the introductory paper of a series presenting the sample selection, photometric and spectroscopic observations and data reduction. Photometric data in different passbands were taken for eight galaxy clusters at Las Campanas Observatory; three clusters at Cerro Tololo Interamerican Observatory; and eight clusters at the Gemini Observatory. Spectroscopic data were collected for only four galaxy clusters using Gemini telescopes. With the photometry, the galaxies were defined based on the star-galaxy separation taking into account photometric parameters. For each galaxy cluster, the catalogues contain the PSF and aperture magnitudes of galaxies within the 90\% completeness limit. They are used together with structural parameters to study the galaxy morphology and to estimate photometric redshifts. With the spectroscopy, the derived galaxy velocity dispersion of our clusters ranged from 507 km~s$^{-1}$ for [VMF98]022 to 775 km~s$^{-1}$ for [VMF98]097 with signs of substructure. Cluster membership has been extensively discussed taking into account spectroscopic and photometric redshift estimates. In this sense, members are the galaxies within a projected radius of 0.75 Mpc from the X-ray mission peak and with cluster centric velocities smaller than the cluster velocity dispersion or 6000 km~s$^{-1}$, respectively. These results will be used in forthcoming papers to study, among the main topics, the red cluster sequence, blue cloud and green populations; the galaxy luminosity function and cluster dynamics.
△ Less
Submitted 7 April, 2016; v1 submitted 6 April, 2016;
originally announced April 2016.
-
Low X-Ray Luminosity Galaxy Clusters. II. Optical properties and morphological content at 0.18 < z < 0.70
Authors:
José Luis Nilo Castellón,
M. Victoria Alonso,
Diego García Lambas,
Ana Laura O' Mill,
Carlos Valotto,
E. Rodrigo Carrasco,
Héctor Cuevas \& Amelia Ramírez
Abstract:
This is the second of a series of papers on low X-ray luminosity galaxy clusters, in which we present the $r^\prime$, $g^\prime$ and $i^\prime$ photometry obtained with GMOS-IMAGE at Gemini North and South telescopes for seven systems in the redshift range of 0.18 to 0.70. Optical magnitudes, colours and morphological parameters, namely, concentration index, ellipticity and visual morphological cl…
▽ More
This is the second of a series of papers on low X-ray luminosity galaxy clusters, in which we present the $r^\prime$, $g^\prime$ and $i^\prime$ photometry obtained with GMOS-IMAGE at Gemini North and South telescopes for seven systems in the redshift range of 0.18 to 0.70. Optical magnitudes, colours and morphological parameters, namely, concentration index, ellipticity and visual morphological classification, are also given.
At lower redshifts, the presence of a well-defined red cluster sequence extending by more than 4 magnitudes showed that these intermediate-mass clusters had reached a relaxed stage. This was confirmed by the small fraction of blue galaxy members observed in the central regions of $\sim$ 0.75 Mpc.
In contrast, galaxy clusters at higher redshifts had a less important red cluster sequence. We also found that the galaxy radial density profiles in these clusters were well fitted by a single power law.
At 0.18 $<$ z $<$ 0.70, we observed an increasing fraction of blue galaxies and a decreasing fraction of lenticulars, with the early-type fraction remaining almost constant. Overall, the results of these intermediate-mass clusters are in agreement with those for high mass clusters.
△ Less
Submitted 4 November, 2013;
originally announced November 2013.
