-
Cooling power analysis of a small scale 4 K pulse tube cryocooler driven by an oil-free low input power Helium compressor
Authors:
Jack-Andre Schmidt,
Bernd Schmidt,
Jens Falter,
Jens Hoehne,
Claudio Dal Savio,
Sebatsian Schaile,
Andre Schirmeisen
Abstract:
Here we report the performance of a small scale 4 K pulse tube cryocooler operating with a low input power reaching a minimum temperature of 2.2 K, as well as a cooling capacity of over 240 mW at 4.2 K. The compressor is air cooled and can be supplied by single phase power sockets. With an input power of about 1.3 kW the coefficient of performance reaches values of up to 185 mW/kW, which is among…
▽ More
Here we report the performance of a small scale 4 K pulse tube cryocooler operating with a low input power reaching a minimum temperature of 2.2 K, as well as a cooling capacity of over 240 mW at 4.2 K. The compressor is air cooled and can be supplied by single phase power sockets. With an input power of about 1.3 kW the coefficient of performance reaches values of up to 185 mW/kW, which is among the highest currently reported values for small to medium power pulse tubes. The combination of an oil-free Helium compressor and low maintenance pulse tube cryocooler provides a unique miniaturized, energy efficient and mobile cooling tool for applications at 4 K and below.
△ Less
Submitted 1 November, 2023;
originally announced November 2023.
-
Towards Hierarchical Regional Transformer-based Multiple Instance Learning
Authors:
Josef Cersovsky,
Sadegh Mohammadi,
Dagmar Kainmueller,
Johannes Hoehne
Abstract:
The classification of gigapixel histopathology images with deep multiple instance learning models has become a critical task in digital pathology and precision medicine. In this work, we propose a Transformer-based multiple instance learning approach that replaces the traditional learned attention mechanism with a regional, Vision Transformer inspired self-attention mechanism. We present a method…
▽ More
The classification of gigapixel histopathology images with deep multiple instance learning models has become a critical task in digital pathology and precision medicine. In this work, we propose a Transformer-based multiple instance learning approach that replaces the traditional learned attention mechanism with a regional, Vision Transformer inspired self-attention mechanism. We present a method that fuses regional patch information to derive slide-level predictions and show how this regional aggregation can be stacked to hierarchically process features on different distance levels. To increase predictive accuracy, especially for datasets with small, local morphological features, we introduce a method to focus the image processing on high attention regions during inference. Our approach is able to significantly improve performance over the baseline on two histopathology datasets and points towards promising directions for further research.
△ Less
Submitted 20 November, 2023; v1 submitted 24 August, 2023;
originally announced August 2023.
-
Transfer Learning for Segmentation Problems: Choose the Right Encoder and Skip the Decoder
Authors:
Jonas Dippel,
Matthias Lenga,
Thomas Goerttler,
Klaus Obermayer,
Johannes Höhne
Abstract:
It is common practice to reuse models initially trained on different data to increase downstream task performance. Especially in the computer vision domain, ImageNet-pretrained weights have been successfully used for various tasks. In this work, we investigate the impact of transfer learning for segmentation problems, being pixel-wise classification problems that can be tackled with encoder-decode…
▽ More
It is common practice to reuse models initially trained on different data to increase downstream task performance. Especially in the computer vision domain, ImageNet-pretrained weights have been successfully used for various tasks. In this work, we investigate the impact of transfer learning for segmentation problems, being pixel-wise classification problems that can be tackled with encoder-decoder architectures. We find that transfer learning the decoder does not help downstream segmentation tasks, while transfer learning the encoder is truly beneficial. We demonstrate that pretrained weights for a decoder may yield faster convergence, but they do not improve the overall model performance as one can obtain equivalent results with randomly initialized decoders. However, we show that it is more effective to reuse encoder weights trained on a segmentation or reconstruction task than reusing encoder weights trained on classification tasks. This finding implicates that using ImageNet-pretrained encoders for downstream segmentation problems is suboptimal. We also propose a contrastive self-supervised approach with multiple self-reconstruction tasks, which provides encoders that are suitable for transfer learning in segmentation problems in the absence of segmentation labels.
△ Less
Submitted 29 July, 2022;
originally announced July 2022.
-
Towards Fine-grained Visual Representations by Combining Contrastive Learning with Image Reconstruction and Attention-weighted Pooling
Authors:
Jonas Dippel,
Steffen Vogler,
Johannes Höhne
Abstract:
This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art contrastive learning methods (e.g. SimCLR) have shortcomings to capture fine-grained visual features in their representations. ConRec extends the SimCLR framework by add…
▽ More
This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art contrastive learning methods (e.g. SimCLR) have shortcomings to capture fine-grained visual features in their representations. ConRec extends the SimCLR framework by adding (1) a self-reconstruction task and (2) an attention mechanism within the contrastive learning task. This is accomplished by applying a simple encoder-decoder architecture with two heads. We show that both extensions contribute towards an improved vector representation for images with fine-grained visual features. Combining those concepts, ConRec outperforms SimCLR and SimCLR with Attention-Pooling on fine-grained classification datasets.
△ Less
Submitted 22 February, 2022; v1 submitted 9 April, 2021;
originally announced April 2021.
-
Chargrid-OCR: End-to-end Trainable Optical Character Recognition for Printed Documents using Instance Segmentation
Authors:
Christian Reisswig,
Anoop R Katti,
Marco Spinaci,
Johannes Höhne
Abstract:
We present an end-to-end trainable approach for Optical Character Recognition (OCR) on printed documents. Specifically, we propose a model that predicts a) a two-dimensional character grid (\emph{chargrid}) representation of a document image as a semantic segmentation task and b) character boxes for delineating character instances as an object detection task. For training the model, we build two l…
▽ More
We present an end-to-end trainable approach for Optical Character Recognition (OCR) on printed documents. Specifically, we propose a model that predicts a) a two-dimensional character grid (\emph{chargrid}) representation of a document image as a semantic segmentation task and b) character boxes for delineating character instances as an object detection task. For training the model, we build two large-scale datasets without resorting to any manual annotation - synthetic documents with clean labels and real documents with noisy labels. We demonstrate experimentally that our method, trained on the combination of these datasets, (i) outperforms previous state-of-the-art approaches in accuracy (ii) is easily parallelizable on GPU and is, therefore, significantly faster and (iii) is easy to train and adapt to a new domain.
△ Less
Submitted 27 February, 2020; v1 submitted 10 September, 2019;
originally announced September 2019.
-
Chargrid: Towards Understanding 2D Documents
Authors:
Anoop Raveendra Katti,
Christian Reisswig,
Cordula Guder,
Sebastian Brarda,
Steffen Bickel,
Johannes Höhne,
Jean Baptiste Faddoul
Abstract:
We introduce a novel type of text representation that preserves the 2D layout of a document. This is achieved by encoding each document page as a two-dimensional grid of characters. Based on this representation, we present a generic document understanding pipeline for structured documents. This pipeline makes use of a fully convolutional encoder-decoder network that predicts a segmentation mask an…
▽ More
We introduce a novel type of text representation that preserves the 2D layout of a document. This is achieved by encoding each document page as a two-dimensional grid of characters. Based on this representation, we present a generic document understanding pipeline for structured documents. This pipeline makes use of a fully convolutional encoder-decoder network that predicts a segmentation mask and bounding boxes. We demonstrate its capabilities on an information extraction task from invoices and show that it significantly outperforms approaches based on sequential text or document images.
△ Less
Submitted 24 September, 2018;
originally announced September 2018.
-
Development of a dry linear compressor for GM and pulse tube cryocoolers
Authors:
Jens Höhne
Abstract:
Pressure Wave Systems GmbH has developed a dry compressor for GM and pulse tube cryocoolers. The concept is based on hydraulically driven metal bellows in which the Helium working gas is compressed. The system is operated in the region of 1 kW of electrical input power and has been successfully tested with a SHI RDK-101D GM cryocooler cold head. Set-up, performance and reliability of the compresso…
▽ More
Pressure Wave Systems GmbH has developed a dry compressor for GM and pulse tube cryocoolers. The concept is based on hydraulically driven metal bellows in which the Helium working gas is compressed. The system is operated in the region of 1 kW of electrical input power and has been successfully tested with a SHI RDK-101D GM cryocooler cold head. Set-up, performance and reliability of the compressor system will be discussed.
△ Less
Submitted 29 June, 2015;
originally announced June 2015.
-
Multi-Target Shrinkage
Authors:
Daniel Bartz,
Johannes Höhne,
Klaus-Robert Müller
Abstract:
Stein showed that the multivariate sample mean is outperformed by "shrinking" to a constant target vector. Ledoit and Wolf extended this approach to the sample covariance matrix and proposed a multiple of the identity as shrinkage target. In a general framework, independent of a specific estimator, we extend the shrinkage concept by allowing simultaneous shrinkage to a set of targets. Application…
▽ More
Stein showed that the multivariate sample mean is outperformed by "shrinking" to a constant target vector. Ledoit and Wolf extended this approach to the sample covariance matrix and proposed a multiple of the identity as shrinkage target. In a general framework, independent of a specific estimator, we extend the shrinkage concept by allowing simultaneous shrinkage to a set of targets. Application scenarios include settings with (A) additional data sets from potentially similar distributions, (B) non-stationarity, (C) a natural grou** of the data or (D) multiple alternative estimators which could serve as targets.
We show that this Multi-Target Shrinkage can be translated into a quadratic program and derive conditions under which the estimation of the shrinkage intensities yields optimal expected squared error in the limit. For the sample mean and the sample covariance as specific instances, we derive conditions under which the optimality of MTS is applicable. We consider two asymptotic settings: the large dimensional limit (LDL), where the dimensionality and the number of observations go to infinity at the same rate, and the finite observations large dimensional limit (FOLDL), where only the dimensionality goes to infinity while the number of observations remains constant. We then show the effectiveness in extensive simulations and on real world data.
△ Less
Submitted 5 December, 2014;
originally announced December 2014.
