-
Towards Interpretable Reinforcement Learning with Constrained Normalizing Flow Policies
Authors:
Finn Rietz,
Erik Schaffernicht,
Stefan Heinrich,
Johannes A. Stork
Abstract:
Reinforcement learning policies are typically represented by black-box neural networks, which are non-interpretable and not well-suited for safety-critical domains. To address both of these issues, we propose constrained normalizing flow policies as interpretable and safe-by-construction policy models. We achieve safety for reinforcement learning problems with instantaneous safety constraints, for…
▽ More
Reinforcement learning policies are typically represented by black-box neural networks, which are non-interpretable and not well-suited for safety-critical domains. To address both of these issues, we propose constrained normalizing flow policies as interpretable and safe-by-construction policy models. We achieve safety for reinforcement learning problems with instantaneous safety constraints, for which we can exploit domain knowledge by analytically constructing a normalizing flow that ensures constraint satisfaction. The normalizing flow corresponds to an interpretable sequence of transformations on action samples, each ensuring alignment with respect to a particular constraint. Our experiments reveal benefits beyond interpretability in an easier learning objective and maintained constraint satisfaction throughout the entire learning process. Our approach leverages constraints over reward engineering while offering enhanced interpretability, safety, and direct means of providing domain knowledge to the agent without relying on complex reward functions.
△ Less
Submitted 2 May, 2024;
originally announced May 2024.
-
Randomized Complexity of Mean Computation and the Adaption Problem
Authors:
Stefan Heinrich
Abstract:
Recently the adaption problem of Information-Based Complexity (IBC) for linear problems in the randomized setting was solved in Heinrich (J. Complexity 82, 2024, 101821). Several papers treating further aspects of this problem followed. However, all examples obtained so far were vector-valued. In this paper we settle the scalar-valued case. We study the complexity of mean computation in finite dim…
▽ More
Recently the adaption problem of Information-Based Complexity (IBC) for linear problems in the randomized setting was solved in Heinrich (J. Complexity 82, 2024, 101821). Several papers treating further aspects of this problem followed. However, all examples obtained so far were vector-valued. In this paper we settle the scalar-valued case. We study the complexity of mean computation in finite dimensional sequence spaces with mixed $L_p^N$ norms. We determine the $n$-th minimal errors in the randomized adaptive and non-adaptive setting. It turns out that among the problems considered there are examples where adaptive and non-adaptive $n$-th minimal errors deviate by a power of $n$. The gap can be (up to log factors) of the order $n^{1/4}$. We also show how to turn such results into infinite dimensional examples with suitable deviation for all $n$ simultaneously.
△ Less
Submitted 25 January, 2024;
originally announced January 2024.
-
An innovative dose rate independent 2D Ce-doped YAG scintillating dosimetry system for time resolved beam monitoring in ultra-high dose rate electron FLASH radiation therapy
Authors:
Verdi Vanreusel,
Sophie Heinrich,
Thomas De Kerf,
Paul Leblans,
Dirk Vandenbroucke,
Steve Vanlanduit,
Dirk Verellen,
Alessia Gasparini,
Luana de Freitas Nascimento
Abstract:
FLASH-RT has proven beneficial in preclinical studies. However, the lack of accurate real time 2D dosimetry is a limiting factor. In this work, an innovative solution for 2D real time dosimetry in UHDR electron beams is presented. The in-house developed ImageDosis system consists of a scientific camera, with high temporal resolution, and a coating, containing 12% of Y$_3$Al$_5$O$_{12}$:Ce$^{3+}$ a…
▽ More
FLASH-RT has proven beneficial in preclinical studies. However, the lack of accurate real time 2D dosimetry is a limiting factor. In this work, an innovative solution for 2D real time dosimetry in UHDR electron beams is presented. The in-house developed ImageDosis system consists of a scientific camera, with high temporal resolution, and a coating, containing 12% of Y$_3$Al$_5$O$_{12}$:Ce$^{3+}$ as scintillating material. Reference dosimetry was performed by means of radiochromic film, and a (C$_{38}$H$_{34}$P$_2$)MnBr$_4$ point scintillator was used to validate the pulse discrimination properties of the ImageDosis system. Irradiations were performed in two centers (Antwerp and Orsay), with an ElectronFlash accelerator, with varying number of pulses, pulse length, pulse repetition frequency (PRF) and energy. Also, the temporal resolution and 2D properties were investigated. For doses > 3.5 Gy, the ImageDosis showed a linear dose response up to at least 13 Gy. No dose rate dependence was found for an average dose rate up to 140 Gy/s, a dose per pulse up to 2 Gy and a PRF up to 300 Hz. The ImageDosis system showed capable of measuring the dose of the individual pulses up to a PRF of 250 Hz, but did not detect 3% of the pulses, because these pulses were delivered during the dead time of the camera. The maximal difference in FWHM of the field size between the ImageDosis system and the reference was 3.6%. For a nominal field size of 100 mm and 120 mm, a decreased output was observed on the superior part of the field. The ImageDosis system showed linear dose response and no dose rate nor energy dependence. It showed capable of discriminating and measuring the dose of individual pulses and promising 2D characteristics that need further optimization.
△ Less
Submitted 29 January, 2024; v1 submitted 21 November, 2023;
originally announced November 2023.
-
Prioritized Soft Q-Decomposition for Lexicographic Reinforcement Learning
Authors:
Finn Rietz,
Erik Schaffernicht,
Stefan Heinrich,
Johannes Andreas Stork
Abstract:
Reinforcement learning (RL) for complex tasks remains a challenge, primarily due to the difficulties of engineering scalar reward functions and the inherent inefficiency of training models from scratch. Instead, it would be better to specify complex tasks in terms of elementary subtasks and to reuse subtask solutions whenever possible. In this work, we address continuous space lexicographic multi-…
▽ More
Reinforcement learning (RL) for complex tasks remains a challenge, primarily due to the difficulties of engineering scalar reward functions and the inherent inefficiency of training models from scratch. Instead, it would be better to specify complex tasks in terms of elementary subtasks and to reuse subtask solutions whenever possible. In this work, we address continuous space lexicographic multi-objective RL problems, consisting of prioritized subtasks, which are notoriously difficult to solve. We show that these can be scalarized with a subtask transformation and then solved incrementally using value decomposition. Exploiting this insight, we propose prioritized soft Q-decomposition (PSQD), a novel algorithm for learning and adapting subtask solutions under lexicographic priorities in continuous state-action spaces. PSQD offers the ability to reuse previously learned subtask solutions in a zero-shot composition, followed by an adaptation step. Its ability to use retained subtask training data for offline learning eliminates the need for new environment interaction during adaptation. We demonstrate the efficacy of our approach by presenting successful learning, reuse, and adaptation results for both low- and high-dimensional simulated robot control tasks, as well as offline learning results. In contrast to baseline approaches, PSQD does not trade off between conflicting subtasks or priority constraints and satisfies subtask priorities during learning. PSQD provides an intuitive framework for tackling complex RL problems, offering insights into the inner workings of the subtask composition.
△ Less
Submitted 2 May, 2024; v1 submitted 3 October, 2023;
originally announced October 2023.
-
Module Monoidal Categories as Categorification of Associative Algebras
Authors:
Sebastian Heinrich
Abstract:
In [arXiv:1509.02937], the notion of a module tensor category was introduced as a braided monoidal central functor $F\colon \mathcal{V}\longrightarrow \mathcal{T}$ from a braided monoidal category $\mathcal{V}$ to a monoidal category $\mathcal{T}$, which is a monoidal functor $F\colon \mathcal{V}\longrightarrow\mathcal{T}$ together with a braided monoidal lift…
▽ More
In [arXiv:1509.02937], the notion of a module tensor category was introduced as a braided monoidal central functor $F\colon \mathcal{V}\longrightarrow \mathcal{T}$ from a braided monoidal category $\mathcal{V}$ to a monoidal category $\mathcal{T}$, which is a monoidal functor $F\colon \mathcal{V}\longrightarrow\mathcal{T}$ together with a braided monoidal lift $F^Z\colon \mathcal{V}\longrightarrow Z(\mathcal{T})$ to the Drinfeld center of $\mathcal{T}$. This is a categorification of a unital associative algebra $A$ over a commutative ring $R$ via a ring homomorphism $f\colon R\longrightarrow Z(A)$ into the center of $A$. In this paper, we want to categorify the characterization of an associative algebra as a (not necessarily unital) ring $A$ together with an $R$-module structure over a commutative ring $R$, such that multiplication in $A$ and action of $R$ on $A$ are compatible. In doing so, we introduce the more general notion of non-unital module monoidal categories and obtain 2-categories of non-unital and unital module monoidal categories, their functors and natural transformations. We will show that in the unital case the latter definition is equivalent to the definition in [arXiv:1509.02937] by explicitly writing down an equivalence of 2-categories.
△ Less
Submitted 21 November, 2023; v1 submitted 21 September, 2023;
originally announced September 2023.
-
Randomized Complexity of Vector-Valued Approximation
Authors:
Stefan Heinrich
Abstract:
We study the randomized $n$-th minimal errors (and hence the complexity) of vector valued approximation. In a recent paper by the author [Randomized complexity of parametric integration and the role of adaption I. Finite dimensional case (preprint)] a long-standing problem of Information-Based Complexity was solved: Is there a constant $c>0$ such that for all linear problems $\mathcal{P}$ the rand…
▽ More
We study the randomized $n$-th minimal errors (and hence the complexity) of vector valued approximation. In a recent paper by the author [Randomized complexity of parametric integration and the role of adaption I. Finite dimensional case (preprint)] a long-standing problem of Information-Based Complexity was solved: Is there a constant $c>0$ such that for all linear problems $\mathcal{P}$ the randomized non-adaptive and adaptive $n$-th minimal errors can deviate at most by a factor of $c$? That is, does the following hold for all linear $\mathcal{P}$ and $n\in {\mathbb N}$ \begin{equation*} e_n^{\rm ran-non} (\mathcal{P})\le ce_n^{\rm ran} (\mathcal{P}) \, {\bf ?} \end{equation*} The analysis of vector-valued mean computation showed that the answer is negative. More precisely, there are instances of this problem where the gap between non-adaptive and adaptive randomized minimal errors can be (up to log factors) of the order $n^{1/8}$. This raises the question about the maximal possible deviation. In this paper we show that for certain instances of vector valued approximation the gap is $n^{1/2}$ (again, up to log factors).
△ Less
Submitted 23 June, 2023;
originally announced June 2023.
-
Randomized Complexity of Parametric Integration and the Role of Adaption II. Sobolev Spaces
Authors:
Stefan Heinrich
Abstract:
We study the complexity of randomized computation of integrals depending on a parameter, with integrands from Sobolev spaces. That is, for $r,d_1,d_2\in{\mathbb N}$, $1\le p,q\le \infty$, $D_1= [0,1]^{d_1}$, and $D_2= [0,1]^{d_2}$ we are given $f\in W_p^r(D_1\times D_2)$ and we seek to approximate $$ Sf=\int_{D_2}f(s,t)dt\quad (s\in D_1), $$ with error measured in the $L_q(D_1)$-norm. Our results…
▽ More
We study the complexity of randomized computation of integrals depending on a parameter, with integrands from Sobolev spaces. That is, for $r,d_1,d_2\in{\mathbb N}$, $1\le p,q\le \infty$, $D_1= [0,1]^{d_1}$, and $D_2= [0,1]^{d_2}$ we are given $f\in W_p^r(D_1\times D_2)$ and we seek to approximate $$ Sf=\int_{D_2}f(s,t)dt\quad (s\in D_1), $$ with error measured in the $L_q(D_1)$-norm. Our results extend previous work of Heinrich and Sindambiwe (J.\ Complexity, 15 (1999), 317--341) for $p=q=\infty$ and Wiegand (Shaker Verlag, 2006) for $1\le p=q<\infty$. Wiegand's analysis was carried out under the assumption that $W_p^r(D_1\times D_2)$ is continuously embedded in $C(D_1\times D_2)$ (embedding condition). We also study the case that the embedding condition does not hold.
For this purpose a new ingredient is developed -- a stochastic discretization technique.
The paper is based on Part I, where vector valued mean computation -- the finite-dimensional counterpart of parametric integration -- was studied.
In Part I a basic problem of Information-Based Complexity on the power of adaption for linear problems in the randomized setting was solved. Here a further aspect of this problem is settled.
△ Less
Submitted 23 June, 2023;
originally announced June 2023.
-
Randomized Complexity of Parametric Integration and the Role of Adaption I. Finite Dimensional Case
Authors:
Stefan Heinrich
Abstract:
We study the randomized $n$-th minimal errors (and hence the complexity) of vector valued mean computation, which is the discrete version of parametric integration. The results of the present paper form the basis for the complexity analysis of parametric integration in Sobolev spaces, which will be presented in Part 2. Altogether this extends previous results of Heinrich and Sindambiwe (J.\ Comple…
▽ More
We study the randomized $n$-th minimal errors (and hence the complexity) of vector valued mean computation, which is the discrete version of parametric integration. The results of the present paper form the basis for the complexity analysis of parametric integration in Sobolev spaces, which will be presented in Part 2. Altogether this extends previous results of Heinrich and Sindambiwe (J.\ Complexity, 15 (1999), 317--341) and Wiegand (Shaker Verlag, 2006). Moreover, a basic problem of Information-Based Complexity on the power of adaption for linear problems in the randomized setting is solved.
△ Less
Submitted 23 June, 2023;
originally announced June 2023.
-
ShaRPy: Shape Reconstruction and Hand Pose Estimation from RGB-D with Uncertainty
Authors:
Vanessa Wirth,
Anna-Maria Liphardt,
Birte Coppers,
Johanna Bräunig,
Simon Heinrich,
Sigrid Leyendecker,
Arnd Kleyer,
Georg Schett,
Martin Vossiek,
Bernhard Egger,
Marc Stamminger
Abstract:
Despite their potential, markerless hand tracking technologies are not yet applied in practice to the diagnosis or monitoring of the activity in inflammatory musculoskeletal diseases. One reason is that the focus of most methods lies in the reconstruction of coarse, plausible poses, whereas in the clinical context, accurate, interpretable, and reliable results are required. Therefore, we propose S…
▽ More
Despite their potential, markerless hand tracking technologies are not yet applied in practice to the diagnosis or monitoring of the activity in inflammatory musculoskeletal diseases. One reason is that the focus of most methods lies in the reconstruction of coarse, plausible poses, whereas in the clinical context, accurate, interpretable, and reliable results are required. Therefore, we propose ShaRPy, the first RGB-D Shape Reconstruction and hand Pose tracking system, which provides uncertainty estimates of the computed pose, e.g., when a finger is hidden or its estimate is inconsistent with the observations in the input, to guide clinical decision-making. Besides pose, ShaRPy approximates a personalized hand shape, promoting a more realistic and intuitive understanding of its digital twin. Our method requires only a light-weight setup with a single consumer-level RGB-D camera yet it is able to distinguish similar poses with only small joint angle deviations in a metrically accurate space. This is achieved by combining a data-driven dense correspondence predictor with traditional energy minimization. To bridge the gap between interactive visualization and biomedical simulation we leverage a parametric hand model in which we incorporate biomedical constraints and optimize for both, its pose and hand shape. We evaluate ShaRPy on a keypoint detection benchmark and show qualitative results of hand function assessments for activity monitoring of musculoskeletal diseases.
△ Less
Submitted 12 September, 2023; v1 submitted 17 March, 2023;
originally announced March 2023.
-
Quantum Fluid Dynamics on the Hypersphere
Authors:
Stuart Heinrich
Abstract:
It is known from quantum mechanics that particles are associated with wave functions, and that the probability of observing a particle at some future location is proportional to the squared modulus of the amplitude of its wave function. Although this statistical relationship is well quantified, the interpretations have remained controversial, with many split between the classical Copenhagen interp…
▽ More
It is known from quantum mechanics that particles are associated with wave functions, and that the probability of observing a particle at some future location is proportional to the squared modulus of the amplitude of its wave function. Although this statistical relationship is well quantified, the interpretations have remained controversial, with many split between the classical Copenhagen interpretation and some variation of the de Broglie-Bohm pilot wave models. Recent experiments with Hydrodynamic Quantum Analogs (HQAs) have demonstrated that droplets of real fluid may achieve stable dynamical states, where interaction of the droplets with their own ripples results in motion analogous to the motion of particles subject to the guiding equation under the pilot wave models. Indeed, many effects previously thought to be exclusively quantum have now been observed as emergent phenomena in these macroscopic HQAs. This has motivated us to explore the possibility that quantum mechanics may actually be the result of fluid dynamics on some real quantum scale fluid. In this paper, we show that if there is a real quantum scale fluid having dynamics analogous to the fluid in HQAs, then this fluid must be a superfluid, and the dynamics of that fluid must take place on the surface of a 4-dimensional hypersphere. Under the influence of cosmological inflation, we further show that these bouncing droplets would have the illusion of a property analogous to rest mass, and that the principles of inertia, momentum, mass-energy equivalence, general relativity, the uncertainty principle and the appearance of a time-like dimension can all be derived for droplets as purely emergent phenomena from the fluid dynamics of this system. As such, we believe that this model merits consideration as a potential foundation for a new unifying theory of physics at all scales.
△ Less
Submitted 10 October, 2022; v1 submitted 20 September, 2022;
originally announced September 2022.
-
Detection of Furigana Text in Images
Authors:
Nikolaj Kjøller Bjerregaard,
Veronika Cheplygina,
Stefan Heinrich
Abstract:
Furigana are pronunciation notes used in Japanese writing. Being able to detect these can help improve optical character recognition (OCR) performance or make more accurate digital copies of Japanese written media by correctly displaying furigana. This project focuses on detecting furigana in Japanese books and comics. While there has been research into the detection of Japanese text in general, t…
▽ More
Furigana are pronunciation notes used in Japanese writing. Being able to detect these can help improve optical character recognition (OCR) performance or make more accurate digital copies of Japanese written media by correctly displaying furigana. This project focuses on detecting furigana in Japanese books and comics. While there has been research into the detection of Japanese text in general, there are currently no proposed methods for detecting furigana.
We construct a new dataset containing Japanese written media and annotations of furigana. We propose an evaluation metric for such data which is similar to the evaluation protocols used in object detection except that it allows groups of objects to be labeled by one annotation. We propose a method for detection of furigana that is based on mathematical morphology and connected component analysis. We evaluate the detections of the dataset and compare different methods for text extraction. We also evaluate different types of images such as books and comics individually and discuss the challenges of each type of image.
The proposed method reaches an F1-score of 76\% on the dataset. The method performs well on regular books, but less so on comics, and books of irregular format. Finally, we show that the proposed method can improve the performance of OCR by 5\% on the manga109 dataset.
Source code is available via \texttt{\url{https://github.com/nikolajkb/FuriganaDetection}}
△ Less
Submitted 8 July, 2022;
originally announced July 2022.
-
Lower bounds for the number of random bits in Monte Carlo algorithms
Authors:
Stefan Heinrich
Abstract:
We continue the study of restricted Monte Carlo algorithms in a general setting. Here we show a lower bound for minimal errors in the setting with finite restriction in terms of deterministic minimal errors. This generalizes a result of Heinrich, Novak, and Pfeiffer, 2004 to the adaptive setting. As a consequence, the lower bounds on the number of random bits from that paper also hold in this sett…
▽ More
We continue the study of restricted Monte Carlo algorithms in a general setting. Here we show a lower bound for minimal errors in the setting with finite restriction in terms of deterministic minimal errors. This generalizes a result of Heinrich, Novak, and Pfeiffer, 2004 to the adaptive setting. As a consequence, the lower bounds on the number of random bits from that paper also hold in this setting. We also derive a lower bound on the number of needed bits for integration of Lipschitz functions over the Wiener space, complementing a result of Giles, Hefter, Mayer, and Ritter, arXiv:1808.10623.
△ Less
Submitted 23 December, 2020;
originally announced December 2020.
-
Crossmodal Language Grounding in an Embodied Neurocognitive Model
Authors:
Stefan Heinrich,
Yuan Yao,
Tobias Hinz,
Zhiyuan Liu,
Thomas Hummel,
Matthias Kerzel,
Cornelius Weber,
Stefan Wermter
Abstract:
Human infants are able to acquire natural language seemingly easily at an early age. Their language learning seems to occur simultaneously with learning other cognitive functions as well as with playful interactions with the environment and caregivers. From a neuroscientific perspective, natural language is embodied, grounded in most, if not all, sensory and sensorimotor modalities, and acquired b…
▽ More
Human infants are able to acquire natural language seemingly easily at an early age. Their language learning seems to occur simultaneously with learning other cognitive functions as well as with playful interactions with the environment and caregivers. From a neuroscientific perspective, natural language is embodied, grounded in most, if not all, sensory and sensorimotor modalities, and acquired by means of crossmodal integration. However, characterising the underlying mechanisms in the brain is difficult and explaining the grounding of language in crossmodal perception and action remains challenging. In this paper, we present a neurocognitive model for language grounding which reflects bio-inspired mechanisms such as an implicit adaptation of timescales as well as end-to-end multimodal abstraction. It addresses developmental robotic interaction and extends its learning capabilities using larger-scale knowledge-based data. In our scenario, we utilise the humanoid robot NICO in obtaining the EMIL data collection, in which the cognitive robot interacts with objects in a children's playground environment while receiving linguistic labels from a caregiver. The model analysis shows that crossmodally integrated representations are sufficient for acquiring language merely from sensory input through interaction with objects in an environment. The representations self-organise hierarchically and embed temporal and spatial information through composition and decomposition. This model can also provide the basis for further crossmodal integration of perceptually grounded cognitive representations.
△ Less
Submitted 16 October, 2020; v1 submitted 24 June, 2020;
originally announced June 2020.
-
Semantic Object Accuracy for Generative Text-to-Image Synthesis
Authors:
Tobias Hinz,
Stefan Heinrich,
Stefan Wermter
Abstract:
Generative adversarial networks conditioned on textual image descriptions are capable of generating realistic-looking images. However, current methods still struggle to generate images based on complex image captions from a heterogeneous domain. Furthermore, quantitatively evaluating these text-to-image models is challenging, as most evaluation metrics only judge image quality but not the conformi…
▽ More
Generative adversarial networks conditioned on textual image descriptions are capable of generating realistic-looking images. However, current methods still struggle to generate images based on complex image captions from a heterogeneous domain. Furthermore, quantitatively evaluating these text-to-image models is challenging, as most evaluation metrics only judge image quality but not the conformity between the image and its caption. To address these challenges we introduce a new model that explicitly models individual objects within an image and a new evaluation metric called Semantic Object Accuracy (SOA) that specifically evaluates images given an image caption. The SOA uses a pre-trained object detector to evaluate if a generated image contains objects that are mentioned in the image caption, e.g. whether an image generated from "a car driving down the street" contains a car. We perform a user study comparing several text-to-image models and show that our SOA metric ranks the models the same way as humans, whereas other metrics such as the Inception Score do not. Our evaluation also shows that models which explicitly model objects outperform models which only model global image characteristics.
△ Less
Submitted 2 June, 2020; v1 submitted 29 October, 2019;
originally announced October 2019.
-
Generating Multiple Objects at Spatially Distinct Locations
Authors:
Tobias Hinz,
Stefan Heinrich,
Stefan Wermter
Abstract:
Recent improvements to Generative Adversarial Networks (GANs) have made it possible to generate realistic images in high resolution based on natural language descriptions such as image captions. Furthermore, conditional GANs allow us to control the image generation process through labels or even natural language descriptions. However, fine-grained control of the image layout, i.e. where in the ima…
▽ More
Recent improvements to Generative Adversarial Networks (GANs) have made it possible to generate realistic images in high resolution based on natural language descriptions such as image captions. Furthermore, conditional GANs allow us to control the image generation process through labels or even natural language descriptions. However, fine-grained control of the image layout, i.e. where in the image specific objects should be located, is still difficult to achieve. This is especially true for images that should contain multiple distinct objects at different spatial locations. We introduce a new approach which allows us to control the location of arbitrarily many objects within an image by adding an object pathway to both the generator and the discriminator. Our approach does not need a detailed semantic layout but only bounding boxes and the respective labels of the desired objects are needed. The object pathway focuses solely on the individual objects and is iteratively applied at the locations specified by the bounding boxes. The global pathway focuses on the image background and the general image layout. We perform experiments on the Multi-MNIST, CLEVR, and the more complex MS-COCO data set. Our experiments show that through the use of the object pathway we can control object locations within images and can model complex scenes with multiple objects at various locations. We further show that the object pathway focuses on the individual objects and learns features relevant for these, while the global pathway focuses on global image characteristics and the image background.
△ Less
Submitted 3 January, 2019;
originally announced January 2019.
-
Photonic glass for high contrast structural color
Authors:
Guoliang Shang,
Lukas Maiwald,
Hagen Renner,
Dirk Jalas,
Maksym Dosta,
Stefan Heinrich,
Alexander Yu. Petrov,
Manfred Eich
Abstract:
Non-iridescent structural colors based on disordered arrangement of monodisperse spherical particles, also called photonic glass, show low color saturation due to gradual transition in reflectivity. No significant improvement is usually expected from particles optimization, as the Mie resonances are broad for small dielectric particles with moderate refractive index. Moreover, the short range orde…
▽ More
Non-iridescent structural colors based on disordered arrangement of monodisperse spherical particles, also called photonic glass, show low color saturation due to gradual transition in reflectivity. No significant improvement is usually expected from particles optimization, as the Mie resonances are broad for small dielectric particles with moderate refractive index. Moreover, the short range order of a photonic glass alone is also insufficient to cause sharp spectral features. We show here, that the combination of a well-chosen particle geometry with the short range order of a photonic glass has strong synergetic effects. We demonstrate how core-shell particles can be used to obtain a sharp transition in the reflection spectrum of photonic glass which is essential to achieve a strong color saturation. The Fourier transform required for a highly saturated color can be achieved by shifting the first zero position of the motif Fourier transform to smaller wave numbers in respect to the peak of the lattice Fourier transform. We show that this can be obtained by choosing a non-monotonous refractive index distribution from the center of the particle through the shell and into the background material. The first-order theoretical predictions are confirmed by numerical simulations.
△ Less
Submitted 28 February, 2018;
originally announced February 2018.
-
Interactive Natural Language Acquisition in a Multi-modal Recurrent Neural Architecture
Authors:
Stefan Heinrich,
Stefan Wermter
Abstract:
For the complex human brain that enables us to communicate in natural language, we gathered good understandings of principles underlying language acquisition and processing, knowledge about socio-cultural conditions, and insights about activity patterns in the brain. However, we were not yet able to understand the behavioural and mechanistic characteristics for natural language and how mechanisms…
▽ More
For the complex human brain that enables us to communicate in natural language, we gathered good understandings of principles underlying language acquisition and processing, knowledge about socio-cultural conditions, and insights about activity patterns in the brain. However, we were not yet able to understand the behavioural and mechanistic characteristics for natural language and how mechanisms in the brain allow to acquire and process language. In bridging the insights from behavioural psychology and neuroscience, the goal of this paper is to contribute a computational understanding of appropriate characteristics that favour language acquisition. Accordingly, we provide concepts and refinements in cognitive modelling regarding principles and mechanisms in the brain and propose a neurocognitively plausible model for embodied language acquisition from real world interaction of a humanoid robot with its environment. In particular, the architecture consists of a continuous time recurrent neural network, where parts have different leakage characteristics and thus operate on multiple timescales for every modality and the association of the higher level nodes of all modalities into cell assemblies. The model is capable of learning language production grounded in both, temporal dynamic somatosensation and vision, and features hierarchical concept abstraction, concept decomposition, multi-modal integration, and self-organisation of latent representations.
△ Less
Submitted 7 February, 2018; v1 submitted 24 March, 2017;
originally announced March 2017.
-
On the randomized complexity of Banach space valued integration
Authors:
Stefan Heinrich,
Aicke Hinrichs
Abstract:
We study the complexity of Banach space valued integration in the randomized setting. We are concerned with $r$-times continuously differentiable functions on the $d$-dimensional unit cube $Q$, with values in a Banach space $X$, and investigate the relation of the optimal convergence rate to the geometry of $X$. It turns out that the $n$-th minimal errors are bounded by $cn^{-r/d-1+1/p}$ if and on…
▽ More
We study the complexity of Banach space valued integration in the randomized setting. We are concerned with $r$-times continuously differentiable functions on the $d$-dimensional unit cube $Q$, with values in a Banach space $X$, and investigate the relation of the optimal convergence rate to the geometry of $X$. It turns out that the $n$-th minimal errors are bounded by $cn^{-r/d-1+1/p}$ if and only if $X$ is of equal norm type $p$.
△ Less
Submitted 11 December, 2013;
originally announced December 2013.
-
Public Key Infrastructure based on Authentication of Media Attestments
Authors:
Stuart Heinrich
Abstract:
Many users would prefer the privacy of end-to-end encryption in their online communications if it can be done without significant inconvenience. However, because existing key distribution methods cannot be fully trusted enough for automatic use, key management has remained a user problem. We propose a fundamentally new approach to the key distribution problem by empowering end-users with the capac…
▽ More
Many users would prefer the privacy of end-to-end encryption in their online communications if it can be done without significant inconvenience. However, because existing key distribution methods cannot be fully trusted enough for automatic use, key management has remained a user problem. We propose a fundamentally new approach to the key distribution problem by empowering end-users with the capacity to independently verify the authenticity of public keys using an additional media attestment. This permits client software to automatically lookup public keys from a keyserver without trusting the keyserver, because any attempted MITM attacks can be detected by end-users. Thus, our protocol is designed to enable a new breed of messaging clients with true end-to-end encryption built in, without the hassle of requiring users to manually manage the public keys, that is verifiably secure against MITM attacks, and does not require trusting any third parties.
△ Less
Submitted 27 November, 2013;
originally announced November 2013.
-
GRED: Graph-Regularized 3D Shape Reconstruction from Highly Anisotropic and Noisy Images
Authors:
Christian Widmer,
Philipp Drewe,
Xinghua Lou,
Shefali Umrania,
Stephanie Heinrich,
Gunnar Rätsch
Abstract:
Analysis of microscopy images can provide insight into many biological processes. One particularly challenging problem is cell nuclear segmentation in highly anisotropic and noisy 3D image data. Manually localizing and segmenting each and every cell nuclei is very time consuming, which remains a bottleneck in large scale biological experiments. In this work we present a tool for automated segmenta…
▽ More
Analysis of microscopy images can provide insight into many biological processes. One particularly challenging problem is cell nuclear segmentation in highly anisotropic and noisy 3D image data. Manually localizing and segmenting each and every cell nuclei is very time consuming, which remains a bottleneck in large scale biological experiments. In this work we present a tool for automated segmentation of cell nuclei from 3D fluorescent microscopic data. Our tool is based on state-of-the-art image processing and machine learning techniques and supports a friendly graphical user interface (GUI). We show that our tool is as accurate as manual annotation but greatly reduces the time for the registration.
△ Less
Submitted 17 September, 2013;
originally announced September 2013.
-
Physical Relativism as an Interpretation of Existence
Authors:
Stuart Heinrich
Abstract:
Despite the success of modern physics in formulating mathematical theories that can predict the outcome of quantum-scale experiments, the physical interpretations of these theories remain controversial. In this manuscript, we propose a new interpretation of existence that we call physical relativism. Under physical relativism, the difference between mathematical existence and physical existence is…
▽ More
Despite the success of modern physics in formulating mathematical theories that can predict the outcome of quantum-scale experiments, the physical interpretations of these theories remain controversial. In this manuscript, we propose a new interpretation of existence that we call physical relativism. Under physical relativism, the difference between mathematical existence and physical existence is clarified, and Wheeler's `it from bit' viewpoint can be objectively evaluated. In addition, physical relativism provides a simple answer to the question of why the universe exists at all, and permits us to derive the maximally biophilic principle, a generalization of the anthropic principle that ascribes high prior likelihood to the observation of a universe with simple physical laws supporting the overall concepts of time, space and the emergent evolution of life.
△ Less
Submitted 5 December, 2013; v1 submitted 23 June, 2013;
originally announced June 2013.
-
The Relativity of Existence
Authors:
Stuart Heinrich
Abstract:
Despite the success of modern physics in formulating mathematical theories that can predict the outcome of experiments, we have made remarkably little progress towards answering the most fundamental question of: why is there a universe at all, as opposed to nothingness? In this paper, it is shown that this seemingly mind-boggling question has a simple logical answer if we accept that existence in…
▽ More
Despite the success of modern physics in formulating mathematical theories that can predict the outcome of experiments, we have made remarkably little progress towards answering the most fundamental question of: why is there a universe at all, as opposed to nothingness? In this paper, it is shown that this seemingly mind-boggling question has a simple logical answer if we accept that existence in the universe is nothing more than mathematical existence relative to the axioms of our universe. This premise is not baseless; it is shown here that there are indeed several independent strong logical arguments for why we should believe that mathematical existence is the only kind of existence. Moreover, it is shown that, under this premise, the answers to many other puzzling questions about our universe come almost immediately. Among these questions are: why is the universe apparently fine-tuned to be able to support life? Why are the laws of physics so elegant? Why do we have three dimensions of space and one of time, with approximate locality and causality at macroscopic scales? How can the universe be non-local and non-causal at the quantum scale? How can the laws of quantum mechanics rely on true randomness?
△ Less
Submitted 23 August, 2012; v1 submitted 21 February, 2012;
originally announced February 2012.
-
Internal Constraints of the Trifocal Tensor
Authors:
Stuart B. Heinrich,
Wesley E. Snyder
Abstract:
The fundamental matrix and trifocal tensor are convenient algebraic representations of the epipolar geometry of two and three view configurations, respectively. The estimation of these entities is central to most reconstruction algorithms, and a solid understanding of their properties and constraints is therefore very important. The fundamental matrix has 1 internal constraint which is well unders…
▽ More
The fundamental matrix and trifocal tensor are convenient algebraic representations of the epipolar geometry of two and three view configurations, respectively. The estimation of these entities is central to most reconstruction algorithms, and a solid understanding of their properties and constraints is therefore very important. The fundamental matrix has 1 internal constraint which is well understood, whereas the trifocal tensor has 8 independent algebraic constraints. The internal tensor constraints can be represented in many ways, although there is only one minimal and sufficient set of 8 constraints known. In this paper, we derive a second set of minimal and sufficient constraints that is simpler. We also show how this can be used in a new parameterization of the trifocal tensor. We hope that this increased understanding of the internal constraints may lead to improved algorithms for estimating the trifocal tensor, although the primary contribution is an improved theoretical understanding.
△ Less
Submitted 30 March, 2011;
originally announced March 2011.
-
Improved Edge Awareness in Discontinuity Preserving Smoothing
Authors:
Stuart B. Heinrich,
Wesley E. Snyder
Abstract:
Discontinuity preserving smoothing is a fundamentally important procedure that is useful in a wide variety of image processing contexts. It is directly useful for noise reduction, and frequently used as an intermediate step in higher level algorithms. For example, it can be particularly useful in edge detection and segmentation. Three well known algorithms for discontinuity preserving smoothing ar…
▽ More
Discontinuity preserving smoothing is a fundamentally important procedure that is useful in a wide variety of image processing contexts. It is directly useful for noise reduction, and frequently used as an intermediate step in higher level algorithms. For example, it can be particularly useful in edge detection and segmentation. Three well known algorithms for discontinuity preserving smoothing are nonlinear anisotropic diffusion, bilateral filtering, and mean shift filtering. Although slight differences make them each better suited to different tasks, all are designed to preserve discontinuities while smoothing. However, none of them satisfy this goal perfectly: they each have exception cases in which smoothing may occur across hard edges. The principal contribution of this paper is the identification of a property we call edge awareness that should be satisfied by any discontinuity preserving smoothing algorithm. This constraint can be incorporated into existing algorithms to improve quality, and usually has negligible changes in runtime performance and/or complexity. We present modifications necessary to augment diffusion and mean shift, as well as a new formulation of the bilateral filter that unifies the spatial and range spaces to achieve edge awareness.
△ Less
Submitted 29 March, 2011;
originally announced March 2011.
-
Multiple testing via successive subdivision
Authors:
Werner Ehm,
Jürgen Kornmeier,
Sven Heinrich
Abstract:
A sequential multiple testing procedure recently introduced by Heinrich, Bach and Kornmeier allows to "zoom in" on, and thus identify regions with highly significant departures from null-hypotheses. The purpose of this note is to state a cognate of this procedure in general form and to prove that it controls the familywise error. Two possible applications are briefly indicated.
A sequential multiple testing procedure recently introduced by Heinrich, Bach and Kornmeier allows to "zoom in" on, and thus identify regions with highly significant departures from null-hypotheses. The purpose of this note is to state a cognate of this procedure in general form and to prove that it controls the familywise error. Two possible applications are briefly indicated.
△ Less
Submitted 30 April, 2009; v1 submitted 13 February, 2009;
originally announced February 2009.
-
Quantum Lower Bounds by Entropy Numbers
Authors:
Stefan Heinrich
Abstract:
We use entropy numbers in combination with the polynomial method to derive a new general lower bound for the n-th minimal error in the quantum setting of information-based complexity. As an application, we improve some lower bounds on quantum approximation of embeddings between finite dimensional L_p spaces and of Sobolev embeddings.
We use entropy numbers in combination with the polynomial method to derive a new general lower bound for the n-th minimal error in the quantum setting of information-based complexity. As an application, we improve some lower bounds on quantum approximation of embeddings between finite dimensional L_p spaces and of Sobolev embeddings.
△ Less
Submitted 30 November, 2006;
originally announced November 2006.
-
The Quantum Query Complexity of Elliptic PDE
Authors:
Stefan Heinrich
Abstract:
The complexity of the following numerical problem is studied in the quantum model of computation: Consider a general elliptic partial differential equation of order 2m in a smooth, bounded domain Q\subset \R^d with smooth coefficients and homogeneous boundary conditions. We seek to approximate the solution on a smooth submanifold M\subseteq Q of dimension 0\le d_1 \le d. With the right hand side…
▽ More
The complexity of the following numerical problem is studied in the quantum model of computation: Consider a general elliptic partial differential equation of order 2m in a smooth, bounded domain Q\subset \R^d with smooth coefficients and homogeneous boundary conditions. We seek to approximate the solution on a smooth submanifold M\subseteq Q of dimension 0\le d_1 \le d. With the right hand side belonging to C^r(Q), and the error being measured in the L_\infty(M) norm, we prove that the n-th minimal quantum error is (up to logarithmic factors) of order n^{-min((r+2m)/d_1,r/d+1)}. For comparison, in the classical deterministic setting the n-th minimal error is known to be of order n^{-r/d}, for all d_1, while in the classical randomized setting it is (up to logarithmic factors) n^{-min((r+2m)/d_1,r/d+1/2)}.
△ Less
Submitted 27 December, 2005;
originally announced December 2005.
-
An Agent-based Manufacturing Management System for Production and Logistics within Cross-Company Regional and National Production Networks
Authors:
S. Heinrich,
H. Durr,
T. Hanel,
J. Lassig
Abstract:
The goal is the development of a simultaneous, dynamic, technological as well as logistical real-time planning and an organizational control of the production by the production units themselves, working in the production network under the use of Multi-Agent-Technology. The design of the multi-agent-based manufacturing management system, the models of the single agents, algorithms for the agent-b…
▽ More
The goal is the development of a simultaneous, dynamic, technological as well as logistical real-time planning and an organizational control of the production by the production units themselves, working in the production network under the use of Multi-Agent-Technology. The design of the multi-agent-based manufacturing management system, the models of the single agents, algorithms for the agent-based, decentralized dispatching of orders, strategies and data management concepts as well as their integration into the SCM, basing on the solution described, will be explained in the following.
Keywords: production engineering and management, dynamic manufacturing planning and control, multi-agentsystems (MAS), supply-chain-management (SCM), e-manufacturing
△ Less
Submitted 18 November, 2005;
originally announced November 2005.
-
On the Power of Quantum Algorithms for Vector Valued Mean Computation
Authors:
Stefan Heinrich
Abstract:
We study computation of the mean of sequences with values in finite dimensional normed spaces and compare the computational power of classical randomized with that of quantum algorithms for this problem. It turns out that in contrast to the known superiority of quantum algorithms in the scalar case, in high dimensional $L_p^M$ spaces classical randomized algorithms are essentially as powerful as…
▽ More
We study computation of the mean of sequences with values in finite dimensional normed spaces and compare the computational power of classical randomized with that of quantum algorithms for this problem. It turns out that in contrast to the known superiority of quantum algorithms in the scalar case, in high dimensional $L_p^M$ spaces classical randomized algorithms are essentially as powerful as quantum algorithms.
△ Less
Submitted 15 March, 2004;
originally announced March 2004.
-
Quantum Boolean Summation with Repetitions in the Worst-Average Setting
Authors:
Stefan Heinrich,
Marek Kwas,
Henryk Wozniakowski
Abstract:
We study the quantum summation QS algorithm of Brassard,
Hoyer, Mosca and Tapp, which approximates the arithmetic mean of a Boolean function defined on $N$ elements. We present sharp error bounds of the QS algorithm in the worst-average setting with the average performance measured in the $L_q$ norm, $q \in [1,\infty]$. We prove that the QS algorithm with $M$ quantum queries, $M<N$, has the wo…
▽ More
We study the quantum summation QS algorithm of Brassard,
Hoyer, Mosca and Tapp, which approximates the arithmetic mean of a Boolean function defined on $N$ elements. We present sharp error bounds of the QS algorithm in the worst-average setting with the average performance measured in the $L_q$ norm, $q \in [1,\infty]$. We prove that the QS algorithm with $M$ quantum queries, $M<N$, has the worst-average error bounds of the form $Θ(\ln M/M)$ for $q=1$, $Θ(M^{-1/q})$ for $q\in (1,\infty)$, and is equal to 1 for $q=\infty$. We also discuss the asymptotic constants of these estimates. We improve the error bounds by using the QS algorithm with repetitions. Using the number of repetitions which is independent of $M$ and linearly dependent on $q$, we get the error bound of order $M^{-1}$ for any $q \in [1,\infty)$. Since $Ω(M^{-1})$ is a lower bound on the worst-average error of any quantum algorithm with $M$ queries, the QS algorithm with repetitions is optimal in the worst-average setting.
△ Less
Submitted 6 November, 2003;
originally announced November 2003.
-
Quantum Approximation II. Sobolev Embeddings
Authors:
Stefan Heinrich
Abstract:
A basic problem of approximation theory, the approximation of functions from the Sobolev space W_p^r([0,1]^d) in the norm of L_q([0,1]^d), is considered from the point of view of quantum computation. We determine the quantum query complexity of this problem (up to logarithmic factors). It turns out that in certain regions of the domain of parameters p,q,r,d quantum computation can reach a speedu…
▽ More
A basic problem of approximation theory, the approximation of functions from the Sobolev space W_p^r([0,1]^d) in the norm of L_q([0,1]^d), is considered from the point of view of quantum computation. We determine the quantum query complexity of this problem (up to logarithmic factors). It turns out that in certain regions of the domain of parameters p,q,r,d quantum computation can reach a speedup of roughly squaring the rate of convergence of classical deterministic or randomized approximation methods. There are other regions were the best possible rates coincide for all three settings.
△ Less
Submitted 6 May, 2003;
originally announced May 2003.
-
Quantum Approximation I. Embeddings of Finite Dimensional L_p Spaces
Authors:
Stefan Heinrich
Abstract:
We study approximation of embeddings between finite dimensional L_p spaces in the quantum model of computation. For the quantum query complexity of this problem matching (up to logarithmic factors) upper and lower bounds are obtained. The results show that for certain regions of the parameter domain quantum computation can essentially improve the rate of convergence of classical deterministic or…
▽ More
We study approximation of embeddings between finite dimensional L_p spaces in the quantum model of computation. For the quantum query complexity of this problem matching (up to logarithmic factors) upper and lower bounds are obtained. The results show that for certain regions of the parameter domain quantum computation can essentially improve the rate of convergence of classical deterministic or randomized approximation, while there are other regions where the best possible rates coincide for all three settings. These results serve as a crucial building block for analyzing approximation in function spaces in a subsequent paper.
△ Less
Submitted 6 May, 2003;
originally announced May 2003.
-
Quantum Integration in Sobolev Classes
Authors:
Stefan Heinrich
Abstract:
We study high dimensional integration in the quantum model of computation. We develop quantum algorithms for integration of functions from Sobolev classes $W^r_p([0,1]^d)$ and analyze their convergence rates. We also prove lower bounds which show that the proposed algorithms are, in many cases, optimal within the setting of quantum computing. This extends recent results of Novak on integration o…
▽ More
We study high dimensional integration in the quantum model of computation. We develop quantum algorithms for integration of functions from Sobolev classes $W^r_p([0,1]^d)$ and analyze their convergence rates. We also prove lower bounds which show that the proposed algorithms are, in many cases, optimal within the setting of quantum computing. This extends recent results of Novak on integration of functions from Hölder classes.
△ Less
Submitted 23 December, 2001;
originally announced December 2001.
-
From Monte Carlo to Quantum Computation
Authors:
Stefan Heinrich
Abstract:
Quantum computing was so far mainly concerned with discrete problems.
Recently, E. Novak and the author studied quantum algorithms for high dimensional integration and dealt with the question, which advantages quantum computing can bring over classical deterministic or randomized methods for this type of problem.
In this paper we give a short introduction to the basic ideas of quantum computi…
▽ More
Quantum computing was so far mainly concerned with discrete problems.
Recently, E. Novak and the author studied quantum algorithms for high dimensional integration and dealt with the question, which advantages quantum computing can bring over classical deterministic or randomized methods for this type of problem.
In this paper we give a short introduction to the basic ideas of quantum computing and survey recent results on high dimensional integration. We discuss connections to the Monte Carlo methology and compare the optimal error rates of quantum algorithms to those of classical deterministic and randomized algorithms.
△ Less
Submitted 23 December, 2001;
originally announced December 2001.
-
On a Problem in Quantum Summation
Authors:
Stefan Heinrich,
Erich Novak
Abstract:
We consider the computation of the mean of sequences in the quantum model of computation. We determine the query complexity in the case of sequences which satisfy a $p$-summability condition for $1\le p<2$. This settles a problem left open in Heinrich (2001).
We consider the computation of the mean of sequences in the quantum model of computation. We determine the query complexity in the case of sequences which satisfy a $p$-summability condition for $1\le p<2$. This settles a problem left open in Heinrich (2001).
△ Less
Submitted 7 September, 2001;
originally announced September 2001.
-
Quantum Summation with an Application to Integration
Authors:
Stefan Heinrich
Abstract:
We study summation of sequences and integration in the quantum model of computation. We develop quantum algorithms for computing the mean of sequences which satisfy a p-summability condition and for integration of functions from Lebesgue spaces L_p([0,1]^d) and analyze their convergence rates. We also prove lower bounds which show that the proposed algorithms are, in many cases, optimal within t…
▽ More
We study summation of sequences and integration in the quantum model of computation. We develop quantum algorithms for computing the mean of sequences which satisfy a p-summability condition and for integration of functions from Lebesgue spaces L_p([0,1]^d) and analyze their convergence rates. We also prove lower bounds which show that the proposed algorithms are, in many cases, optimal within the setting of quantum computing. This extends recent results of Brassard, Hoyer, Mosca, and Tapp (2000) on computing the mean for bounded sequences and complements results of Novak (2001) on integration of functions from Hoelder classes.
△ Less
Submitted 23 May, 2001;
originally announced May 2001.
-
Optimal Summation and Integration by Deterministic, Randomized, and Quantum Algorithms
Authors:
S. Heinrich,
E. Novak
Abstract:
We survey old and new results about optimal algorithms for summation of finite sequences and for integration of functions from Hoelder or Sobolev spaces. First we discuss optimal deterministic and randomized algorithms. Then we add a new aspect, which has not been covered before on conferences about (quasi-) Monte Carlo methods: quantum computation. We give a short introduction into this setting…
▽ More
We survey old and new results about optimal algorithms for summation of finite sequences and for integration of functions from Hoelder or Sobolev spaces. First we discuss optimal deterministic and randomized algorithms. Then we add a new aspect, which has not been covered before on conferences about (quasi-) Monte Carlo methods: quantum computation. We give a short introduction into this setting and present recent results of the authors on optimal quantum algorithms for summation and integration. We discuss comparisons between the three settings. The most interesting case for Monte Carlo and quantum integration is that of moderate smoothness k and large dimension d which, in fact, occurs in a number of important applied problems. In that case the deterministic exponent is negligible, so the n^{-1/2} Monte Carlo and the n^{-1} quantum speedup essentially constitute the entire convergence rate. We observe that -- there is an exponential speed-up of quantum algorithms over deterministic (classical) algorithms, if k/d tends to zero; -- there is a (roughly) quadratic speed-up of quantum algorithms over randomized classical algorithms, if k/d is small.
△ Less
Submitted 23 May, 2001;
originally announced May 2001.