Showing 1–50 of 56 results for author: Biehl, M

Iterated Relevance Matrix Analysis (IRMA) for the identification of class-discriminative subspaces

Authors: Sofie Lövdal, Michael Biehl

Abstract: We introduce and investigate the iterated application of Generalized Matrix Learning Vector Quantizaton for the analysis of feature relevances in classification problems, as well as for the construction of class-discriminative subspaces. The suggested Iterated Relevance Matrix Analysis (IRMA) identifies a linear subspace representing the classification specific information of the considered data s… ▽ More We introduce and investigate the iterated application of Generalized Matrix Learning Vector Quantizaton for the analysis of feature relevances in classification problems, as well as for the construction of class-discriminative subspaces. The suggested Iterated Relevance Matrix Analysis (IRMA) identifies a linear subspace representing the classification specific information of the considered data sets using Generalized Matrix Learning Vector Quantization (GMLVQ). By iteratively determining a new discriminative subspace while projecting out all previously identified ones, a combined subspace carrying all class-specific information can be found. This facilitates a detailed analysis of feature relevances, and enables improved low-dimensional representations and visualizations of labeled data sets. Additionally, the IRMA-based class-discriminative subspace can be used for dimensionality reduction and the training of robust classifiers with potentially improved performance. △ Less

Submitted 23 January, 2024; originally announced January 2024.

Comments: 17 pages, 5 figures, 1 table. Submitted to Neurocomputing. Extension of 2023 ESANN conference contribution

Interpreting systems as solving POMDPs: a step towards a formal understanding of agency

Authors: Martin Biehl, Nathaniel Virgo

Abstract: Under what circumstances can a system be said to have beliefs and goals, and how do such agency-related features relate to its physical state? Recent work has proposed a notion of interpretation map, a function that maps the state of a system to a probability distribution representing its beliefs about an external world. Such a map is not completely arbitrary, as the beliefs it attributes to the s… ▽ More Under what circumstances can a system be said to have beliefs and goals, and how do such agency-related features relate to its physical state? Recent work has proposed a notion of interpretation map, a function that maps the state of a system to a probability distribution representing its beliefs about an external world. Such a map is not completely arbitrary, as the beliefs it attributes to the system must evolve over time in a manner that is consistent with Bayes' theorem, and consequently the dynamics of a system constrain its possible interpretations. Here we build on this approach, proposing a notion of interpretation not just in terms of beliefs but in terms of goals and actions. To do this we make use of the existing theory of partially observable Markov processes (POMDPs): we say that a system can be interpreted as a solution to a POMDP if it not only admits an interpretation map describing its beliefs about the hidden state of a POMDP but also takes actions that are optimal according to its belief state. An agent is then a system together with an interpretation of this system as a POMDP solution. Although POMDPs are not the only possible formulation of what it means to have a goal, this nevertheless represents a step towards a more general formal definition of what it means for a system to be an agent. △ Less

Submitted 4 September, 2022; originally announced September 2022.

Comments: 17 pages, no figures, to be presented at 3rd International Workshop on Active Inference 2022

A machine learning based approach to gravitational lens identification with the International LOFAR Telescope

Authors: S. Rezaei, J. P. McKean, M. Biehl, W. de Roo1, A. Lafontaine

Abstract: We present a novel machine learning based approach for detecting galaxy-scale gravitational lenses from interferometric data, specifically those taken with the International LOFAR Telescope (ILT), which is observing the northern radio sky at a frequency of 150 MHz, an angular resolution of 350 mas and a sensitivity of 90 uJy beam-1 (1 sigma). We develop and test several Convolutional Neural Networ… ▽ More We present a novel machine learning based approach for detecting galaxy-scale gravitational lenses from interferometric data, specifically those taken with the International LOFAR Telescope (ILT), which is observing the northern radio sky at a frequency of 150 MHz, an angular resolution of 350 mas and a sensitivity of 90 uJy beam-1 (1 sigma). We develop and test several Convolutional Neural Networks to determine the probability and uncertainty of a given sample being classified as a lensed or non-lensed event. By training and testing on a simulated interferometric imaging data set that includes realistic lensed and non-lensed radio sources, we find that it is possible to recover 95.3 per cent of the lensed samples (true positive rate), with a contamination of just 0.008 per cent from non-lensed samples (false positive rate). Taking the expected lensing probability into account results in a predicted sample purity for lensed events of 92.2 per cent. We find that the network structure is most robust when the maximum image separation between the lensed images is greater than 3 times the synthesized beam size, and the lensed images have a total flux density that is equivalent to at least a 20 sigma (point-source) detection. For the ILT, this corresponds to a lens sample with Einstein radii greater than 0.5 arcsec and a radio source population with 150 MHz flux densities more than 2 mJy. By applying these criteria and our lens detection algorithm we expect to discover the vast majority of galaxy-scale gravitational lens systems contained within the LOFAR Two Metre Sky Survey. △ Less

Submitted 21 July, 2022; originally announced July 2022.

Comments: Accepted to be published by MNRAS

Interpretable Models Capable of Handling Systematic Missingness in Imbalanced Classes and Heterogeneous Datasets

Authors: Sreejita Ghosh, Elizabeth S. Baranowski, Michael Biehl, Wiebke Arlt, Peter Tino, Kerstin Bunte

Abstract: Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data. Furthermore, the transparency of these models increase trust among application domain experts. Medical datasets face common issues such as heterogeneous measurements, imbalanced classes with limited sample size, and missing data, which h… ▽ More Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data. Furthermore, the transparency of these models increase trust among application domain experts. Medical datasets face common issues such as heterogeneous measurements, imbalanced classes with limited sample size, and missing data, which hinder the straightforward application of machine learning techniques. In this paper we present a family of prototype-based (PB) interpretable models which are capable of handling these issues. The models introduced in this contribution show comparable or superior performance to alternative techniques applicable in such situations. However, unlike ensemble based models, which have to compromise on easy interpretation, the PB models here do not. Moreover we propose a strategy of harnessing the power of ensembles while maintaining the intrinsic interpretability of the PB models, by averaging the model parameter manifolds. All the models were evaluated on a synthetic (publicly available dataset) in addition to detailed analyses of two real-world medical datasets (one publicly available). Results indicated that the models and strategies we introduced addressed the challenges of real-world medical data, while remaining computationally inexpensive and transparent, as well as similar or superior in performance compared to their alternatives. △ Less

Submitted 4 June, 2022; originally announced June 2022.

Interpreting Dynamical Systems as Bayesian Reasoners

Authors: Nathaniel Virgo, Martin Biehl, Simon McGregor

Abstract: A central concept in active inference is that the internal states of a physical system parametrise probability measures over states of the external world. These can be seen as an agent's beliefs, expressed as a Bayesian prior or posterior. Here we begin the development of a general theory that would tell us when it is appropriate to interpret states as representing beliefs in this way. We focus on… ▽ More A central concept in active inference is that the internal states of a physical system parametrise probability measures over states of the external world. These can be seen as an agent's beliefs, expressed as a Bayesian prior or posterior. Here we begin the development of a general theory that would tell us when it is appropriate to interpret states as representing beliefs in this way. We focus on the case in which a system can be interpreted as performing either Bayesian filtering or Bayesian inference. We provide formal definitions of what it means for such an interpretation to exist, using techniques from category theory. △ Less

Submitted 27 December, 2021; originally announced December 2021.

Comments: 11 pages + 26 pages appendix, to be published in the proceedings of the 2nd International Workshop on Active Inference 2021

ACM Class: I.2.0

DECORAS: detection and characterization of radio-astronomical sources using deep learning

Authors: S. Rezaei, J. P. McKean, M. Biehl, A. Javadpour

Abstract: We present DECORAS, a deep learning based approach to detect both point and extended sources from Very Long Baseline Interferometry (VLBI) observations. Our approach is based on an encoder-decoder neural network architecture that uses a low number of convolutional layers to provide a scalable solution for source detection. In addition, DECORAS performs source characterization in terms of the posit… ▽ More We present DECORAS, a deep learning based approach to detect both point and extended sources from Very Long Baseline Interferometry (VLBI) observations. Our approach is based on an encoder-decoder neural network architecture that uses a low number of convolutional layers to provide a scalable solution for source detection. In addition, DECORAS performs source characterization in terms of the position, effective radius and peak brightness of the detected sources. We have trained and tested the network with images that are based on realistic Very Long Baseline Array (VLBA) observations at 20 cm. Also, these images have not gone through any prior de-convolution step and are directly related to the visibility data via a Fourier transform. We find that the source catalog generated by DECORAS has a better overall completeness and purity, when compared to a traditional source detection algorithm. DECORAS is complete at the 7.5$σ$ level, and has an almost factor of two improvement in reliability at 5.5$σ$. We find that DECORAS can recover the position of the detected sources to within 0.61 $\pm$ 0.69 mas, and the effective radius and peak surface brightness are recovered to within 20 per cent for 98 and 94 per cent of the sources, respectively. Overall, we find that DECORAS provides a reliable source detection and characterization solution for future wide-field VLBI surveys. △ Less

Submitted 21 September, 2021; v1 submitted 19 September, 2021; originally announced September 2021.

Comments: submitted to MNRAS

Experimental Evidence that Empowerment May Drive Exploration in Sparse-Reward Environments

Authors: Francesco Massari, Martin Biehl, Lisa Meeden, Ryota Kanai

Abstract: Reinforcement Learning (RL) is known to be often unsuccessful in environments with sparse extrinsic rewards. A possible countermeasure is to endow RL agents with an intrinsic reward function, or 'intrinsic motivation', which rewards the agent based on certain features of the current sensor state. An intrinsic reward function based on the principle of empowerment assigns rewards proportional to the… ▽ More Reinforcement Learning (RL) is known to be often unsuccessful in environments with sparse extrinsic rewards. A possible countermeasure is to endow RL agents with an intrinsic reward function, or 'intrinsic motivation', which rewards the agent based on certain features of the current sensor state. An intrinsic reward function based on the principle of empowerment assigns rewards proportional to the amount of control the agent has over its own sensors. We implemented a variation on a recently proposed intrinsically motivated agent, which we refer to as the 'curious' agent, and an empowerment-inspired agent. The former leverages sensor state encoding with a variational autoencoder, while the latter predicts the next sensor state via a variational information bottleneck. We compared the performance of both agents to that of an advantage actor-critic baseline in four sparse reward grid worlds. Both the empowerment agent and its curious competitor seem to benefit to similar extents from their intrinsic rewards. This provides some experimental support to the conjecture that empowerment can be used to drive exploration. △ Less

Submitted 14 July, 2021; originally announced July 2021.

Comments: 6 pages, 3 figures, to be published in proceedings of the International Conference on Development and Learning 2021

Non-trivial informational closure of a Bayesian hyperparameter

Authors: Martin Biehl, Ryota Kanai

Abstract: We investigate the non-trivial informational closure (NTIC) of a Bayesian hyperparameter inferring the underlying distribution of an identically and independently distributed finite random variable. For this we embed both the Bayesian hyper-parameter updating process and the random data process into a Markov chain. The original publication by Bertschinger et al. (2006) mentioned that NTIC may be a… ▽ More We investigate the non-trivial informational closure (NTIC) of a Bayesian hyperparameter inferring the underlying distribution of an identically and independently distributed finite random variable. For this we embed both the Bayesian hyper-parameter updating process and the random data process into a Markov chain. The original publication by Bertschinger et al. (2006) mentioned that NTIC may be able to capture an abstract notion of modeling that is agnostic to the specific internal structure of and existence of explicit representations within the modeling process. The Bayesian hyperparameter is of interest since it has a well defined interpretation as a model of the data process and at the same time its dynamics can be specified without reference to this interpretation. On the one hand we show explicitly that the NTIC of the hyperparameter increases indefinitely over time. On the other hand we attempt to establish a connection between a quantity that is a feature of the interpretation of the hyperparameter as a model, namely the information gain, and the one-step pointwise NTIC which is a quantity that does not depend on this interpretation. We find that in general we cannot use the one-step pointwise NTIC as an indicator for information gain. We hope this exploratory work can lead to further rigorous studies of the relation between NTIC and modeling. △ Less

Submitted 5 October, 2020; originally announced October 2020.

Complex-valued embeddings of generic proximity data

Authors: Maximilian Münch, Michiel Straat, Michael Biehl, Frank-Michael Schleif

Abstract: Proximities are at the heart of almost all machine learning methods. If the input data are given as numerical vectors of equal lengths, euclidean distance, or a Hilbertian inner product is frequently used in modeling algorithms. In a more generic view, objects are compared by a (symmetric) similarity or dissimilarity measure, which may not obey particular mathematical properties. This renders many… ▽ More Proximities are at the heart of almost all machine learning methods. If the input data are given as numerical vectors of equal lengths, euclidean distance, or a Hilbertian inner product is frequently used in modeling algorithms. In a more generic view, objects are compared by a (symmetric) similarity or dissimilarity measure, which may not obey particular mathematical properties. This renders many machine learning methods invalid, leading to convergence problems and the loss of guarantees, like generalization bounds. In many cases, the preferred dissimilarity measure is not metric, like the earth mover distance, or the similarity measure may not be a simple inner product in a Hilbert space but in its generalization a Krein space. If the input data are non-vectorial, like text sequences, proximity-based learning is used or ngram embedding techniques can be applied. Standard embeddings lead to the desired fixed-length vector encoding, but are costly and have substantial limitations in preserving the original data's full information. As an information preserving alternative, we propose a complex-valued vector embedding of proximity data. This allows suitable machine learning algorithms to use these fixed-length, complex-valued vectors for further processing. The complex-valued data can serve as an input to complex-valued machine learning algorithms. In particular, we address supervised learning and use extensions of prototype-based learning. The proposed approach is evaluated on a variety of standard benchmarks and shows strong performance compared to traditional techniques in processing non-metric or non-psd proximity data. △ Less

Submitted 31 August, 2020; originally announced August 2020.

Comments: Proximity learning, embedding, complex values, complex-valued embedding, learning vector quantization

Causal blankets: Theory and algorithmic framework

Authors: Fernando E. Rosas, Pedro A. M. Mediano, Martin Biehl, Shamil Chandaria, Daniel Polani

Abstract: We introduce a novel framework to identify perception-action loops (PALOs) directly from data based on the principles of computational mechanics. Our approach is based on the notion of causal blanket, which captures sensory and active variables as dynamical sufficient statistics -- i.e. as the "differences that make a difference." Moreover, our theory provides a broadly applicable procedure to con… ▽ More We introduce a novel framework to identify perception-action loops (PALOs) directly from data based on the principles of computational mechanics. Our approach is based on the notion of causal blanket, which captures sensory and active variables as dynamical sufficient statistics -- i.e. as the "differences that make a difference." Moreover, our theory provides a broadly applicable procedure to construct PALOs that requires neither a steady-state nor Markovian dynamics. Using our theory, we show that every bipartite stochastic process has a causal blanket, but the extent to which this leads to an effective PALO formulation varies depending on the integrated information of the bipartition. △ Less

Submitted 29 September, 2020; v1 submitted 28 August, 2020; originally announced August 2020.

Supervised Learning in the Presence of Concept Drift: A modelling framework

Authors: Michiel Straat, Fthi Abadi, Zhuoyun Kan, Christina Göpfert, Barbara Hammer, Michael Biehl

Abstract: We present a modelling framework for the investigation of supervised learning in non-stationary environments. Specifically, we model two example types of learning systems: prototype-based Learning Vector Quantization (LVQ) for classification and shallow, layered neural networks for regression tasks. We investigate so-called student teacher scenarios in which the systems are trained from a stream o… ▽ More We present a modelling framework for the investigation of supervised learning in non-stationary environments. Specifically, we model two example types of learning systems: prototype-based Learning Vector Quantization (LVQ) for classification and shallow, layered neural networks for regression tasks. We investigate so-called student teacher scenarios in which the systems are trained from a stream of high-dimensional, labeled data. Properties of the target task are considered to be non-stationary due to drift processes while the training is performed. Different types of concept drift are studied, which affect the density of example inputs only, the target rule itself, or both. By applying methods from statistical physics, we develop a modelling framework for the mathematical analysis of the training dynamics in non-stationary environments. Our results show that standard LVQ algorithms are already suitable for the training in non-stationary environments to a certain extent. However, the application of weight decay as an explicit mechanism of forgetting does not improve the performance under the considered drift processes. Furthermore, we investigate gradient-based training of layered neural networks with sigmoidal activation functions and compare with the use of rectified linear units (ReLU). Our findings show that the sensitivity to concept drift and the effectiveness of weight decay differs significantly between the two types of activation function. △ Less

Submitted 27 February, 2021; v1 submitted 21 May, 2020; originally announced May 2020.

Comments: 17 pages in twocolumn

Journal ref: Neural Computing and Applications 2021

A Technical Critique of Some Parts of the Free Energy Principle

Authors: Martin Biehl, Felix A. Pollock, Ryota Kanai

Abstract: We summarize the original formulation of the free energy principle, and highlight some technical issues. We discuss how these issues affect related results involving generalised coordinates and, where appropriate, mention consequences for and reveal, up to now unacknowledged, differences to newer formulations of the free energy principle. In particular, we reveal that various definitions of the "M… ▽ More We summarize the original formulation of the free energy principle, and highlight some technical issues. We discuss how these issues affect related results involving generalised coordinates and, where appropriate, mention consequences for and reveal, up to now unacknowledged, differences to newer formulations of the free energy principle. In particular, we reveal that various definitions of the "Markov blanket" proposed in different works are not equivalent. We show that crucial steps in the free energy argument which involve rewriting the equations of motion of systems with Markov blankets, are not generally correct without additional (previously unstated) assumptions. We prove by counterexample that the original free energy lemma, when taken at face value, is wrong. We show further that this free energy lemma, when it does hold, implies equality of variational density and ergodic conditional density. The interpretation in terms of Bayesian inference hinges on this point, and we hence conclude that it is not sufficiently justified. Additionally, we highlight that the variational densities presented in newer formulations of the free energy principle and lemma are parameterised by different variables than in older works, leading to a substantially different interpretation of the theory. Note that we only highlight some specific problems in the discussed publications. These problems do not rule out conclusively that the general ideas behind the free energy principle are worth pursuing. △ Less

Submitted 28 February, 2021; v1 submitted 12 January, 2020; originally announced January 2020.

Comments: 20 pages, 1 figure. Martin Biehl and Felix A. Pollock contributed equally to this publication. This version will be published in Entropy. It contains a minor correction (contrary to our previous assertion linearity is not assumed in Step 1) and additional details in response to reviewer's comments

Feature Relevance Determination for Ordinal Regression in the Context of Feature Redundancies and Privileged Information

Authors: Lukas Pfannschmidt, Jonathan Jakob, Fabian Hinder, Michael Biehl, Peter Tino, Barbara Hammer

Abstract: Advances in machine learning technologies have led to increasingly powerful models in particular in the context of big data. Yet, many application scenarios demand for robustly interpretable models rather than optimum model accuracy; as an example, this is the case if potential biomarkers or causal factors should be discovered based on a set of given measurements. In this contribution, we focus on… ▽ More Advances in machine learning technologies have led to increasingly powerful models in particular in the context of big data. Yet, many application scenarios demand for robustly interpretable models rather than optimum model accuracy; as an example, this is the case if potential biomarkers or causal factors should be discovered based on a set of given measurements. In this contribution, we focus on feature selection paradigms, which enable us to uncover relevant factors of a given regularity based on a sparse model. We focus on the important specific setting of linear ordinal regression, i.e.\ data have to be ranked into one of a finite number of ordered categories by a linear projection. Unlike previous work, we consider the case that features are potentially redundant, such that no unique minimum set of relevant features exists. We aim for an identification of all strongly and all weakly relevant features as well as their type of relevance (strong or weak); we achieve this goal by determining feature relevance bounds, which correspond to the minimum and maximum feature relevance, respectively, if searched over all equivalent models. In addition, we discuss how this setting enables us to substitute some of the features, e.g.\ due to their semantics, and how to extend the framework of feature relevance intervals to the setting of privileged information, i.e.\ potentially relevant information is available for training purposes only, but cannot be used for the prediction itself. △ Less

Submitted 10 December, 2019; originally announced December 2019.

Comments: Preprint accepted at Neurocomputing

Hidden Unit Specialization in Layered Neural Networks: ReLU vs. Sigmoidal Activation

Authors: Elisa Oostwal, Michiel Straat, Michael Biehl

Abstract: We study layered neural networks of rectified linear units (ReLU) in a modelling framework for stochastic training processes. The comparison with sigmoidal activation functions is in the center of interest. We compute typical learning curves for shallow networks with K hidden units in matching student teacher scenarios. The systems exhibit sudden changes of the generalization performance via the p… ▽ More We study layered neural networks of rectified linear units (ReLU) in a modelling framework for stochastic training processes. The comparison with sigmoidal activation functions is in the center of interest. We compute typical learning curves for shallow networks with K hidden units in matching student teacher scenarios. The systems exhibit sudden changes of the generalization performance via the process of hidden unit specialization at critical sizes of the training set. Surprisingly, our results show that the training behavior of ReLU networks is qualitatively different from that of networks with sigmoidal activations. In networks with K >= 3 sigmoidal hidden units, the transition is discontinuous: Specialized network configurations co-exist and compete with states of poor performance even for very large training sets. On the contrary, the use of ReLU activations results in continuous transitions for all K: For large enough training sets, two competing, differently specialized states display similar generalization abilities, which coincide exactly for large networks in the limit K to infinity. △ Less

Submitted 27 May, 2020; v1 submitted 16 October, 2019; originally announced October 2019.

Comments: Main changes compared to first version: Added a section on supporting Monte Carlo simulations, results and additional figures are presented and discussed. Some references added. Layout changed to single column layout for better readability. Minor textual changes and typos corrected

Journal ref: Physica A: Statistical Mechanics and its Applications 564: 125517, 2020

Information Closure Theory of Consciousness

Authors: Acer Y. C. Chang, Martin Biehl, Yen Yu, Ryota Kanai

Abstract: Information processing in neural systems can be described and analysed at multiple spatiotemporal scales. Generally, information at lower levels is more fine-grained and can be coarse-grained in higher levels. However, information processed only at specific levels seems to be available for conscious awareness. We do not have direct experience of information available at the level of individual neu… ▽ More Information processing in neural systems can be described and analysed at multiple spatiotemporal scales. Generally, information at lower levels is more fine-grained and can be coarse-grained in higher levels. However, information processed only at specific levels seems to be available for conscious awareness. We do not have direct experience of information available at the level of individual neurons, which is noisy and highly stochastic. Neither do we have experience of more macro-level interactions such as interpersonal communications. Neurophysiological evidence suggests that conscious experiences co-vary with information encoded in coarse-grained neural states such as the firing pattern of a population of neurons. In this article, we introduce a new informational theory of consciousness: Information Closure Theory of Consciousness (ICT). We hypothesise that conscious processes are processes which form non-trivial informational closure (NTIC) with respect to the environment at certain coarse-grained levels. This hypothesis implies that conscious experience is confined due to informational closure from conscious processing to other coarse-grained levels. ICT proposes new quantitative definitions of both conscious content and conscious level. With the parsimonious definitions and a hypothesise, ICT provides explanations and predictions of various phenomena associated with consciousness. The implications of ICT naturally reconciles issues in many existing theories of consciousness and provides explanations for many of our intuitions about consciousness. Most importantly, ICT demonstrates that information can be the common language between consciousness and physical reality. △ Less

Submitted 11 June, 2020; v1 submitted 28 September, 2019; originally announced September 2019.

Galaxy classification: A machine learning analysis of GAMA catalogue data

Authors: Aleke Nolte, Lingyu Wang, Maciej Bilicki, Benne Holwerda, Michael Biehl

Abstract: We present a machine learning analysis of five labelled galaxy catalogues from the Galaxy And Mass Assembly (GAMA): The SersicCatVIKING and SersicCatUKIDSS catalogues containing morphological features, the GaussFitSimple catalogue containing spectroscopic features, the MagPhys catalogue including physical parameters for galaxies, and the Lambdar catalogue, which contains photometric measurements.… ▽ More We present a machine learning analysis of five labelled galaxy catalogues from the Galaxy And Mass Assembly (GAMA): The SersicCatVIKING and SersicCatUKIDSS catalogues containing morphological features, the GaussFitSimple catalogue containing spectroscopic features, the MagPhys catalogue including physical parameters for galaxies, and the Lambdar catalogue, which contains photometric measurements. Extending work previously presented at the ESANN 2018 conference - in an analysis based on Generalized Relevance Matrix Learning Vector Quantization and Random Forests - we find that neither the data from the individual catalogues nor a combined dataset based on all 5 catalogues fully supports the visual-inspection-based galaxy classification scheme employed to categorise the galaxies. In particular, only one class, the Little Blue Spheroids, is consistently separable from the other classes. To aid further insight into the nature of the employed visual-based classification scheme with respect to physical and morphological features, we present the galaxy parameters that are discriminative for the achieved class distinctions. △ Less

Submitted 18 March, 2019; originally announced March 2019.

Comments: Accepted for the ESANN 2018 Special Issue of Neurocomputing

Journal ref: Neurocomputing 342: 172-190, 2019

On-line learning dynamics of ReLU neural networks using statistical physics techniques

Authors: Michiel Straat, Michael Biehl

Abstract: We introduce exact macroscopic on-line learning dynamics of two-layer neural networks with ReLU units in the form of a system of differential equations, using techniques borrowed from statistical physics. For the first experiments, numerical solutions reveal similar behavior compared to sigmoidal activation researched in earlier work. In these experiments the theoretical results show good correspo… ▽ More We introduce exact macroscopic on-line learning dynamics of two-layer neural networks with ReLU units in the form of a system of differential equations, using techniques borrowed from statistical physics. For the first experiments, numerical solutions reveal similar behavior compared to sigmoidal activation researched in earlier work. In these experiments the theoretical results show good correspondence with simulations. In ove-rrealizable and unrealizable learning scenarios, the learning behavior of ReLU networks shows distinctive characteristics compared to sigmoidal networks. △ Less

Submitted 18 March, 2019; originally announced March 2019.

Comments: Accepted contribution: ESANN 2019, 6 pages European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning 2019

Prototype-based classifiers in the presence of concept drift: A modelling framework

Authors: Michael Biehl, Fthi Abadi, Christina Göpfert, Barbara Hammer

Abstract: We present a modelling framework for the investigation of prototype-based classifiers in non-stationary environments. Specifically, we study Learning Vector Quantization (LVQ) systems trained from a stream of high-dimensional, clustered data.We consider standard winner-takes-all updates known as LVQ1. Statistical properties of the input data change on the time scale defined by the training process… ▽ More We present a modelling framework for the investigation of prototype-based classifiers in non-stationary environments. Specifically, we study Learning Vector Quantization (LVQ) systems trained from a stream of high-dimensional, clustered data.We consider standard winner-takes-all updates known as LVQ1. Statistical properties of the input data change on the time scale defined by the training process. We apply analytical methods borrowed from statistical physics which have been used earlier for the exact description of learning in stationary environments. The suggested framework facilitates the computation of learning curves in the presence of virtual and real concept drift. Here we focus on timedependent class bias in the training data. First results demonstrate that, while basic LVQ algorithms are suitable for the training in non-stationary environments, weight decay as an explicit mechanism of forgetting does not improve the performance under the considered drift processes. △ Less

Submitted 18 March, 2019; originally announced March 2019.

Comments: Accepted contribution to WSOM+ 2019, Barcelona/Spain, June 2019 13th International Workshop on Self-Organizing Maps and Learning Vector Quantization, Clustering and Data Visualization 11 pages

Feature Relevance Bounds for Ordinal Regression

Authors: Lukas Pfannschmidt, Jonathan Jakob, Michael Biehl, Peter Tino, Barbara Hammer

Abstract: The increasing occurrence of ordinal data, mainly sociodemographic, led to a renewed research interest in ordinal regression, i.e. the prediction of ordered classes. Besides model accuracy, the interpretation of these models itself is of high relevance, and existing approaches therefore enforce e.g. model sparsity. For high dimensional or highly correlated data, however, this might be misleading d… ▽ More The increasing occurrence of ordinal data, mainly sociodemographic, led to a renewed research interest in ordinal regression, i.e. the prediction of ordered classes. Besides model accuracy, the interpretation of these models itself is of high relevance, and existing approaches therefore enforce e.g. model sparsity. For high dimensional or highly correlated data, however, this might be misleading due to strong variable dependencies. In this contribution, we aim for an identification of feature relevance bounds which - besides identifying all relevant features - explicitly differentiates between strongly and weakly relevant features. △ Less

Submitted 20 February, 2019; originally announced February 2019.

Comments: preprint of a paper accepted for oral presentation at the 27th European Symposium on Artificial Neural Networks (ESANN 2019)

Geometry of Friston's active inference

Authors: Martin Biehl

Abstract: We reconstruct Karl Friston's active inference and give a geometrical interpretation of it. We reconstruct Karl Friston's active inference and give a geometrical interpretation of it. △ Less

Submitted 20 November, 2018; originally announced November 2018.

Comments: 6 pages, 3 figures, Extended abstract accepted as a poster at AABI2018, 1st Symposium on Advances in Approximate Bayesian Inference, 2018

Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loop

Authors: Martin Biehl, Christian Guckelsberger, Christoph Salge, Simón C. Smith, Daniel Polani

Abstract: Active inference is an ambitious theory that treats perception, inference and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena, including consciousness. In active inference, action selection is driven by an objective function that evaluates possible future actions with respect to current, inf… ▽ More Active inference is an ambitious theory that treats perception, inference and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena, including consciousness. In active inference, action selection is driven by an objective function that evaluates possible future actions with respect to current, inferred beliefs about the world. Active inference at its core is independent from extrinsic rewards, resulting in a high level of robustness across e.g.\ different environments or agent morphologies. In the literature, paradigms that share this independence have been summarised under the notion of intrinsic motivations. In general and in contrast to active inference, these models of motivation come without a commitment to particular inference and action selection mechanisms. In this article, we study if the inference and action selection machinery of active inference can also be used by alternatives to the originally included intrinsic motivation. The perception-action loop explicitly relates inference and action selection to the environment and agent memory, and is consequently used as foundation for our analysis. We reconstruct the active inference approach, locate the original formulation within, and show how alternative intrinsic motivations can be used while kee** many of the original features intact. Furthermore, we illustrate the connection to universal reinforcement learning by means of our formalism. Active inference research may profit from comparisons of the dynamics induced by alternative intrinsic motivations. Research on intrinsic motivations may profit from an additional way to implement intrinsically motivated agents that also share the biological plausibility of active inference. △ Less

Submitted 21 June, 2018; originally announced June 2018.

Comments: 53 pages, 6 figures, 2 tables

MSC Class: 62F15; 91B06 ACM Class: I.2.0; I.2.6; I.5.0; I.5.1

Being curious about the answers to questions: novelty search with learned attention

Authors: Nicholas Guttenberg, Martin Biehl, Nathaniel Virgo, Ryota Kanai

Abstract: We investigate the use of attentional neural network layers in order to learn a `behavior characterization' which can be used to drive novelty search and curiosity-based policies. The space is structured towards answering a particular distribution of questions, which are used in a supervised way to train the attentional neural network. We find that in a 2d exploration task, the structure of the sp… ▽ More We investigate the use of attentional neural network layers in order to learn a `behavior characterization' which can be used to drive novelty search and curiosity-based policies. The space is structured towards answering a particular distribution of questions, which are used in a supervised way to train the attentional neural network. We find that in a 2d exploration task, the structure of the space successfully encodes local sensory-motor contingencies such that even a greedy local `do the most novel action' policy with no reinforcement learning or evolution can explore the space quickly. We also apply this to a high/low number guessing game task, and find that guessing according to the learned attention profile performs active inference and can discover the correct number more quickly than an exact but passive approach. △ Less

Submitted 1 June, 2018; originally announced June 2018.

Comments: 8 pages, 7 figures, ALife 2018

Learning body-affordances to simplify action spaces

Authors: Nicholas Guttenberg, Martin Biehl, Ryota Kanai

Abstract: Controlling embodied agents with many actuated degrees of freedom is a challenging task. We propose a method that can discover and interpolate between context dependent high-level actions or body-affordances. These provide an abstract, low-dimensional interface indexing high-dimensional and time- extended action policies. Our method is related to recent ap- proaches in the machine learning literat… ▽ More Controlling embodied agents with many actuated degrees of freedom is a challenging task. We propose a method that can discover and interpolate between context dependent high-level actions or body-affordances. These provide an abstract, low-dimensional interface indexing high-dimensional and time- extended action policies. Our method is related to recent ap- proaches in the machine learning literature but is conceptually simpler and easier to implement. More specifically our method requires the choice of a n-dimensional target sensor space that is endowed with a distance metric. The method then learns an also n-dimensional embedding of possibly reactive body-affordances that spread as far as possible throughout the target sensor space. △ Less

Submitted 15 August, 2017; originally announced August 2017.

Comments: 4 pages, 4 figures

Action and perception for spatiotemporal patterns

Authors: Martin Biehl, Daniel Polani

Abstract: This is a contribution to the formalization of the concept of agents in multivariate Markov chains. Agents are commonly defined as entities that act, perceive, and are goal-directed. In a multivariate Markov chain (e.g. a cellular automaton) the transition matrix completely determines the dynamics. This seems to contradict the possibility of acting entities within such a system. Here we present de… ▽ More This is a contribution to the formalization of the concept of agents in multivariate Markov chains. Agents are commonly defined as entities that act, perceive, and are goal-directed. In a multivariate Markov chain (e.g. a cellular automaton) the transition matrix completely determines the dynamics. This seems to contradict the possibility of acting entities within such a system. Here we present definitions of actions and perceptions within multivariate Markov chains based on entity-sets. Entity-sets represent a largely independent choice of a set of spatiotemporal patterns that are considered as all the entities within the Markov chain. For example, the entity-set can be chosen according to operational closure conditions or complete specific integration. Importantly, the perception-action loop also induces an entity-set and is a multivariate Markov chain. We then show that our definition of actions leads to non-heteronomy and that of perceptions specialize to the usual concept of perception in the perception-action loop. △ Less

Submitted 12 June, 2017; originally announced June 2017.

Comments: 8 pages, 2 figures, accepted at the European Conference on Artificial Life 2017, Lyon, France

MSC Class: 92B20 ACM Class: G.3; H.1.1; I.2.11; I.5.m; J.3

Journal ref: Proceedings of The Fourteenth European Conference on Artificial Life (September 2017) p.68-75

Formal approaches to a definition of agents

Authors: Martin Biehl

Abstract: This thesis contributes to the formalisation of the notion of an agent within the class of finite multivariate Markov chains. Agents are seen as entities that act, perceive, and are goal-directed. We present a new measure that can be used to identify entities (called $ι$-entities), some general requirements for entities in multivariate Markov chains, as well as formal definitions of actions and… ▽ More This thesis contributes to the formalisation of the notion of an agent within the class of finite multivariate Markov chains. Agents are seen as entities that act, perceive, and are goal-directed. We present a new measure that can be used to identify entities (called $ι$-entities), some general requirements for entities in multivariate Markov chains, as well as formal definitions of actions and perceptions suitable for such entities. The intuition behind $ι$-entities is that entities are spatiotemporal patterns for which every part makes every other part more probable. The measure, complete local integration (CLI), is formally investigated in general Bayesian networks. It is based on the specific local integration (SLI) which is measured with respect to a partition. CLI is the minimum value of SLI over all partitions. We prove that $ι$-entities are blocks in specific partitions of the global trajectory. These partitions are the finest partitions that achieve a given SLI value. We also establish the transformation behaviour of SLI under permutations of nodes in the network. We go on to present three conditions on general definitions of entities. These are not fulfilled by sets of random variables i.e.\ the perception-action loop, which is often used to model agents, is too restrictive. We propose that any general entity definition should in effect specify a subset (called an an entity-set) of the set of all spatiotemporal patterns of a given multivariate Markov chain. The set of $ι$-entities is such a set. Importantly the perception-action loop also induces an entity-set. We then propose formal definitions of actions and perceptions for arbitrary entity-sets. These specialise to standard notions in case of the perception-action loop entity-set. Finally we look at some very simple examples. △ Less

Submitted 10 April, 2017; originally announced April 2017.

Comments: PhD thesis, 198 pages

MSC Class: 92B20 ACM Class: G.3; H.1.1; I.2.11; I.5.m; J.3

Neural Coarse-Graining: Extracting slowly-varying latent degrees of freedom with neural networks

Authors: Nicholas Guttenberg, Martin Biehl, Ryota Kanai

Abstract: We present a loss function for neural networks that encompasses an idea of trivial versus non-trivial predictions, such that the network jointly determines its own prediction goals and learns to satisfy them. This permits the network to choose sub-sets of a problem which are most amenable to its abilities to focus on solving, while discarding 'distracting' elements that interfere with its learning… ▽ More We present a loss function for neural networks that encompasses an idea of trivial versus non-trivial predictions, such that the network jointly determines its own prediction goals and learns to satisfy them. This permits the network to choose sub-sets of a problem which are most amenable to its abilities to focus on solving, while discarding 'distracting' elements that interfere with its learning. To do this, the network first transforms the raw data into a higher-level categorical representation, and then trains a predictor from that new time series to its future. To prevent a trivial solution of map** the signal to zero, we introduce a measure of non-triviality via a contrast between the prediction error of the learned model with a naive model of the overall signal statistics. The transform can learn to discard uninformative and unpredictable components of the signal in favor of the features which are both highly predictive and highly predictable. This creates a coarse-grained model of the time-series dynamics, focusing on predicting the slowly varying latent parameters which control the statistics of the time-series, rather than predicting the fast details directly. The result is a semi-supervised algorithm which is capable of extracting latent parameters, segmenting sections of time-series with differing statistics, and building a higher-level representation of the underlying dynamics from unlabeled data. △ Less

Submitted 1 September, 2016; originally announced September 2016.

Comments: 9 pages, 5 figures, 3 tables

Towards information based spatiotemporal patterns as a foundation for agent representation in dynamical systems

Authors: Martin Biehl, Takashi Ikegami, Daniel Polani

Abstract: We present some arguments why existing methods for representing agents fall short in applications crucial to artificial life. Using a thought experiment involving a fictitious dynamical systems model of the biosphere we argue that the metabolism, motility, and the concept of counterfactual variation should be compatible with any agent representation in dynamical systems. We then propose an informa… ▽ More We present some arguments why existing methods for representing agents fall short in applications crucial to artificial life. Using a thought experiment involving a fictitious dynamical systems model of the biosphere we argue that the metabolism, motility, and the concept of counterfactual variation should be compatible with any agent representation in dynamical systems. We then propose an information-theoretic notion of \emph{integrated spatiotemporal patterns} which we believe can serve as the basic building block of an agent definition. We argue that these patterns are capable of solving the problems mentioned before. We also test this in some preliminary experiments. △ Less

Submitted 18 May, 2016; originally announced May 2016.

Comments: 8 pages, 3 figures

MSC Class: 92B20 ACM Class: G.3; I.2.11; I.5.1; J.3

Journal ref: Proceedings of the Artificial Life Conference 2016

Towards designing artificial universes for artificial agents under interaction closure

Authors: Martin Biehl, Christoph Salge, Daniel Polani

Abstract: We are interested in designing artificial universes for artifi- cial agents. We view artificial agents as networks of high- level processes on top of of a low-level detailed-description system. We require that the high-level processes have some intrinsic explanatory power and we introduce an extension of informational closure namely interaction closure to capture this. Then we derive a method to d… ▽ More We are interested in designing artificial universes for artifi- cial agents. We view artificial agents as networks of high- level processes on top of of a low-level detailed-description system. We require that the high-level processes have some intrinsic explanatory power and we introduce an extension of informational closure namely interaction closure to capture this. Then we derive a method to design artificial universes in the form of finite Markov chains which exhibit high-level pro- cesses that satisfy the property of interaction closure. We also investigate control or information transfer which we see as an building block for networks representing artificial agents. △ Less

Submitted 5 June, 2014; originally announced June 2014.

Comments: 8 pages, 3 figures; accepted for publication in ALIFE 14 proceedings

MSC Class: G.3; H.1.1; I.2.0; I.6.m; J.2; J.3

A Behavioural Perspective on the Early Evolution of Nervous Systems: A Computational Model of Excitable Myoepithelia

Authors: Ronald A. J. van Elburg, Oltman O. de Wiljes, Michael Biehl, Fred A. Keijzer

Abstract: How the very first nervous systems evolved remains a fundamental open question. Molecular and genomic techniques have revolutionized our knowledge of the molecular ingredients behind this transition but not yet provided a clear picture of the morphological and tissue changes involved. Here we focus on a behavioural perspective that centres on movement by muscle contraction. Building on the finding… ▽ More How the very first nervous systems evolved remains a fundamental open question. Molecular and genomic techniques have revolutionized our knowledge of the molecular ingredients behind this transition but not yet provided a clear picture of the morphological and tissue changes involved. Here we focus on a behavioural perspective that centres on movement by muscle contraction. Building on the finding that molecules for chemical neural signalling predate multicellular animals, we investigate a gradual evolutionary scenario for nervous systems that consists of two stages: A) Chemically transmission of electrical activity between adjacent cells provided a primitive form of muscle coordination in a contractile epithelial tissue. B) This primitive form of coordination was subsequently improved upon by evolving the axodendritic processes of modern neurons. We use computer simulations to investigate the first stage. The simulations show that chemical transmission across a contractile sheet can indeed produce useful body scale patterns, but only for small-sized animals. For larger animals the noise in chemical neural signalling interferes. Our results imply that a two-stage scenario is a viable approach to nervous system evolution. The first stage could provide an initial behavioural advantage, as well as a clear scaffold for subsequent improvements in behavioural coordination. △ Less

Submitted 14 December, 2012; originally announced December 2012.

Comments: 32 pages, 8 figures and 8 model tables

How to Evaluate Dimensionality Reduction? - Improving the Co-ranking Matrix

Authors: Wouter Lueks, Bassam Mokbel, Michael Biehl, Barbara Hammer

Abstract: The growing number of dimensionality reduction methods available for data visualization has recently inspired the development of quality assessment measures, in order to evaluate the resulting low-dimensional representation independently from a methods' inherent criteria. Several (existing) quality measures can be (re)formulated based on the so-called co-ranking matrix, which subsumes all rank err… ▽ More The growing number of dimensionality reduction methods available for data visualization has recently inspired the development of quality assessment measures, in order to evaluate the resulting low-dimensional representation independently from a methods' inherent criteria. Several (existing) quality measures can be (re)formulated based on the so-called co-ranking matrix, which subsumes all rank errors (i.e. differences between the ranking of distances from every point to all others, comparing the low-dimensional representation to the original data). The measures are often based on the partioning of the co-ranking matrix into 4 submatrices, divided at the K-th row and column, calculating a weighted combination of the sums of each submatrix. Hence, the evaluation process typically involves plotting a graph over several (or even all possible) settings of the parameter K. Considering simple artificial examples, we argue that this parameter controls two notions at once, that need not necessarily be combined, and that the rectangular shape of submatrices is disadvantageous for an intuitive interpretation of the parameter. We debate that quality measures, as general and flexible evaluation tools, should have parameters with a direct and intuitive interpretation as to which specific error types are tolerated or penalized. Therefore, we propose to replace K with two parameters to control these notions separately, and introduce a differently shaped weighting on the co-ranking matrix. The two new parameters can then directly be interpreted as a threshold up to which rank errors are tolerated, and a threshold up to which the rank-distances are significant for the evaluation. Moreover, we propose a color representation of local quality to visually support the evaluation process for a given map**, where every point in the map** is colored according to its local contribution to the overall quality. △ Less

Submitted 18 October, 2011; originally announced October 2011.

Comments: This is an article for the Dagstuhl Preprint Archive, belonging to Dagstuhl Seminar No. 11341 "Learning in the context of very high dimensional data"

Report number: DPA-11341

A LOFAR RFI detection pipeline and its first results

Authors: A. R. Offringa, A. G. de Bruyn, S. Zaroubi, M. Biehl

Abstract: Radio astronomy is entering a new era with new and future radio observatories such as the Low Frequency Array and the Square Kilometer Array. We describe in detail an automated flagging pipeline and evaluate its performance. With only a fraction of the computational cost of correlation and its use of the previously introduced SumThreshold method, it is found to be both fast and unrivalled in its h… ▽ More Radio astronomy is entering a new era with new and future radio observatories such as the Low Frequency Array and the Square Kilometer Array. We describe in detail an automated flagging pipeline and evaluate its performance. With only a fraction of the computational cost of correlation and its use of the previously introduced SumThreshold method, it is found to be both fast and unrivalled in its high accuracy. The LOFAR radio environment is analysed with the help of this pipeline. The high time and spectral resolution of LOFAR have resulted in an observatory where only a few percent of the data is lost due to RFI. △ Less

Submitted 15 July, 2010; v1 submitted 13 July, 2010; originally announced July 2010.

Comments: Accepted for publication in Proc. RFI2010

Post-correlation radio frequency interference classification methods

Authors: A. R. Offringa, A. G. de Bruyn, M. Biehl, S. Zaroubi, G. Bernardi, V. N. Pandey

Abstract: We describe and compare several post-correlation radio frequency interference classification methods. As data sizes of observations grow with new and improved telescopes, the need for completely automated, robust methods for radio frequency interference mitigation is pressing. We investigated several classification methods and find that, for the data sets we used, the most accurate among them is… ▽ More We describe and compare several post-correlation radio frequency interference classification methods. As data sizes of observations grow with new and improved telescopes, the need for completely automated, robust methods for radio frequency interference mitigation is pressing. We investigated several classification methods and find that, for the data sets we used, the most accurate among them is the SumThreshold method. This is a new method formed from a combination of existing techniques, including a new way of thresholding. This iterative method estimates the astronomical signal by carrying out a surface fit in the time-frequency plane. With a theoretical accuracy of 95% recognition and an approximately 0.1% false probability rate in simple simulated cases, the method is in practice as good as the human eye in finding RFI. In addition it is fast, robust, does not need a data model before it can be executed and works in almost all configurations with its default parameters. The method has been compared using simulated data with several other mitigation techniques, including one based upon the singular value decomposition of the time-frequency matrix, and has shown better results than the rest. △ Less

Submitted 9 February, 2010; originally announced February 2010.

Comments: 14 pages, 12 figures (11 in colour). The software that was used in the article can be downloaded from http://www.astro.rug.nl/rfi-software/

Journal ref: MNRAS 405 (June 2010) 155-167

Interplay of Strain Relaxation and Chemically Induced Diffusion Barriers: Nanostructure Formation in 2D Alloys

Authors: T. Volkmann, F. Much, M. Biehl, M. Kotrla

Abstract: We study the formation of nanostructures with alternating stripes composed of bulk-immiscible adsorbates during submonolayer heteroepitaxy. We evaluate the influence of two mechanisms considered in the literature: (i) strain relaxation by alternating arrangement of the adsorbate species, and (ii) kinetic segregation due to chemically induced diffusion barriers. A model ternary system of two adso… ▽ More We study the formation of nanostructures with alternating stripes composed of bulk-immiscible adsorbates during submonolayer heteroepitaxy. We evaluate the influence of two mechanisms considered in the literature: (i) strain relaxation by alternating arrangement of the adsorbate species, and (ii) kinetic segregation due to chemically induced diffusion barriers. A model ternary system of two adsorbates with opposite misfit relative to the substrate, and symmetric binding is investigated by off-lattice as well as lattice kinetic Monte Carlo simulations. We find that neither of the mechanisms (i) or (ii) alone can account for known experimental observations. Rather, a combination of both is needed. We present an off-lattice model which allows for a qualitative reproduction of stripe patterns as well as island ramification in agreement with recent experimental observations for CoAg/Ru(0001) [R. Q. Hwang, Phys. Rev. Lett. 76, 4757 (1996)]. The quantitative dependencies of stripe width and degree of island ramification on the misfit and interaction strength between the two adsorbate types are presented. Attempts to capture essential features in a simplified lattice gas model show that a detailed incorporation of non-local effects is required. △ Less

Submitted 10 November, 2004; originally announced November 2004.

Comments: 24 pages, 12 figures

Lattice gas models and Kinetic Monte Carlo simulations of epitaxial growth

Authors: Michael Biehl

Abstract: A brief introduction is given to Kinetic Monte Carlo (KMC) simulations of epitaxial crystal growth. Molecular Beam Epitaxy (MBE) serves as the prototype example for growth far from equilibrium. However, many of the aspects discussed hear would carry over to other techniques as well. A variety of approaches to the modeling and simulation of epitaxial growth has been applied. They range from the d… ▽ More A brief introduction is given to Kinetic Monte Carlo (KMC) simulations of epitaxial crystal growth. Molecular Beam Epitaxy (MBE) serves as the prototype example for growth far from equilibrium. However, many of the aspects discussed hear would carry over to other techniques as well. A variety of approaches to the modeling and simulation of epitaxial growth has been applied. They range from the detailed quantum mechanics treatment of microscopic processes to the coarse grained picture in terms of stochastic differential equations or other continuum approaches. Here, the focus is on discrete representations such as lattice gas and Solid-On-Solid (SOS) models. The basic ideas of the corresponding KMC methods are presented. Strengths and weaknesses become apparent in the discussion of several levels of simplification that are possible in this context. △ Less

Submitted 29 June, 2004; originally announced June 2004.

Comments: 17 pages, 6 figures. Invited lecture at the MFO Miniworkshop "Multiscale Modeling in Epitaxial Growth" (Oberwolfach 2004). Proceedings to be appear in "International Series in Numerical Mathematics" (Birkhaeuser)

Off-lattice Kinetic Monte Carlo simulations of strained heteroepitaxial growth

Authors: Michael Biehl, Florian Much, Christian Vey

Abstract: An off-lattice, continuous space Kinetic Monte Carlo (KMC) algorithm is discussed and applied in the investigation of strained heteroepitaxial crystal growth. As a starting point, we study a simplifying (1+1)-dimensional situation with inter-atomic interactions given by simple pair-potentials. The model exhibits the appearance of strain-induced misfit dislocations at a characteristic film thickn… ▽ More An off-lattice, continuous space Kinetic Monte Carlo (KMC) algorithm is discussed and applied in the investigation of strained heteroepitaxial crystal growth. As a starting point, we study a simplifying (1+1)-dimensional situation with inter-atomic interactions given by simple pair-potentials. The model exhibits the appearance of strain-induced misfit dislocations at a characteristic film thickness. In our simulations we observe a power law dependence of this critical thickness on the lattice misfit, which is in agreement with experimental results for semiconductor compounds. We furthermore investigate the emergence of strain induced multilayer islands or "Dots" upon an adsorbate wetting layer in the so-called Stranski-Krastanov (SK) growth mode. At a characteristic kinetic film thickness, a transition from monolayer to multilayer islands occurs. We discuss the microscopic causes of the SK-transition and its dependence on the model parameters, i.e. lattice misfit, growth rate, and substrate temperature. △ Less

Submitted 27 May, 2004; originally announced May 2004.

Comments: 17 pages, 6 figures Invited talk presented at the MFO Workshop "Multiscale modeling in epitaxial growth" (Oberwolfach, Jan. 2004). Proceedings to be published in "International Series in Numerical Mathematics" (Birkhaeuser)

Kinetic model of II-VI(001) semiconductor surfaces: Growth rates in atomic layer epitaxy

Authors: T. Volkmann, M. Ahr, M. Biehl

Abstract: We present a zinc-blende lattice gas model of II-VI(001) surfaces, which is investigated by means of Kinetic Monte Carlo (KMC) simulations. Anisotropic effective interactions between surface metal atoms allow for the description of, e.g., the sublimation of CdTe(001), including the reconstruction of Cd-terminated surfaces and its dependence on the substrate temperature T. Our model also includes… ▽ More We present a zinc-blende lattice gas model of II-VI(001) surfaces, which is investigated by means of Kinetic Monte Carlo (KMC) simulations. Anisotropic effective interactions between surface metal atoms allow for the description of, e.g., the sublimation of CdTe(001), including the reconstruction of Cd-terminated surfaces and its dependence on the substrate temperature T. Our model also includes Te-dimerization and the potential presence of excess Te in a reservoir of weakly bound atoms at the surface. We study the self-regulation of atomic layer epitaxy (ALE) and demonstrate how the interplay of the reservoir occupation with the surface kinetics results in two different regimes: at high T the growth rate is limited to 0.5 layers per ALE cycle, whereas at low enough T each cycle adds a complete layer of CdTe. The transition between the two regimes occurs at a characteristic temperature and its dependence on external parameters is studied. Comparing the temperature dependence of the ALE growth rate in our model with experimental results for CdTe we find qualitative agreement. △ Less

Submitted 1 December, 2003; v1 submitted 7 October, 2003; originally announced October 2003.

Comments: 9 pages (REVTeX), 8 figures (EPS). Content revised, references added, typos corrected

Off-lattice Kinetic Monte Carlo simulations of Stranski-Krastanov-like growth

Authors: Michael Biehl, Florian Much

Abstract: We investigate strained heteroepitaxial crystal growth in the framework of a simplifying (1+1)-dimensional model by use of off-lattice Kinetic Monte Carlo simulations. Our modified Lennard-Jones system displays the so-called Stranski-Krastanov growth mode: initial pseudomorphic growth ends by the sudden appearance of strain induced multilayer islands upon a persisting wetting layer. We investigate strained heteroepitaxial crystal growth in the framework of a simplifying (1+1)-dimensional model by use of off-lattice Kinetic Monte Carlo simulations. Our modified Lennard-Jones system displays the so-called Stranski-Krastanov growth mode: initial pseudomorphic growth ends by the sudden appearance of strain induced multilayer islands upon a persisting wetting layer. △ Less

Submitted 28 July, 2003; originally announced July 2003.

Comments: invited contribution to the NATO-ARW on "Quantum Dots: Fundamentals, Applications, and Frontiers", June 2003 16 pages, 4 figures

Flat (001) surfaces of II-VI semiconductors: A lattice gas model

Authors: M. Ahr, M. Biehl

Abstract: We present a two-dimensional lattice gas with anisotropic interactions which model the known properties of the surface reconstructions of CdTe and ZnSe. In constrast to an earlier publication [12], the formation of anion dimers is considered. This alters the behaviour of the model considerably. We determine the phase diagram of this model by means of transfer matrix calculations and Monte Carlo… ▽ More We present a two-dimensional lattice gas with anisotropic interactions which model the known properties of the surface reconstructions of CdTe and ZnSe. In constrast to an earlier publication [12], the formation of anion dimers is considered. This alters the behaviour of the model considerably. We determine the phase diagram of this model by means of transfer matrix calculations and Monte Carlo simulations. We find qualitative agreement with the results of various experimental investigations. △ Less

Submitted 7 November, 2001; originally announced November 2001.

Comments: 17 pages, 5 figures. See http://theorie.physik.uni-wuerzburg.de/~ahr/ for related publications

Report number: WUE-ITP-2001-033

Modelling (001) surfaces of II-VI semiconductors

Authors: M. Ahr, M. Biehl, T. Volkmann

Abstract: First, we present a two-dimensional lattice gas model with anisotropic interactions which explains the experimentally observed transition from a dominant c(2x2) ordering of the CdTe(001) surface to a local (2x1) arrangement of the Cd atoms as an equilibrium phase transition. Its analysis by means of transfer-matrix and Monte Carlo techniques shows that the small energy difference of the competin… ▽ More First, we present a two-dimensional lattice gas model with anisotropic interactions which explains the experimentally observed transition from a dominant c(2x2) ordering of the CdTe(001) surface to a local (2x1) arrangement of the Cd atoms as an equilibrium phase transition. Its analysis by means of transfer-matrix and Monte Carlo techniques shows that the small energy difference of the competing reconstructions determines to a large extent the nature of the different phases. Then, this lattice gas is extended to a model of a three-dimensional crystal which qualitatively reproduces many of the characteristic features of CdTe which have been observed during sublimation and atomic layer epitaxy. △ Less

Submitted 31 July, 2001; originally announced July 2001.

Comments: 5 pages, 3 figures

Report number: WUE-ITP-2001-021

Kinetic Monte Carlo Simulations of dislocations in heteroepitaxial growth

Authors: F. Much, M. Ahr, M. Biehl, W. Kinzel

Abstract: We determine the critical layer thickness for the appearance of misfit dislocations as a function of the misfit between the lattice constants of the substrate and the adsorbate from Kinetic Monte Carlo (KMC) simulations of heteroepitaxial growth. To this end, an algorithm is introduced which allows the off-lattice simulation of various phenomena observed in heteroepitaxial growth including cri… ▽ More We determine the critical layer thickness for the appearance of misfit dislocations as a function of the misfit between the lattice constants of the substrate and the adsorbate from Kinetic Monte Carlo (KMC) simulations of heteroepitaxial growth. To this end, an algorithm is introduced which allows the off-lattice simulation of various phenomena observed in heteroepitaxial growth including critical layer thickness for the appearance of misfit dislocations, or self-assembled island formation. The only parameters of the model are deposition flux, temperature and a pairwise interaction potential between the particles of the system. Our results are compared with a theoretical treatment of the problem and show good agreement with a simple power law. △ Less

Submitted 21 June, 2001; originally announced June 2001.

Comments: 7 pages, 4 figures

Particle currents and the distribution of terrace sizes in unstable epitaxial growth

Authors: M. Biehl, M. Ahr, M. Kinne, W. Kinzel, S. Schinzer

Abstract: A solid-on-solid model of epitaxial growth in 1+1 dimensions is investigated in which slope dependent upward and downward particle currents compete on the surface. The microscopic mechanisms which give rise to these currents are the smoothening incorporation of particles upon deposition and an Ehrlich-Schwoebel barrier which hinders inter-layer transport at step edges. We calculate the distribut… ▽ More A solid-on-solid model of epitaxial growth in 1+1 dimensions is investigated in which slope dependent upward and downward particle currents compete on the surface. The microscopic mechanisms which give rise to these currents are the smoothening incorporation of particles upon deposition and an Ehrlich-Schwoebel barrier which hinders inter-layer transport at step edges. We calculate the distribution of terrace sizes and the resulting currents on a stepped surface with a given inclination angle. The cancellation of the competing effects leads to the selection of a stable magic slope. Simulation results are in very good agreement with the theoretical findings. △ Less

Submitted 9 February, 2001; originally announced February 2001.

Comments: 4 pages, including 3 figures

Learning multilayer perceptrons efficiently

Authors: C. Bunzmann, M. Biehl, R. Urbanczik

Abstract: A learning algorithm for multilayer perceptrons is presented which is based on finding the principal components of a correlation matrix computed from the example inputs and their target outputs. For large networks our procedure needs far fewer examples to achieve good generalization than traditional on-line algorithms. A learning algorithm for multilayer perceptrons is presented which is based on finding the principal components of a correlation matrix computed from the example inputs and their target outputs. For large networks our procedure needs far fewer examples to achieve good generalization than traditional on-line algorithms. △ Less

Submitted 10 January, 2001; originally announced January 2001.

Comments: 5 pages, 3 figures, to appear: Phys. Rev. Letts

Modelling sublimation and atomic layer epitaxy in the presence of competing surface reconstructions

Authors: M. Ahr, M. Biehl

Abstract: We present a solid-on-solid model of a binary AB compound, where atoms of type A in the topmost layer interact via anisotropic interactions different from those inside the bulk. Depending on temperature and particle flux, this model displays surface reconstructions similar to those of (001) surfaces of II-VI semiconductors. We show, that our model qualitatively reproduces mamy of the characteris… ▽ More We present a solid-on-solid model of a binary AB compound, where atoms of type A in the topmost layer interact via anisotropic interactions different from those inside the bulk. Depending on temperature and particle flux, this model displays surface reconstructions similar to those of (001) surfaces of II-VI semiconductors. We show, that our model qualitatively reproduces mamy of the characteristic features of these materials which have been observed during sublimation and atomic layer epitaxy. We predict some previously unknown effects which might be observed experimentally. △ Less

Submitted 1 December, 2000; v1 submitted 9 October, 2000; originally announced October 2000.

Comments: 4 pages, 2 figures. New title, additional figures, minor changes in the text. See http://theorie.physik.uni-wuerzburg.de/~ahr/AB/ for surface images and MPEG movies

A lattice gas model of II-VI(001) semiconductor surfaces

Authors: Michael Biehl, Martin Ahr, Wolfgang Kinzel, Moritz Sokolowski, Thorsten Volkmann

Abstract: We introduce an anisotropic two-dimensional lattice gas model of metal terminated II-IV(001) seminconductor surfaces. Important properties of this class of materials are represented by effective NN and NNN interactions, which result in the competition of two vacancy structures on the surface. We demonstrate that the experimentally observed c(2x2)-(2x1) transition of the CdTe(001) surface can be… ▽ More We introduce an anisotropic two-dimensional lattice gas model of metal terminated II-IV(001) seminconductor surfaces. Important properties of this class of materials are represented by effective NN and NNN interactions, which result in the competition of two vacancy structures on the surface. We demonstrate that the experimentally observed c(2x2)-(2x1) transition of the CdTe(001) surface can be understood as a phase transition in thermal equilbrium. The model is studied by means of transfer matrix and Monte Carlo techniques. The analysis shows that the small energy difference of the competing reconstructions determines to a large extent the nature of the different phases. Possible implications for further experimental research are discussed. △ Less

Submitted 1 August, 2000; originally announced August 2000.

Comments: 7 pages, 2 figures

The influence of the crystal lattice on coarsening in unstable epitaxial growth

Authors: M. Ahr, M. Biehl, M. Kinne, W. Kinzel

Abstract: We report the results of computer simulations of epitaxial growth in the presence of a large Schwoebel barrier on different crystal surfaces: simple cubic(001), bcc(001), simple hexagonal(001) and hcp(001). We find, that mounds coarse by a step edge diffusion driven process, if adatoms can diffuse relatively far along step edges without being hindered by kink-edge diffusion barriers. This yields… ▽ More We report the results of computer simulations of epitaxial growth in the presence of a large Schwoebel barrier on different crystal surfaces: simple cubic(001), bcc(001), simple hexagonal(001) and hcp(001). We find, that mounds coarse by a step edge diffusion driven process, if adatoms can diffuse relatively far along step edges without being hindered by kink-edge diffusion barriers. This yields the scaling exponents alpha = 1, beta = 1/3. These exponents are independent of the symmetry of the crystal surface. The crystal lattice, however, has strong effects on the morphology of the mounds, which are by no means restricted to trivial symmetry effects: while we observe pyramidal shapes on the simple lattices, on bcc and hcp there are two fundamentally different classes of mounds, which are encompanied by characteristic diffusion currents: a metastable one with rounded corners, and an actively coarsening configuration, which breaks the symmetry given by the crystal surface. △ Less

Submitted 29 May, 2000; originally announced May 2000.

Comments: 10 pages, 3 figures. MPEG movies of simulated growing surfaces available online at http://theorie.physik.uni-wuerzburg.de/~ahr/LATTICE/lattice.html

Report number: WUE-ITP-2000.012

Learning structured data from unspecific reinforcement

Authors: M. Biehl, R. Kuehn, I. -O. Stamatescu

Abstract: We show that a straightforward extension of a simple learning model based on the Hebb rule, the previously introduced Association-Reinforcement-Hebb-Rule, can cope with "delayed", unspecific reinforcement also in the case of structured data and lead to perfect generalization. We show that a straightforward extension of a simple learning model based on the Hebb rule, the previously introduced Association-Reinforcement-Hebb-Rule, can cope with "delayed", unspecific reinforcement also in the case of structured data and lead to perfect generalization. △ Less

Submitted 27 January, 2000; originally announced January 2000.

Comments: 13 pages, 3 figures

Report number: HD-THEP-00-02, WUE-ITP-2000-007

Singularity spectra of rough growing surfaces from wavelet analysis

Authors: Martin Ahr, Michael Biehl

Abstract: We apply the wavelet transform modulus maxima (WTMM) method to the analysis of simulated MBE-grown surfaces. In contrast to the structure function approach commonly used in the literature, this new method permits an investigation of the complete singularity spectrum. We focus on a kinetic Monte-Carlo model with Arrhenius dynamics, which in particular takes into consideration the process of therm… ▽ More We apply the wavelet transform modulus maxima (WTMM) method to the analysis of simulated MBE-grown surfaces. In contrast to the structure function approach commonly used in the literature, this new method permits an investigation of the complete singularity spectrum. We focus on a kinetic Monte-Carlo model with Arrhenius dynamics, which in particular takes into consideration the process of thermally activated desorption of particles. We find a wide spectrum of Hoelder exponents, which reflects the multiaffine surface morphology. Although our choice of parameters yields small desorption rates (< 3 %), we observe a dramatic change in the singularity spectrum, which is shifted towards smaller Hoelder exponents. Our results offer a mathematical foundation of anomalous scaling: We identify the global exponent alpha_g with the Hoelder exponent which maximizes the singularity soectrum. △ Less

Submitted 3 April, 2000; v1 submitted 23 December, 1999; originally announced December 1999.

Comments: 8 pages, 4 eps-figures, more details of the algorithm, additional references

Journal ref: Phys. Rev. E 62(2), 1773-1777 (2000)

Noisy regression and classification with continuous multilayer networks

Authors: Martin Ahr, Michael Biehl, Robert Urbanczik

Abstract: We investigate zero temperature Gibbs learning for two classes of unrealizable rules which play an important role in practical applications of multilayer neural networks with differentiable activation functions: classification problems and noisy regression problems. Considering one step of replica symmetry breaking, we surprisingly find that for sufficiently large training sets the stable state… ▽ More We investigate zero temperature Gibbs learning for two classes of unrealizable rules which play an important role in practical applications of multilayer neural networks with differentiable activation functions: classification problems and noisy regression problems. Considering one step of replica symmetry breaking, we surprisingly find that for sufficiently large training sets the stable state is replica symmetric even though the target rule is unrealizable. Further, the classification problem is shown to be formally equivalent to the noisy regression problem. △ Less

Submitted 22 July, 1999; originally announced July 1999.

Comments: 7 pages, including 2 figures

Unconventional MBE Strategies from Computer Simulations for Optimized Growth Conditions

Authors: S. Schinzer, M. Sokolowski, M. Biehl, W. Kinzel

Abstract: We investigate the influence of step edge diffusion (SED) and desorption on Molecular Beam Epitaxy (MBE) using kinetic Monte-Carlo simulations of the solid-on-solid (SOS) model. Based on these investigations we propose two strategies to optimize MBE growth. The strategies are applicable in different growth regimes: During layer-by-layer growth one can exploit the presence of desorption in order… ▽ More We investigate the influence of step edge diffusion (SED) and desorption on Molecular Beam Epitaxy (MBE) using kinetic Monte-Carlo simulations of the solid-on-solid (SOS) model. Based on these investigations we propose two strategies to optimize MBE growth. The strategies are applicable in different growth regimes: During layer-by-layer growth one can exploit the presence of desorption in order to achieve smooth surfaces. By additional short high flux pulses of particles one can increase the growth rate and assist layer-by-layer growth. If, however, mounds are formed (non-layer-by-layer growth) the SED can be used to control size and shape of the three-dimensional structures. By controlled reduction of the flux with time we achieve a fast coarsening together with smooth step edges. △ Less

Submitted 19 March, 1999; originally announced March 1999.

Comments: 19 pages, 7 figures, submitted to Phys. Rev. B

Report number: WUE-ITP-99-008

Weight decay induced phase transitions in multilayer neural networks

Authors: M. Ahr, M. Biehl, E. Schloesser

Abstract: We investigate layered neural networks with differentiable activation function and student vectors without normalization constraint by means of equilibrium statistical physics. We consider the learning of perfectly realizable rules and find that the length of student vectors becomes infinite, unless a proper weight decay term is added to the energy. Then, the system undergoes a first order phase… ▽ More We investigate layered neural networks with differentiable activation function and student vectors without normalization constraint by means of equilibrium statistical physics. We consider the learning of perfectly realizable rules and find that the length of student vectors becomes infinite, unless a proper weight decay term is added to the energy. Then, the system undergoes a first order phase transition between states with very long student vectors and states where the lengths are comparable to those of the teacher vectors. Additionally in both configurations there is a phase transition between a specialized and an unspecialized phase. An anti-specialized phase with long student vectors exists in networks with a small number of hidden units. △ Less

Submitted 19 January, 1999; originally announced January 1999.

Comments: 7 pages, 7 figures