-
Metacognitive particles, mental action and the sense of agency
Authors:
Lars Sandved-Smith,
Lancelot Da Costa
Abstract:
This paper articulates metacognition using the language of statistical physics and Bayesian mechanics. Metacognitive beliefs, defined as beliefs about beliefs, find a natural description within this formalism, which allows us to define the dynamics of 'metacognitive particles', i.e., systems possessing metacognitive beliefs. We further unpack this typology of metacognitive systems by distinguishin…
▽ More
This paper articulates metacognition using the language of statistical physics and Bayesian mechanics. Metacognitive beliefs, defined as beliefs about beliefs, find a natural description within this formalism, which allows us to define the dynamics of 'metacognitive particles', i.e., systems possessing metacognitive beliefs. We further unpack this typology of metacognitive systems by distinguishing passive and active metacognitive particles, where active particles are endowed with the capacity for mental actions that update the parameters of other beliefs. We provide arguments for the necessity of this architecture in the emergence of a subjective sense of agency and the experience of being separate from the environment. The motivation is to pave the way towards a mathematical and physical understanding of cognition -- and higher forms thereof -- furthering the study and formalization of cognitive science in the language of mathematical physics.
△ Less
Submitted 14 June, 2024; v1 submitted 21 May, 2024;
originally announced May 2024.
-
Towards a Bayesian mechanics of metacognitive particles: A commentary on "Path integrals, particular kinds, and strange things" by Friston, Da Costa, Sakthivadivel, Heins, Pavliotis, Ramstead, and Parr
Authors:
Lancelot Da Costa,
Lars Sandved-Smith
Abstract:
What could metacognition look like in simple physical terms? We define metacognition as having beliefs about beliefs, which can be articulated very simply using the language of statistical physics and Bayesian mechanics. We introduce a typology between cognitive and metacognitive particles and develop an example of a metacognitive particle. This can be generalized to provide examples of higher for…
▽ More
What could metacognition look like in simple physical terms? We define metacognition as having beliefs about beliefs, which can be articulated very simply using the language of statistical physics and Bayesian mechanics. We introduce a typology between cognitive and metacognitive particles and develop an example of a metacognitive particle. This can be generalized to provide examples of higher forms of metacognition: i.e. particles having beliefs about beliefs about beliefs and so forth. We conclude by saying that the typology of particles laid down in the target article seems promising, for seemingly enabling a physics of cognition that builds upon and refines the free energy principle, toward a physical description of entities that specifically possess higher forms of cognition.
△ Less
Submitted 24 November, 2023;
originally announced March 2024.
-
Collective behavior from surprise minimization
Authors:
Conor Heins,
Beren Millidge,
Lancelot da Costa,
Richard Mann,
Karl Friston,
Iain Couzin
Abstract:
Collective motion is ubiquitous in nature; groups of animals, such as fish, birds, and ungulates appear to move as a whole, exhibiting a rich behavioral repertoire that ranges from directed movement to milling to disordered swarming. Typically, such macroscopic patterns arise from decentralized, local interactions among constituent components (e.g., individual fish in a school). Preeminent models…
▽ More
Collective motion is ubiquitous in nature; groups of animals, such as fish, birds, and ungulates appear to move as a whole, exhibiting a rich behavioral repertoire that ranges from directed movement to milling to disordered swarming. Typically, such macroscopic patterns arise from decentralized, local interactions among constituent components (e.g., individual fish in a school). Preeminent models of this process describe individuals as self-propelled particles, subject to self-generated motion and 'social forces' such as short-range repulsion and long-range attraction or alignment. However, organisms are not particles; they are probabilistic decision-makers. Here, we introduce an approach to modelling collective behavior based on active inference. This cognitive framework casts behavior as the consequence of a single imperative: to minimize surprise. We demonstrate that many empirically-observed collective phenomena, including cohesion, milling and directed motion, emerge naturally when considering behavior as driven by active Bayesian inference -- without explicitly building behavioral rules or goals into individual agents. Furthermore, we show that active inference can recover and generalize the classical notion of social forces as agents attempt to suppress prediction errors that conflict with their expectations. By exploring the parameter space of the belief-based model, we reveal non-trivial relationships between the individual beliefs and group properties like polarization and the tendency to visit different collective states. We also explore how individual beliefs about uncertainty determine collective decision-making accuracy. Finally, we show how agents can update their generative model over time, resulting in groups that are collectively more sensitive to external fluctuations and encode information more robustly.
△ Less
Submitted 14 May, 2024; v1 submitted 27 July, 2023;
originally announced July 2023.
-
On efficient computation in active inference
Authors:
Aswin Paul,
Noor Sajid,
Lancelot Da Costa,
Adeel Razi
Abstract:
Despite being recognized as neurobiologically plausible, active inference faces difficulties when employed to simulate intelligent behaviour in complex environments due to its computational cost and the difficulty of specifying an appropriate target distribution for the agent. This paper introduces two solutions that work in concert to address these limitations. First, we present a novel planning…
▽ More
Despite being recognized as neurobiologically plausible, active inference faces difficulties when employed to simulate intelligent behaviour in complex environments due to its computational cost and the difficulty of specifying an appropriate target distribution for the agent. This paper introduces two solutions that work in concert to address these limitations. First, we present a novel planning algorithm for finite temporal horizons with drastically lower computational complexity. Second, inspired by Z-learning from control theory literature, we simplify the process of setting an appropriate target distribution for new and existing active inference planning schemes. Our first approach leverages the dynamic programming algorithm, known for its computational efficiency, to minimize the cost function used in planning through the Bellman-optimality principle. Accordingly, our algorithm recursively assesses the expected free energy of actions in the reverse temporal order. This improves computational efficiency by orders of magnitude and allows precise model learning and planning, even under uncertain conditions. Our method simplifies the planning process and shows meaningful behaviour even when specifying only the agent's final goal state. The proposed solutions make defining a target distribution from a goal state straightforward compared to the more complicated task of defining a temporally informed target distribution. The effectiveness of these methods is tested and demonstrated through simulations in standard grid-world tasks. These advances create new opportunities for various applications.
△ Less
Submitted 2 July, 2023;
originally announced July 2023.
-
Path integrals, particular kinds, and strange things
Authors:
Karl Friston,
Lancelot Da Costa,
Dalton A. R. Sakthivadivel,
Conor Heins,
Grigorios A. Pavliotis,
Maxwell Ramstead,
Thomas Parr
Abstract:
This paper describes a path integral formulation of the free energy principle. The ensuing account expresses the paths or trajectories that a particle takes as it evolves over time. The main results are a method or principle of least action that can be used to emulate the behaviour of particles in open exchange with their external milieu. Particles are defined by a particular partition, in which i…
▽ More
This paper describes a path integral formulation of the free energy principle. The ensuing account expresses the paths or trajectories that a particle takes as it evolves over time. The main results are a method or principle of least action that can be used to emulate the behaviour of particles in open exchange with their external milieu. Particles are defined by a particular partition, in which internal states are individuated from external states by active and sensory blanket states. The variational principle at hand allows one to interpret internal dynamics - of certain kinds of particles - as inferring external states that are hidden behind blanket states. We consider different kinds of particles, and to what extent they can be imbued with an elementary form of inference or sentience. Specifically, we consider the distinction between dissipative and conservative particles, inert and active particles and, finally, ordinary and strange particles. Strange particles can be described as inferring their own actions, endowing them with apparent autonomy or agency. In short - of the kinds of particles afforded by a particular partition - strange kinds may be apt for describing sentient behaviour.
△ Less
Submitted 13 June, 2023; v1 submitted 23 October, 2022;
originally announced October 2022.
-
The free energy principle made simpler but not too simple
Authors:
Karl Friston,
Lancelot Da Costa,
Noor Sajid,
Conor Heins,
Kai Ueltzhöffer,
Grigorios A. Pavliotis,
Thomas Parr
Abstract:
This paper provides a concise description of the free energy principle, starting from a formulation of random dynamical systems in terms of a Langevin equation and ending with a Bayesian mechanics that can be read as a physics of sentience. It rehearses the key steps using standard results from statistical physics. These steps entail (i) establishing a particular partition of states based upon con…
▽ More
This paper provides a concise description of the free energy principle, starting from a formulation of random dynamical systems in terms of a Langevin equation and ending with a Bayesian mechanics that can be read as a physics of sentience. It rehearses the key steps using standard results from statistical physics. These steps entail (i) establishing a particular partition of states based upon conditional independencies that inherit from sparsely coupled dynamics, (ii) unpacking the implications of this partition in terms of Bayesian inference and (iii) describing the paths of particular states with a variational principle of least action. Teleologically, the free energy principle offers a normative account of self-organisation in terms of optimal Bayesian design and decision-making, in the sense of maximising marginal likelihood or Bayesian model evidence. In summary, starting from a description of the world in terms of random dynamical systems, we end up with a description of self-organisation as sentient behaviour that can be interpreted as self-evidencing; namely, self-assembly, autopoiesis or active inference.
△ Less
Submitted 30 May, 2023; v1 submitted 17 January, 2022;
originally announced January 2022.
-
Bayesian brains and the Rényi divergence
Authors:
Noor Sajid,
Francesco Faccio,
Lancelot Da Costa,
Thomas Parr,
Jürgen Schmidhuber,
Karl Friston
Abstract:
Under the Bayesian brain hypothesis, behavioural variations can be attributed to different priors over generative model parameters. This provides a formal explanation for why individuals exhibit inconsistent behavioural preferences when confronted with similar choices. For example, greedy preferences are a consequence of confident (or precise) beliefs over certain outcomes. Here, we offer an alter…
▽ More
Under the Bayesian brain hypothesis, behavioural variations can be attributed to different priors over generative model parameters. This provides a formal explanation for why individuals exhibit inconsistent behavioural preferences when confronted with similar choices. For example, greedy preferences are a consequence of confident (or precise) beliefs over certain outcomes. Here, we offer an alternative account of behavioural variability using Rényi divergences and their associated variational bounds. Rényi bounds are analogous to the variational free energy (or evidence lower bound) and can be derived under the same assumptions. Importantly, these bounds provide a formal way to establish behavioural differences through an $α$ parameter, given fixed priors. This rests on changes in $α$ that alter the bound (on a continuous scale), inducing different posterior estimates and consequent variations in behaviour. Thus, it looks as if individuals have different priors, and have reached different conclusions. More specifically, $α\to 0^{+}$ optimisation leads to mass-covering variational estimates and increased variability in choice behaviour. Furthermore, $α\to + \infty$ optimisation leads to mass-seeking variational posteriors and greedy preferences. We exemplify this formulation through simulations of the multi-armed bandit task. We note that these $α$ parameterisations may be especially relevant, i.e., shape preferences, when the true posterior is not in the same family of distributions as the assumed (simpler) approximate density, which may be the case in many real-world scenarios. The ensuing departure from vanilla variational inference provides a potentially useful explanation for differences in behavioural preferences of biological (or artificial) agents under the assumption that the brain performs variational Bayesian inference.
△ Less
Submitted 12 July, 2021;
originally announced July 2021.
-
Bayesian Mechanics for Stationary Processes
Authors:
Lancelot Da Costa,
Karl Friston,
Conor Heins,
Grigorios A. Pavliotis
Abstract:
This paper develops a Bayesian mechanics for adaptive systems.
Firstly, we model the interface between a system and its environment with a Markov blanket. This affords conditions under which states internal to the blanket encode information about external states.
Second, we introduce dynamics and represent adaptive systems as Markov blankets at steady-state. This allows us to identify a wide c…
▽ More
This paper develops a Bayesian mechanics for adaptive systems.
Firstly, we model the interface between a system and its environment with a Markov blanket. This affords conditions under which states internal to the blanket encode information about external states.
Second, we introduce dynamics and represent adaptive systems as Markov blankets at steady-state. This allows us to identify a wide class of systems whose internal states appear to infer external states, consistent with variational inference in Bayesian statistics and theoretical neuroscience.
Finally, we partition the blanket into sensory and active states. It follows that active states can be seen as performing active inference and well-known forms of stochastic control (such as PID control), which are prominent formulations of adaptive behaviour in theoretical biology and engineering.
△ Less
Submitted 26 October, 2021; v1 submitted 25 June, 2021;
originally announced June 2021.
-
Reward Maximisation through Discrete Active Inference
Authors:
Lancelot Da Costa,
Noor Sajid,
Thomas Parr,
Karl Friston,
Ryan Smith
Abstract:
Active inference is a probabilistic framework for modelling the behaviour of biological and artificial agents, which derives from the principle of minimising free energy. In recent years, this framework has successfully been applied to a variety of situations where the goal was to maximise reward, offering comparable and sometimes superior performance to alternative approaches. In this paper, we c…
▽ More
Active inference is a probabilistic framework for modelling the behaviour of biological and artificial agents, which derives from the principle of minimising free energy. In recent years, this framework has successfully been applied to a variety of situations where the goal was to maximise reward, offering comparable and sometimes superior performance to alternative approaches. In this paper, we clarify the connection between reward maximisation and active inference by demonstrating how and when active inference agents perform actions that are optimal for maximising reward. Precisely, we show the conditions under which active inference produces the optimal solution to the Bellman equation--a formulation that underlies several approaches to model-based reinforcement learning and control. On partially observed Markov decision processes, the standard active inference scheme can produce Bellman optimal actions for planning horizons of 1, but not beyond. In contrast, a recently developed recursive active inference scheme (sophisticated inference) can produce Bellman optimal actions on any finite temporal horizon. We append the analysis with a discussion of the broader relationship between active inference and reinforcement learning.
△ Less
Submitted 11 July, 2022; v1 submitted 17 September, 2020;
originally announced September 2020.
-
Containing COVID-19 outbreaks using a Firewall
Authors:
Ezequiel Alvarez,
Leandro Da Rold,
Federico Lamagna,
Manuel Szewc
Abstract:
COVID-19 outbreaks have proven to be very difficult to isolate and extinguish before they spread out. An important reason behind this might be that epidemiological barriers consisting in stop** symptomatic people are likely to fail because of the contagion time before onset, mild cases and/or asymptomatics carriers. Motivated by these special COVID-19 features, we study a scheme for containing a…
▽ More
COVID-19 outbreaks have proven to be very difficult to isolate and extinguish before they spread out. An important reason behind this might be that epidemiological barriers consisting in stop** symptomatic people are likely to fail because of the contagion time before onset, mild cases and/or asymptomatics carriers. Motivated by these special COVID-19 features, we study a scheme for containing an outbreak in a city that consists in adding an extra firewall block between the outbreak and the rest of the city. We implement a coupled compartment model with stochastic noise to simulate a localized outbreak that is partially isolated and analyze its evolution with and without firewall for different plausible model parameters. We explore how further improvements could be achieved if the epidemic evolution would trigger policy changes for the flux and/or lock-down in the different blocks. Our results show that a substantial improvement is obtained by merely adding an extra block between the outbreak and the bulk of the city.
△ Less
Submitted 28 August, 2020;
originally announced August 2020.
-
Visual Explanation for Identification of the Brain Bases for Dyslexia on fMRI Data
Authors:
Laura Tomaz Da Silva,
Nathalia Bianchini Esper,
Duncan D. Ruiz,
Felipe Meneguzzi,
Augusto Buchweitz
Abstract:
Brain imaging of mental health, neurodevelopmental and learning disorders has coupled with machine learning to identify patients based only on their brain activation, and ultimately identify features that generalize from smaller samples of data to larger ones. However, the success of machine learning classification algorithms on neurofunctional data has been limited to more homogeneous data sets o…
▽ More
Brain imaging of mental health, neurodevelopmental and learning disorders has coupled with machine learning to identify patients based only on their brain activation, and ultimately identify features that generalize from smaller samples of data to larger ones. However, the success of machine learning classification algorithms on neurofunctional data has been limited to more homogeneous data sets of dozens of participants. More recently, larger brain imaging data sets have allowed for the application of deep learning techniques to classify brain states and clinical groups solely from neurofunctional features. Deep learning techniques provide helpful tools for classification in healthcare applications, including classification of structural 3D brain images. Recent approaches improved classification performance of larger functional brain imaging data sets, but they fail to provide diagnostic insights about the underlying conditions or provide an explanation from the neural features that informed the classification. We address this challenge by leveraging a number of network visualization techniques to show that, using such techniques in convolutional neural network layers responsible for learning high-level features, we are able to provide meaningful images for expert-backed insights into the condition being classified. Our results show not only accurate classification of developmental dyslexia from the brain imaging alone, but also provide automatic visualizations of the features involved that match contemporary neuroscientific knowledge, indicating that the visual explanations do help in unveiling the neurological bases of the disorder being classified.
△ Less
Submitted 17 July, 2020;
originally announced July 2020.
-
COVID-19 Image Data Collection: Prospective Predictions Are the Future
Authors:
Joseph Paul Cohen,
Paul Morrison,
Lan Dao,
Karsten Roth,
Tim Q Duong,
Marzyeh Ghassemi
Abstract:
Across the world's coronavirus disease 2019 (COVID-19) hot spots, the need to streamline patient diagnosis and management has become more pressing than ever. As one of the main imaging tools, chest X-rays (CXRs) are common, fast, non-invasive, relatively cheap, and potentially bedside to monitor the progression of the disease. This paper describes the first public COVID-19 image data collection as…
▽ More
Across the world's coronavirus disease 2019 (COVID-19) hot spots, the need to streamline patient diagnosis and management has become more pressing than ever. As one of the main imaging tools, chest X-rays (CXRs) are common, fast, non-invasive, relatively cheap, and potentially bedside to monitor the progression of the disease. This paper describes the first public COVID-19 image data collection as well as a preliminary exploration of possible use cases for the data. This dataset currently contains hundreds of frontal view X-rays and is the largest public resource for COVID-19 image and prognostic data, making it a necessary resource to develop and evaluate tools to aid in the treatment of COVID-19. It was manually aggregated from publication figures as well as various web based repositories into a machine learning (ML) friendly format with accompanying dataloader code. We collected frontal and lateral view imagery and metadata such as the time since first symptoms, intensive care unit (ICU) status, survival status, intubation status, or hospital location. We present multiple possible use cases for the data such as predicting the need for the ICU, predicting patient survival, and understanding a patient's trajectory during treatment. Data can be accessed here: https://github.com/ieee8023/covid-chestxray-dataset
△ Less
Submitted 14 December, 2020; v1 submitted 21 June, 2020;
originally announced June 2020.
-
Sophisticated Inference
Authors:
Karl Friston,
Lancelot Da Costa,
Danijar Hafner,
Casper Hesp,
Thomas Parr
Abstract:
Active inference offers a first principle account of sentient behaviour, from which special and important cases can be derived, e.g., reinforcement learning, active learning, Bayes optimal inference, Bayes optimal design, etc. Active inference resolves the exploitation-exploration dilemma in relation to prior preferences, by placing information gain on the same footing as reward or value. In brief…
▽ More
Active inference offers a first principle account of sentient behaviour, from which special and important cases can be derived, e.g., reinforcement learning, active learning, Bayes optimal inference, Bayes optimal design, etc. Active inference resolves the exploitation-exploration dilemma in relation to prior preferences, by placing information gain on the same footing as reward or value. In brief, active inference replaces value functions with functionals of (Bayesian) beliefs, in the form of an expected (variational) free energy. In this paper, we consider a sophisticated kind of active inference, using a recursive form of expected free energy. Sophistication describes the degree to which an agent has beliefs about beliefs. We consider agents with beliefs about the counterfactual consequences of action for states of affairs and beliefs about those latent states. In other words, we move from simply considering beliefs about 'what would happen if I did that' to 'what would I believe about what would happen if I did that'. The recursive form of the free energy functional effectively implements a deep tree search over actions and outcomes in the future. Crucially, this search is over sequences of belief states, as opposed to states per se. We illustrate the competence of this scheme, using numerical simulations of deep decision problems.
△ Less
Submitted 7 June, 2020;
originally announced June 2020.
-
Predicting COVID-19 Pneumonia Severity on Chest X-ray with Deep Learning
Authors:
Joseph Paul Cohen,
Lan Dao,
Paul Morrison,
Karsten Roth,
Yoshua Bengio,
Beiyi Shen,
Almas Abbasi,
Mahsa Hoshmand-Kochi,
Marzyeh Ghassemi,
Haifang Li,
Tim Q Duong
Abstract:
Purpose: The need to streamline patient management for COVID-19 has become more pressing than ever. Chest X-rays provide a non-invasive (potentially bedside) tool to monitor the progression of the disease. In this study, we present a severity score prediction model for COVID-19 pneumonia for frontal chest X-ray images. Such a tool can gauge severity of COVID-19 lung infections (and pneumonia in ge…
▽ More
Purpose: The need to streamline patient management for COVID-19 has become more pressing than ever. Chest X-rays provide a non-invasive (potentially bedside) tool to monitor the progression of the disease. In this study, we present a severity score prediction model for COVID-19 pneumonia for frontal chest X-ray images. Such a tool can gauge severity of COVID-19 lung infections (and pneumonia in general) that can be used for escalation or de-escalation of care as well as monitoring treatment efficacy, especially in the ICU.
Methods: Images from a public COVID-19 database were scored retrospectively by three blinded experts in terms of the extent of lung involvement as well as the degree of opacity. A neural network model that was pre-trained on large (non-COVID-19) chest X-ray datasets is used to construct features for COVID-19 images which are predictive for our task.
Results: This study finds that training a regression model on a subset of the outputs from an this pre-trained chest X-ray model predicts our geographic extent score (range 0-8) with 1.14 mean absolute error (MAE) and our lung opacity score (range 0-6) with 0.78 MAE.
Conclusions: These results indicate that our model's ability to gauge severity of COVID-19 lung infections could be used for escalation or de-escalation of care as well as monitoring treatment efficacy, especially in the intensive care unit (ICU). A proper clinical trial is needed to evaluate efficacy. To enable this we make our code, labels, and data available online at https://github.com/mlmed/torchxrayvision/tree/master/scripts/covid-severity and https://github.com/ieee8023/covid-chestxray-dataset
△ Less
Submitted 30 June, 2020; v1 submitted 24 May, 2020;
originally announced May 2020.
-
Nota Técnica dos Modelos Implementados pelo Coletivo Covid19br para Projeções de Cenários Futuros da Pandemia COVID-19 no Brasil
Authors:
Daniel Severo,
Giuliano Netto Flores Cruz,
Alcides Carlos de Araújo,
André Marques dos Santos,
André Luiz Nunes Martins,
Carolina Ferreira da Silva,
Cristiane Schmitz,
Felipe Brum de Brito Sousa,
Gabriel Domingos de Arruda,
Gabriel Mendes Cabral Gondim,
Giovanna Ferraresso,
Joao Ricardo Vissoci,
Marcel Figueredo S. Figueredo,
Rafael Prudencio Moreira,
Ralf Lima da Costa,
Vito Ribeiro Venturieri,
Diógenes Adriano Rizzoto Justo
Abstract:
This technical note aims to provide a brief introduction to the projection models used by the group to project future scenarios for states and municipalities in real-time, according to the disease's behavior in previous days. However, the parameters can be modified by the user to design customized scenarios. The proposed model begins with the calculation of the basic reproduction number for the st…
▽ More
This technical note aims to provide a brief introduction to the projection models used by the group to project future scenarios for states and municipalities in real-time, according to the disease's behavior in previous days. However, the parameters can be modified by the user to design customized scenarios. The proposed model begins with the calculation of the basic reproduction number for the state or municipality based on the incidence of cases in the last 12 days. Once this is done, the epidemiological curve is projected using the SEIR compartmentalized epidemic model, in possession of this curve, part of the newly projected infected enter a simulation model for health systems in queuing theory, aiming to project future occupations and collapses.
△ Less
Submitted 25 April, 2020;
originally announced April 2020.
-
COVID-19 Image Data Collection
Authors:
Joseph Paul Cohen,
Paul Morrison,
Lan Dao
Abstract:
This paper describes the initial COVID-19 open image data collection. It was created by assembling medical images from websites and publications and currently contains 123 frontal view X-rays.
This paper describes the initial COVID-19 open image data collection. It was created by assembling medical images from websites and publications and currently contains 123 frontal view X-rays.
△ Less
Submitted 25 March, 2020;
originally announced March 2020.
-
Some interesting observations on the free energy principle
Authors:
Karl Friston,
Lancelot Da Costa,
Thomas Parr
Abstract:
Biehl et al (2020) present some interesting observations on an early formulation of the free energy principle in (Friston, 2013). We use these observations to scaffold a discussion of the technical arguments that underwrite the free energy principle. This discussion focuses on solenoidal coupling between various (subsets of) states in sparsely coupled systems that possess a Markov blanket - and th…
▽ More
Biehl et al (2020) present some interesting observations on an early formulation of the free energy principle in (Friston, 2013). We use these observations to scaffold a discussion of the technical arguments that underwrite the free energy principle. This discussion focuses on solenoidal coupling between various (subsets of) states in sparsely coupled systems that possess a Markov blanket - and the distinction between exact and approximate Bayesian inference, implied by the ensuing Bayesian mechanics.
△ Less
Submitted 5 February, 2020;
originally announced February 2020.
-
Neural dynamics under active inference: plausibility and efficiency of information processing
Authors:
Lancelot Da Costa,
Thomas Parr,
Biswa Sengupta,
Karl Friston
Abstract:
Active inference is a normative framework for explaining behaviour under the free energy principle -- a theory of self-organisation originating in neuroscience. It specifies neuronal dynamics for state-estimation in terms of a descent on (variational) free energy -- a measure of the fit between an internal (generative) model and sensory observations. The free energy gradient is a prediction error…
▽ More
Active inference is a normative framework for explaining behaviour under the free energy principle -- a theory of self-organisation originating in neuroscience. It specifies neuronal dynamics for state-estimation in terms of a descent on (variational) free energy -- a measure of the fit between an internal (generative) model and sensory observations. The free energy gradient is a prediction error -- plausibly encoded in the average membrane potentials of neuronal populations. Conversely, the expected probability of a state can be expressed in terms of neuronal firing rates. We show that this is consistent with current models of neuronal dynamics and establish face validity by synthesising plausible electrophysiological responses. We then show that these neuronal dynamics approximate natural gradient descent, a well-known optimisation algorithm from information geometry that follows the steepest descent of the objective in information space. We compare the information length of belief updating in both schemes, a measure of the distance traveled in information space that has a direct interpretation in terms of metabolic cost. We show that neural dynamics under active inference are metabolically efficient and suggest that neural representations in biological agents may evolve by approximating steepest descent in information space towards the point of optimal inference.
△ Less
Submitted 31 January, 2021; v1 submitted 22 January, 2020;
originally announced January 2020.
-
Active inference on discrete state-spaces: a synthesis
Authors:
Lancelot Da Costa,
Thomas Parr,
Noor Sajid,
Sebastijan Veselic,
Victorita Neacsu,
Karl Friston
Abstract:
Active inference is a normative principle underwriting perception, action, planning, decision-making and learning in biological or artificial agents. From its inception, its associated process theory has grown to incorporate complex generative models, enabling simulation of a wide range of complex behaviours. Due to successive developments in active inference, it is often difficult to see how its…
▽ More
Active inference is a normative principle underwriting perception, action, planning, decision-making and learning in biological or artificial agents. From its inception, its associated process theory has grown to incorporate complex generative models, enabling simulation of a wide range of complex behaviours. Due to successive developments in active inference, it is often difficult to see how its underlying principle relates to process theories and practical implementation. In this paper, we try to bridge this gap by providing a complete mathematical synthesis of active inference on discrete state-space models. This technical summary provides an overview of the theory, derives neuronal dynamics from first principles and relates this dynamics to biological processes. Furthermore, this paper provides a fundamental building block needed to understand active inference for mixed generative models; allowing continuous sensations to inform discrete representations. This paper may be used as follows: to guide research towards outstanding challenges, a practical guide on how to implement active inference to simulate experimental behaviour, or a pointer towards various in-silico neurophysiological responses that may be used to make empirical predictions.
△ Less
Submitted 28 March, 2020; v1 submitted 20 January, 2020;
originally announced January 2020.
-
A survey of biodiversity informatics: Concepts, practices, and challenges
Authors:
Luiz M. R. Gadelha Jr.,
Pedro C. de Siracusa,
Artur Ziviani,
Eduardo Couto Dalcin,
Helen Michelle Affe,
Marinez Ferreira de Siqueira,
Luís Alexandre Estevão da Silva,
Douglas A. Augusto,
Eduardo Krempser,
Marcia Chame,
Raquel Lopes Costa,
Pedro Milet Meirelles,
Fabiano Thompson
Abstract:
The unprecedented size of the human population, along with its associated economic activities, have an ever increasing impact on global environments. Across the world, countries are concerned about the growing resource consumption and the capacity of ecosystems to provide them. To effectively conserve biodiversity, it is essential to make indicators and knowledge openly available to decision-maker…
▽ More
The unprecedented size of the human population, along with its associated economic activities, have an ever increasing impact on global environments. Across the world, countries are concerned about the growing resource consumption and the capacity of ecosystems to provide them. To effectively conserve biodiversity, it is essential to make indicators and knowledge openly available to decision-makers in ways that they can effectively use them. The development and deployment of mechanisms to produce these indicators depend on having access to trustworthy data from field surveys and automated sensors, biological collections, molecular data, and historic academic literature. The transformation of this raw data into synthesized information that is fit for use requires going through many refinement steps. The methodologies and techniques used to manage and analyze this data comprise an area often called biodiversity informatics (or e-Biodiversity). Biodiversity data follows a life cycle consisting of planning, collection, certification, description, preservation, discovery, integration, and analysis. Researchers, whether producers or consumers of biodiversity data, will likely perform activities related to at least one of these steps. This article explores each stage of the life cycle of biodiversity data, discussing its methodologies, tools, and challenges.
△ Less
Submitted 7 December, 2020; v1 submitted 29 September, 2018;
originally announced October 2018.
-
Role-separating ordering in social dilemmas controlled by topological frustration
Authors:
Marco A. Amaral,
Matjaz Perc,
Lucas Wardil,
Attila Szolnoki,
Elton J. da Silva Júnior,
Jafferson K. L. da Silva
Abstract:
"Three is a crowd" is an old proverb that applies as much to social interactions, as it does to frustrated configurations in statistical physics models. Accordingly, social relations within a triangle deserve special attention. With this motivation, we explore the impact of topological frustration on the evolutionary dynamics of the snowdrift game on a triangular lattice. This topology provides an…
▽ More
"Three is a crowd" is an old proverb that applies as much to social interactions, as it does to frustrated configurations in statistical physics models. Accordingly, social relations within a triangle deserve special attention. With this motivation, we explore the impact of topological frustration on the evolutionary dynamics of the snowdrift game on a triangular lattice. This topology provides an irreconcilable frustration, which prevents anti-coordination of competing strategies that would be needed for an optimal outcome of the game. By using different strategy updating protocols, we observe complex spatial patterns in dependence on payoff values that are reminiscent to a honeycomb-like organization, which helps to minimize the negative consequence of the topological frustration. We relate the emergence of these patterns to the microscopic dynamics of the evolutionary process, both by means of mean-field approximations and Monte Carlo simulations. For comparison, we also consider the same evolutionary dynamics on the square lattice, where of course the topological frustration is absent. However, with the deletion of diagonal links of the triangular lattice, we can gradually bridge the gap to the square lattice. Interestingly, in this case the level of cooperation in the system is a direct indicator of the level of topological frustration, thus providing a method to determine frustration levels in an arbitrary interaction network.
△ Less
Submitted 27 February, 2017;
originally announced February 2017.
-
Stochastic win-stay-lose-shift strategy with dynamic aspirations in evolutionary social dilemmas
Authors:
Marco A. Amaral,
Lucas Wardil,
Matjaz Perc,
Jafferson K. L. da Silva
Abstract:
In times of plenty expectations rise, just as in times of crisis they fall. This can be mathematically described as a Win-Stay-Lose-Shift strategy with dynamic aspiration levels, where individuals aspire to be as wealthy as their average neighbor. Here we investigate this model in the realm of evolutionary social dilemmas on the square lattice and scale-free networks. By using the master equation…
▽ More
In times of plenty expectations rise, just as in times of crisis they fall. This can be mathematically described as a Win-Stay-Lose-Shift strategy with dynamic aspiration levels, where individuals aspire to be as wealthy as their average neighbor. Here we investigate this model in the realm of evolutionary social dilemmas on the square lattice and scale-free networks. By using the master equation and Monte Carlo simulations, we find that cooperators coexist with defectors in the whole phase diagram, even at high temptations to defect. We study the microscopic mechanism that is responsible for the striking persistence of cooperative behavior and find that cooperation spreads through second-order neighbors, rather than by means of network reciprocity that dominates in imitation-based models. For the square lattice the master equation can be solved analytically in the large temperature limit of the Fermi function, while for other cases the resulting differential equations must be solved numerically. Either way, we find good qualitative agreement with the Monte Carlo simulation results. Our analysis also reveals that the evolutionary outcomes are to a large degree independent of the network topology, including the number of neighbors that are considered for payoff determination on lattices, which further corroborates the local character of the microscopic dynamics. Unlike large-scale spatial patterns that typically emerge due to network reciprocity, here local checkerboard-like patterns remain virtually unaffected by differences in the macroscopic properties of the interaction network.
△ Less
Submitted 1 October, 2016; v1 submitted 22 September, 2016;
originally announced September 2016.
-
Evolutionary mixed games in structured populations: Cooperation and the benefits of heterogeneity
Authors:
Marco A. Amaral,
Lucas Wardil,
Matjaz Perc,
Jafferson K. L. da Silva
Abstract:
Evolutionary games on networks traditionally involve the same game at each interaction. Here we depart from this assumption by considering mixed games, where the game played at each interaction is drawn uniformly at random from a set of two different games. While in well-mixed populations the random mixture of the two games is always equivalent to the average single game, in structured populations…
▽ More
Evolutionary games on networks traditionally involve the same game at each interaction. Here we depart from this assumption by considering mixed games, where the game played at each interaction is drawn uniformly at random from a set of two different games. While in well-mixed populations the random mixture of the two games is always equivalent to the average single game, in structured populations this is not always the case. We show that the outcome is in fact strongly dependent on the distance of separation of the two games in the parameter space. Effectively, this distance introduces payoff heterogeneity, and the average game is returned only if the heterogeneity is small. For higher levels of heterogeneity the distance to the average game grows, which often involves the promotion of cooperation. The presented results support preceding research that highlights the favorable role of heterogeneity regardless of its origin, and they also emphasize the importance of the population structure in amplifying facilitators of cooperation.
△ Less
Submitted 20 May, 2016;
originally announced May 2016.
-
Colored noise and memory effects on formal spiking neuron models
Authors:
L. A. da Silva,
R. D. Vilela
Abstract:
Simplified neuronal models capture the essence of the electrical activity of a generic neuron, besides being more interesting from the computational point of view when compared to higher dimensional models such as the Hodgkin-Huxley one. In this work, we propose a generalized resonate-and-fire model described by a generalized Langevin equation that takes into account memory effects and colored noi…
▽ More
Simplified neuronal models capture the essence of the electrical activity of a generic neuron, besides being more interesting from the computational point of view when compared to higher dimensional models such as the Hodgkin-Huxley one. In this work, we propose a generalized resonate-and-fire model described by a generalized Langevin equation that takes into account memory effects and colored noise. We perform a comprehensive numerical analysis to study the dynamics and the point process statistics of the proposed model, highlighting interesting new features like: i) non-monotonic behavior (emergence of peak structures, enhanced by the choice of colored noise characteristic time-scale) of the coefficient of variation (CV) as a function of memory characteristic time-scale, ii) colored noise-induced shift in the CV, and iii) emergence and suppression of multimodality in the interspike interval (ISI) distribution due to memory-induced subthreshold oscillations. Moreover, in the noise-induced spike regime, we study how memory and colored noise affects the coherence resonance (CR) phenomenon. We found that for sufficiently long memory, CR is not only suppressed, but also the minimum of the CV $\times$ noise intensity curve that characterizes the presence of CR may be replaced by a maximum. The aforementioned features allow to interpret the interplay between memory and colored noise as an effective control mechanism to neuronal variability. Since both variability and non-trivial temporal patterns in the ISI distribution are ubiquitous in biological cells, we hope the present model can be useful in modeling real aspects of neurons.
△ Less
Submitted 12 May, 2015; v1 submitted 24 March, 2015;
originally announced March 2015.
-
Reactive Strategies: The Establishment of Cooperation
Authors:
Elton J. S. Júnior,
Lucas Wardil,
Jafferson K. L. da Silva
Abstract:
Cooperation is usually represented as a Prisoner's Dilemma game. Although individual self-interest may not favour cooperation, cooperation can evolve if, for example, players interact multiple times adjusting their behaviour accordingly to opponent's previous action. To analyze population dynamics, replicator equation has been widely used under several versions. Although it is usually stated that…
▽ More
Cooperation is usually represented as a Prisoner's Dilemma game. Although individual self-interest may not favour cooperation, cooperation can evolve if, for example, players interact multiple times adjusting their behaviour accordingly to opponent's previous action. To analyze population dynamics, replicator equation has been widely used under several versions. Although it is usually stated that a strategy called Generous-tit-for-tat is the winner within the reactive strategies set, here we show that this result depends on replicator's version and on the number of available strategies, stemming from the fact that a dynamics system is also defined by the number of available strategies and not only by the model version. Using computer simulations and analytical arguments, we show that Generous-tit-for-tat victory is found only if the number of strategies available is not too large, with defection winning otherwise.
△ Less
Submitted 28 April, 2015; v1 submitted 16 October, 2014;
originally announced October 2014.
-
Environment fluctuations on single species pattern formation
Authors:
L. A. da Silva,
E. H. Colombo,
C. Anteneodo
Abstract:
System-environment interactions are intrinsically nonlinear and dependent on the interplay between many degrees of freedom. The complexity may be even more pronounced when one aims to describe biologically motivated systems. In that case, it is useful to resort to simplified models relying on effective stochastic equations. A natural consideration is to assume that there is a noisy contribution fr…
▽ More
System-environment interactions are intrinsically nonlinear and dependent on the interplay between many degrees of freedom. The complexity may be even more pronounced when one aims to describe biologically motivated systems. In that case, it is useful to resort to simplified models relying on effective stochastic equations. A natural consideration is to assume that there is a noisy contribution from the environment, such that the parameters which characterize it are not constant but instead fluctuate around their characteristic values. From this perspective, we propose a stochastic generalization of the nonlocal Fisher-KPP equation where, as a first step, environmental fluctuations are Gaussian white noises, both in space and time. We apply analytical and numerical techniques to study how noise affects stability and pattern formation in this context. Particularly, we investigate noise induced coherence by means of the complementary information provided by the dispersion relation and the structure function.
△ Less
Submitted 20 June, 2014;
originally announced June 2014.
-
Distinguishing the opponents in the prisoner dilemma in well-mixed populations
Authors:
Lucas Wardil,
Jafferson K. L. da Silva
Abstract:
Here we study the effects of adopting different strategies against different opponent instead of adopting the same strategy against all of them in the prisoner dilemma structured in well-mixed populations. We consider an evolutionary process in which strategies that provide reproductive success are imitated and players replace one of their worst interactions by the new one. We set individuals in…
▽ More
Here we study the effects of adopting different strategies against different opponent instead of adopting the same strategy against all of them in the prisoner dilemma structured in well-mixed populations. We consider an evolutionary process in which strategies that provide reproductive success are imitated and players replace one of their worst interactions by the new one. We set individuals in a well-mixed population so that network reciprocity effect is excluded and we analyze both synchronous and asynchronous updates. As a consequence of the replacement rule, we show that mutual cooperation is never destroyed and the initial fraction of mutual cooperation is a lower bound for the level of cooperation. We show by simulation and mean-field analysis that for synchronous update cooperation dominates while for asynchronous update only cooperations associated to the initial mutual cooperations are maintained. As a side effect of the replacement rule, an "implicit punishment" mechanism comes up in a way that exploitations are always neutralized providing evolutionary stability for cooperation.
△ Less
Submitted 8 January, 2010;
originally announced January 2010.
-
Innovative in silico approaches to address avian flu using grid technology
Authors:
V. Vincent Breton,
A. L. Da Costa,
P. De Vlieger,
L. Maigne,
D. Sarramia,
Y. -M. Kim,
D. Kim,
H. Q. Nguyen,
T. Solomonides,
Y. -T. Wu,
T. N. Hai
Abstract:
The recent years have seen the emergence of diseases which have spread very quickly all around the world either through human travels like SARS or animal migration like avian flu. Among the biggest challenges raised by infectious emerging diseases, one is related to the constant mutation of the viruses which turns them into continuously moving targets for drug and vaccine discovery. Another chal…
▽ More
The recent years have seen the emergence of diseases which have spread very quickly all around the world either through human travels like SARS or animal migration like avian flu. Among the biggest challenges raised by infectious emerging diseases, one is related to the constant mutation of the viruses which turns them into continuously moving targets for drug and vaccine discovery. Another challenge is related to the early detection and surveillance of the diseases as new cases can appear just anywhere due to the globalization of exchanges and the circulation of people and animals around the earth, as recently demonstrated by the avian flu epidemics. For 3 years now, a collaboration of teams in Europe and Asia has been exploring some innovative in silico approaches to better tackle avian flu taking advantage of the very large computing resources available on international grid infrastructures. Grids were used to study the impact of mutations on the effectiveness of existing drugs against H5N1 and to find potentially new leads active on mutated strains. Grids allow also the integration of distributed data in a completely secured way. The paper presents how we are currently exploring how to integrate the existing data sources towards a global surveillance network for molecular epidemiology.
△ Less
Submitted 23 December, 2008;
originally announced December 2008.
-
A discrete inhomogeneous model for the yeast cell cycle
Authors:
L. Wardil,
J. K. L. da Silva
Abstract:
We study the robustness and stability of the yeast cell regulatory network by using a general inhomogeneous discrete model. We find that inhomogeneity, on average, enhances the stability of the biggest attractor of the dynamics and that the large size of the basin of attraction is robust against changes in the parameters of inhomogeneity. We find that the most frequent orbit, which represents th…
▽ More
We study the robustness and stability of the yeast cell regulatory network by using a general inhomogeneous discrete model. We find that inhomogeneity, on average, enhances the stability of the biggest attractor of the dynamics and that the large size of the basin of attraction is robust against changes in the parameters of inhomogeneity. We find that the most frequent orbit, which represents the cell-cycle pathway, has a better biological meaning than the one exhibited by the homogeneous model.
△ Less
Submitted 11 December, 2008;
originally announced December 2008.
-
The Scaling of Maximum and Basal Metabolic Rates of Mammals and Birds
Authors:
Lauro A. Barbosa,
Guilherme J. M. Garcia,
Jafferson K. L. da Silva
Abstract:
Allometric scaling is one of the most pervasive laws in biology. Its origin, however, is still a matter of dispute. Recent studies have established that maximum metabolic rate scales with an exponent larger than that found for basal metabolism. This unpredicted result sets a challenge that can decide which of the concurrent hypotheses is the correct theory. Here we show that both scaling laws ca…
▽ More
Allometric scaling is one of the most pervasive laws in biology. Its origin, however, is still a matter of dispute. Recent studies have established that maximum metabolic rate scales with an exponent larger than that found for basal metabolism. This unpredicted result sets a challenge that can decide which of the concurrent hypotheses is the correct theory. Here we show that both scaling laws can be deduced from a single network model. Besides the 3/4-law for basal metabolism, the model predicts that maximum metabolic rate scales as $M^{6/7}$, maximum heart rate as $M^{-1/7}$, and muscular capillary density as $M^{-1/7}$, in agreement with data.
△ Less
Submitted 24 September, 2004;
originally announced September 2004.
-
Power-law temporal auto-correlations in day-long records of human physical activity and their alteration with disease
Authors:
Luis A. Nunes Amaral,
Danyel J. Bezerra Soares,
Luciano R. da Silva,
Liacir S. Lucena,
Mariko Saito,
Hiroaki Kumano,
Naoko Aoyagi,
Yoshiharu Yamamoto
Abstract:
We investigate long-duration time series of human physical activity under three different conditions: healthy individuals in (i) a constant routine protocol and (ii) in regular daily routine, and (iii) individuals diagnosed with multiple chemical sensitivities. We find that in all cases human physical activity displays power law decaying temporal auto-correlations. Moreover, we find that under r…
▽ More
We investigate long-duration time series of human physical activity under three different conditions: healthy individuals in (i) a constant routine protocol and (ii) in regular daily routine, and (iii) individuals diagnosed with multiple chemical sensitivities. We find that in all cases human physical activity displays power law decaying temporal auto-correlations. Moreover, we find that under regular daily routine, time correlations of physical activity are significantly different during diurnal and nocturnal periods but that no difference exists under constant routine conditions. Finally, we find significantly different auto-correlations for diurnal records of patients with multiple chemical sensitivities.
△ Less
Submitted 1 October, 2002;
originally announced October 2002.
