Showing 1–2 of 2 results for author: Nauta, J
-
Learning Perception and Planning with Deep Active Inference
Authors:
Ozan Çatal,
Tim Verbelen,
Johannes Nauta,
Cedric De Boom,
Bart Dhoedt
Abstract:
Active inference is a process theory of the brain that states that all living organisms infer actions in order to minimize their (expected) free energy. However, current experiments are limited to predefined, often discrete, state spaces. In this paper we use recent advances in deep learning to learn the state space and approximate the necessary probability distributions to engage in active infere…
▽ More
Active inference is a process theory of the brain that states that all living organisms infer actions in order to minimize their (expected) free energy. However, current experiments are limited to predefined, often discrete, state spaces. In this paper we use recent advances in deep learning to learn the state space and approximate the necessary probability distributions to engage in active inference.
△ Less
Submitted 24 February, 2020; v1 submitted 30 January, 2020;
originally announced January 2020.
-
Bayesian policy selection using active inference
Authors:
Ozan Çatal,
Johannes Nauta,
Tim Verbelen,
Pieter Simoens,
Bart Dhoedt
Abstract:
Learning to take actions based on observations is a core requirement for artificial agents to be able to be successful and robust at their task. Reinforcement Learning (RL) is a well-known technique for learning such policies. However, current RL algorithms often have to deal with reward sha**, have difficulties generalizing to other environments and are most often sample inefficient. In this pa…
▽ More
Learning to take actions based on observations is a core requirement for artificial agents to be able to be successful and robust at their task. Reinforcement Learning (RL) is a well-known technique for learning such policies. However, current RL algorithms often have to deal with reward sha**, have difficulties generalizing to other environments and are most often sample inefficient. In this paper, we explore active inference and the free energy principle, a normative theory from neuroscience that explains how self-organizing biological systems operate by maintaining a model of the world and casting action selection as an inference problem. We apply this concept to a typical problem known to the RL community, the mountain car problem, and show how active inference encompasses both RL and learning from demonstrations.
△ Less
Submitted 25 April, 2019; v1 submitted 17 April, 2019;
originally announced April 2019.
