-
Graviton-photon oscillation in a cosmic background for a general theory of gravity
Authors:
José A. R. Cembranos,
Miguel González Ortiz,
Prado Martín-Moruno
Abstract:
Graviton-photon oscillation is the conversion of gravitational waves to electromagnetic waves and vice versa in the presence of a background electromagnetic field. We investigate this phenomenon in a cosmological scenario considering a background cosmic magnetic field and assuming different gravitational frameworks. We obtain the dam** term that characterizes the attenuation of the conversion pr…
▽ More
Graviton-photon oscillation is the conversion of gravitational waves to electromagnetic waves and vice versa in the presence of a background electromagnetic field. We investigate this phenomenon in a cosmological scenario considering a background cosmic magnetic field and assuming different gravitational frameworks. We obtain the dam** term that characterizes the attenuation of the conversion probability in cosmological backgrounds. This is a general feature that is present even for standard General Relativity. Furthermore, we show that the effects of decoherence, which are due to the interaction with the cosmological expansion and with the additional degrees of freedom of alternative theories of gravity, can be relevant to the phenomenon of graviton-photon mixing.
△ Less
Submitted 9 October, 2023; v1 submitted 16 February, 2023;
originally announced February 2023.
-
Efficient entity-based reinforcement learning
Authors:
Vince Jankovics,
Michael Garcia Ortiz,
Eduardo Alonso
Abstract:
Recent deep reinforcement learning (DRL) successes rely on end-to-end learning from fixed-size observational inputs (e.g. image, state-variables). However, many challenging and interesting problems in decision making involve observations or intermediary representations which are best described as a set of entities: either the image-based approach would miss small but important details in the obser…
▽ More
Recent deep reinforcement learning (DRL) successes rely on end-to-end learning from fixed-size observational inputs (e.g. image, state-variables). However, many challenging and interesting problems in decision making involve observations or intermediary representations which are best described as a set of entities: either the image-based approach would miss small but important details in the observations (e.g. ojects on a radar, vehicles on satellite images, etc.), the number of sensed objects is not fixed (e.g. robotic manipulation), or the problem simply cannot be represented in a meaningful way as an image (e.g. power grid control, or logistics). This type of structured representations is not directly compatible with current DRL architectures, however, there has been an increase in machine learning techniques directly targeting structured information, potentially addressing this issue. We propose to combine recent advances in set representations with slot attention and graph neural networks to process structured data, broadening the range of applications of DRL algorithms. This approach allows to address entity-based problems in an efficient and scalable way. We show that it can improve training time and robustness significantly, and demonstrate their potential to handle structured as well as purely visual domains, on multiple environments from the Atari Learning Environment and Simple Playgrounds.
△ Less
Submitted 6 June, 2022;
originally announced June 2022.
-
Symplectic forms on Banach spaces
Authors:
Jesús M. F. Castillo,
Wilson Cuellar,
Manuel González Ortiz,
Raúl Pino
Abstract:
We extend and generalize the result of Kalton and Swanson ($Z_2$ is a symplectic Banach space with no Lagrangian subspace) by showing that all higher order Rochgberg spaces $\mathfrak R^{(n)}$ are symplectic Banach spaces with no Lagrangian subspaces. The nontrivial symplectic structure on even spaces is the one induced by the natural duality; while the nontrivial symplectic structure on odd space…
▽ More
We extend and generalize the result of Kalton and Swanson ($Z_2$ is a symplectic Banach space with no Lagrangian subspace) by showing that all higher order Rochgberg spaces $\mathfrak R^{(n)}$ are symplectic Banach spaces with no Lagrangian subspaces. The nontrivial symplectic structure on even spaces is the one induced by the natural duality; while the nontrivial symplectic structure on odd spaces requires perturbation with a complex structure. We will also study symplectic structures on general Banach spaces and, motivated by the unexpected appearance of complex structures, we introduce and study almost symplectic structures.
△ Less
Submitted 1 April, 2022;
originally announced April 2022.
-
Unsupervised Emergence of Egocentric Spatial Structure from Sensorimotor Prediction
Authors:
Alban Laflaquière,
Michael Garcia Ortiz
Abstract:
Despite its omnipresence in robotics application, the nature of spatial knowledge and the mechanisms that underlie its emergence in autonomous agents are still poorly understood. Recent theoretical works suggest that the Euclidean structure of space induces invariants in an agent's raw sensorimotor experience. We hypothesize that capturing these invariants is beneficial for sensorimotor prediction…
▽ More
Despite its omnipresence in robotics application, the nature of spatial knowledge and the mechanisms that underlie its emergence in autonomous agents are still poorly understood. Recent theoretical works suggest that the Euclidean structure of space induces invariants in an agent's raw sensorimotor experience. We hypothesize that capturing these invariants is beneficial for sensorimotor prediction and that, under certain exploratory conditions, a motor representation capturing the structure of the external space should emerge as a byproduct of learning to predict future sensory experiences. We propose a simple sensorimotor predictive scheme, apply it to different agents and types of exploration, and evaluate the pertinence of these hypotheses. We show that a naive agent can capture the topology and metric regularity of its sensor's position in an egocentric spatial frame without any a priori knowledge, nor extraneous supervision.
△ Less
Submitted 17 September, 2019; v1 submitted 4 June, 2019;
originally announced June 2019.
-
State representation learning with recurrent capsule networks
Authors:
Louis Annabi,
Michael Garcia Ortiz
Abstract:
Unsupervised learning of compact and relevant state representations has been proved very useful at solving complex reinforcement learning tasks. In this paper, we propose a recurrent capsule network that learns such representations by trying to predict the future observations in an agent's trajectory.
Unsupervised learning of compact and relevant state representations has been proved very useful at solving complex reinforcement learning tasks. In this paper, we propose a recurrent capsule network that learns such representations by trying to predict the future observations in an agent's trajectory.
△ Less
Submitted 22 February, 2019; v1 submitted 28 December, 2018;
originally announced December 2018.
-
Grounding Perception: A Developmental Approach to Sensorimotor Contingencies
Authors:
Alban Laflaquière,
Nikolas Hemion,
Michaël Garcia Ortiz,
Jean-Christophe Baillie
Abstract:
Sensorimotor contingency theory offers a promising account of the nature of perception, a topic rarely addressed in the robotics community. We propose a developmental framework to address the problem of the autonomous acquisition of sensorimotor contingencies by a naive robot. While exploring the world, the robot internally encodes contingencies as predictive models that capture the structure they…
▽ More
Sensorimotor contingency theory offers a promising account of the nature of perception, a topic rarely addressed in the robotics community. We propose a developmental framework to address the problem of the autonomous acquisition of sensorimotor contingencies by a naive robot. While exploring the world, the robot internally encodes contingencies as predictive models that capture the structure they imply in its sensorimotor experience. Three preliminary applications are presented to illustrate our approach to the acquisition of perceptive abilities: discovering the environment, discovering objects, and discovering a visual field.
△ Less
Submitted 3 October, 2018;
originally announced October 2018.
-
Unsupervised Emergence of Spatial Structure from Sensorimotor Prediction
Authors:
Alban Laflaquière,
Michael Garcia Ortiz
Abstract:
Despite its omnipresence in robotics application, the nature of spatial knowledge and the mechanisms that underlie its emergence in autonomous agents are still poorly understood. Recent theoretical work suggests that the concept of space can be grounded by capturing invariants induced by the structure of space in an agent's raw sensorimotor experience. Moreover, it is hypothesized that capturing t…
▽ More
Despite its omnipresence in robotics application, the nature of spatial knowledge and the mechanisms that underlie its emergence in autonomous agents are still poorly understood. Recent theoretical work suggests that the concept of space can be grounded by capturing invariants induced by the structure of space in an agent's raw sensorimotor experience. Moreover, it is hypothesized that capturing these invariants is beneficial for a naive agent trying to predict its sensorimotor experience. Under certain exploratory conditions, spatial representations should thus emerge as a byproduct of learning to predict. We propose a simple sensorimotor predictive scheme, apply it to different agents and types of exploration, and evaluate the pertinence of this hypothesis. We show that a naive agent can capture the topology and metric regularity of its spatial configuration without any a priori knowledge, nor extraneous supervision.
△ Less
Submitted 27 November, 2018; v1 submitted 2 October, 2018;
originally announced October 2018.
-
Learning Representations of Spatial Displacement through Sensorimotor Prediction
Authors:
Michael Garcia Ortiz,
Alban Laflaquière
Abstract:
Robots act in their environment through sequences of continuous motor commands. Because of the dimensionality of the motor space, as well as the infinite possible combinations of successive motor commands, agents need compact representations that capture the structure of the resulting displacements. In the case of an autonomous agent with no a priori knowledge about its sensorimotor apparatus, thi…
▽ More
Robots act in their environment through sequences of continuous motor commands. Because of the dimensionality of the motor space, as well as the infinite possible combinations of successive motor commands, agents need compact representations that capture the structure of the resulting displacements. In the case of an autonomous agent with no a priori knowledge about its sensorimotor apparatus, this compression has to be learned. We propose to use Recurrent Neural Networks to encode motor sequences into a compact representation, which is used to predict the consequence of motor sequences in term of sensory changes. We show that sensory prediction can successfully guide the compression of motor sequences into representations that are organized topologically in term of spatial displacement.
△ Less
Submitted 16 May, 2018;
originally announced May 2018.
-
Representation Learning in Partially Observable Environments using Sensorimotor Prediction
Authors:
Thibaut Kulak,
Michael Garcia Ortiz
Abstract:
In order to explore and act autonomously in an environment, an agent needs to learn from the sensorimotor information that is captured while acting. By extracting the regularities in this sensorimotor stream, it can learn a model of the world, which in turn can be used as a basis for action and exploration.
This requires the acquisition of compact representations from a possibly high dimensional…
▽ More
In order to explore and act autonomously in an environment, an agent needs to learn from the sensorimotor information that is captured while acting. By extracting the regularities in this sensorimotor stream, it can learn a model of the world, which in turn can be used as a basis for action and exploration.
This requires the acquisition of compact representations from a possibly high dimensional raw observation, which is noisy and ambiguous. In this paper, we learn sensory representations from sensorimotor prediction. We propose a model which integrates sensorimotor information over time, and project it in a sensory representation which is useful for prediction. We emphasize on a simple example the role of motor and memory for learning sensory representations.
△ Less
Submitted 26 April, 2018; v1 submitted 1 March, 2018;
originally announced March 2018.
