-
DyNODE: Neural Ordinary Differential Equations for Dynamics Modeling in Continuous Control
Authors:
Victor M. Martinez Alvarez,
Rareş Roşca,
Cristian G. Fălcuţescu
Abstract:
We present a novel approach (DyNODE) that captures the underlying dynamics of a system by incorporating control in a neural ordinary differential equation framework. We conduct a systematic evaluation and comparison of our method and standard neural network architectures for dynamics modeling. Our results indicate that a simple DyNODE architecture when combined with an actor-critic reinforcement l…
▽ More
We present a novel approach (DyNODE) that captures the underlying dynamics of a system by incorporating control in a neural ordinary differential equation framework. We conduct a systematic evaluation and comparison of our method and standard neural network architectures for dynamics modeling. Our results indicate that a simple DyNODE architecture when combined with an actor-critic reinforcement learning (RL) algorithm that uses model predictions to improve the critic's target values, outperforms canonical neural networks, both in sample efficiency and predictive performance across a diverse range of continuous tasks that are frequently used to benchmark RL algorithms. This approach provides a new avenue for the development of models that are more suited to learn the evolution of dynamical systems, particularly useful in the context of model-based reinforcement learning. To assist related work, we have made code available at https://github.com/vmartinezalvarez/DyNODE .
△ Less
Submitted 9 September, 2020;
originally announced September 2020.
-
Edge states in trimer lattices
Authors:
V. M. Martinez Alvarez,
M. D. Coutinho-Filho
Abstract:
Topological phases of matter have attracted much attention over the years. Motivated by analogy with photonic lattices, here we examine the edge states of a one-dimensional trimer lattice in the phases with and without inversion symmetry protection. In contrast to the Su-Schrieffer-Heeger model, we show that the edge states in the inversion-symmetry broken phase of the trimer model turn out to be…
▽ More
Topological phases of matter have attracted much attention over the years. Motivated by analogy with photonic lattices, here we examine the edge states of a one-dimensional trimer lattice in the phases with and without inversion symmetry protection. In contrast to the Su-Schrieffer-Heeger model, we show that the edge states in the inversion-symmetry broken phase of the trimer model turn out to be chiral, i.e., instead of appearing in pairs localized at opposite edges they can appear at a $\textit{single}$ edge. Interestingly, these chiral edge states remain robust to large amounts of disorder. In addition, we use the Zak phase to characterize the emergence of degenerate edge states in the inversion-symmetric phase of the trimer model. Furthermore, we capture the essentials of the whole family of trimers through a map** onto the commensurate off-diagonal Aubry-André-Harper model, which allow us to establish a direct connection between chiral edge modes in the two models, including the calculation of Chern numbers. We thus suggest that the chiral edge modes of the trimer lattice have a topological origin inherited from this effective map**. Also, we find a nontrivial connection between the topological phase transition point in the trimer lattice and the one in its associated two-dimensional parent system, in agreement with results in the context of Thouless pum** in photonic lattices.
△ Less
Submitted 18 October, 2018; v1 submitted 12 October, 2018;
originally announced October 2018.
-
Topological states of non-Hermitian systems
Authors:
V. M. Martinez Alvarez,
J. E. Barrios Vargas,
M. Berdakin,
L. E. F. Foa Torres
Abstract:
Recently, the search for topological states of matter has turned to non-Hermitian systems, which exhibit a rich variety of unique properties without Hermitian counterparts. Lattices modeled through non-Hermitian Hamiltonians appear in the context of photonic systems, where one needs to account for gain and loss, circuits of resonators, and also when modeling the lifetime due to interactions in con…
▽ More
Recently, the search for topological states of matter has turned to non-Hermitian systems, which exhibit a rich variety of unique properties without Hermitian counterparts. Lattices modeled through non-Hermitian Hamiltonians appear in the context of photonic systems, where one needs to account for gain and loss, circuits of resonators, and also when modeling the lifetime due to interactions in condensed matter systems. Here we provide a brief overview of this rapidly growing subject, the search for topological states and a bulk-boundary correspondence in non-Hermitian systems.
△ Less
Submitted 21 May, 2018;
originally announced May 2018.
-
Non-Hermitian robust edge states in one-dimension: Anomalous localization and eigenspace condensation at exceptional points
Authors:
V. M. Martinez Alvarez,
J. E. Barrios Vargas,
L. E. F. Foa Torres
Abstract:
Capital to topological insulators, the bulk-boundary correspondence ties a topological invariant computed from the bulk (extended) states with those at the boundary, which are hence robust to disorder. Here we put forward an ordering unique to non-Hermitian lattices, whereby a pristine system becomes devoid of extended states, a property which turns out to be robust to disorder. This is enabled by…
▽ More
Capital to topological insulators, the bulk-boundary correspondence ties a topological invariant computed from the bulk (extended) states with those at the boundary, which are hence robust to disorder. Here we put forward an ordering unique to non-Hermitian lattices, whereby a pristine system becomes devoid of extended states, a property which turns out to be robust to disorder. This is enabled by a peculiar type of non-Hermitian degeneracy where a macroscopic fraction of the states coalesce at a single point with geometrical multiplicity of $1$, that we call a phenomenal point.
△ Less
Submitted 14 November, 2017;
originally announced November 2017.
-
Lieb and hole-doped ferrimagnetism, spiral, resonating valence-bond states, and phase separation in large-U $AB_{2}$ Hubbard chains
Authors:
V. M. Martinez Alvarez,
M. D. Coutinho-Filho
Abstract:
The ground state (GS) properties of the quasi-one-dimensional $AB_2$ Hubbard model are investigated taking the effects of charge and spin quantum fluctuations on equal footing. In the strong-coupling regime, we derive a low-energy Lagrangian suitable to describe the ferrimagnetic phase at half filling and the phases in the hole-doped regime. At half filling, a perturbative spin-wave analysis allow…
▽ More
The ground state (GS) properties of the quasi-one-dimensional $AB_2$ Hubbard model are investigated taking the effects of charge and spin quantum fluctuations on equal footing. In the strong-coupling regime, we derive a low-energy Lagrangian suitable to describe the ferrimagnetic phase at half filling and the phases in the hole-doped regime. At half filling, a perturbative spin-wave analysis allows us to find the GS energy, sublattice magnetizations, and Lieb total spin per unit cell of the effective quantum Heisenberg model, in very good agreement with previous results. In the challenging hole do** regime away from half filling, we derive the corresponding $t\textrm{-}J$ Hamiltonian. Under the assumption that charge and spin quantum correlations are decoupled, the evolution of the second-order spin-wave modes in the doped regime unveils the occurrence of spatially modulated spin structures and the emergence of phase separation in the presence of resonating-valence-bond states. We also calculate the do**-dependent GS energy and total spin per unit cell, in which case it is shown that the spiral ferrimagnetic order collapses at a critical hole concentration. Notably, our analytical results in the doped regime are in very good agreement with density matrix renormalization group studies, where our assumption of spin-charge decoupling is numerically supported by the formation of charge-density waves in anti-phase with the modulation of the magnetic structure.
△ Less
Submitted 13 December, 2018; v1 submitted 12 February, 2017;
originally announced February 2017.
-
Quantum phase transition from a Antiferromagnetic-Insulator to a Paramagnetic-Metal laying beneath the superconducting dome
Authors:
Victor M. Martinez Alvarez,
Alejandro Cabo-Bizet,
Alejandro Cabo Montes de Oca
Abstract:
The effect of do** on the TB model of the CuO planes in the La2CuO4 constructed in previous works is investigated. Firstly, it is noted that the model employed constitutes a generalization of the Hubbard one for the same system. Thus, the former predictions of the insulator gap, antiferromagnetic character and the existence of a paramagnetic-pseudogap state, become natural ones to be expected fr…
▽ More
The effect of do** on the TB model of the CuO planes in the La2CuO4 constructed in previous works is investigated. Firstly, it is noted that the model employed constitutes a generalization of the Hubbard one for the same system. Thus, the former predictions of the insulator gap, antiferromagnetic character and the existence of a paramagnetic-pseudogap state, become natural ones to be expected from this more general picture. The effect of hole do** on the antiferromagnetic-insulator state (AFI) and the paramagnetic-pseudogap one, is investigated. The results predict a quantum phase transition (QPT) from the AFI state at low do** to a paramagnetic-metallic state (PM) at higher hole densities. Therefore, a clear description of the hidden QPT laying beneath the dome in high critical temperature superconducting materials is found. At low do**, the system prefers the AFI state, and at the critical value of the do** density 0.2, the energy of a metallic state becomes lower. The evolution with small do** values of the band spectrum of the AFI state, shows that the holes tend to become localized at the middle of the sides of the reduced Brillouin zone (BZ). Then, around the critical value, the holes of the AFI state move to become situated at the corners of the same reduced BZ, showing a structural change at the phase transition point. Thus, the PM state appearing at the QPT acquires the same behavior with respect to the position of holes as the pseudogap state. In the small do** limit a clear difference between the degree of convergence of the iterative self-consistent solution is associated to an even or odd number of electrons. It suggests that the Kramers degeneration in combination with the spin-spatial entangled nature of the hole states, leads to a new kind of pair interaction between two holes. The binding energy value is estimated as a function of the screening.
△ Less
Submitted 26 November, 2012; v1 submitted 24 October, 2012;
originally announced October 2012.