-
Controlling Chaos Using Edge Computing Hardware
Authors:
Robert M. Kent,
Wendson A. S. Barbosa,
Daniel J. Gauthier
Abstract:
Machine learning provides a data-driven approach for creating a digital twin of a system - a digital model used to predict the system behavior. Having an accurate digital twin can drive many applications, such as controlling autonomous systems. Often the size, weight, and power consumption of the digital twin or related controller must be minimized, ideally realized on embedded computing hardware…
▽ More
Machine learning provides a data-driven approach for creating a digital twin of a system - a digital model used to predict the system behavior. Having an accurate digital twin can drive many applications, such as controlling autonomous systems. Often the size, weight, and power consumption of the digital twin or related controller must be minimized, ideally realized on embedded computing hardware that can operate without a cloud-computing connection. Here, we show that a nonlinear controller based on next-generation reservoir computing can tackle a difficult control problem: controlling a chaotic system to an arbitrary time-dependent state. The model is accurate, yet it is small enough to be evaluated on a field-programmable gate array typically found in embedded devices. Furthermore, the model only requires 25.0 $\pm$ 7.0 nJ per evaluation, well below other algorithms, even without systematic power optimization. Our work represents the first step in deploying efficient machine learning algorithms to the computing "edge."
△ Less
Submitted 8 May, 2024;
originally announced June 2024.
-
Controlling Chaotic Maps using Next-Generation Reservoir Computing
Authors:
Robert M. Kent,
Wendson A. S. Barbosa,
Daniel J. Gauthier
Abstract:
In this work, we combine nonlinear system control techniques with next-generation reservoir computing, a best-in-class machine learning approach for predicting the behavior of dynamical systems. We demonstrate the performance of the controller in a series of control tasks for the chaotic Hénon map, including controlling the system between unstable fixed-points, stabilizing the system to higher ord…
▽ More
In this work, we combine nonlinear system control techniques with next-generation reservoir computing, a best-in-class machine learning approach for predicting the behavior of dynamical systems. We demonstrate the performance of the controller in a series of control tasks for the chaotic Hénon map, including controlling the system between unstable fixed-points, stabilizing the system to higher order periodic orbits, and to an arbitrary desired state. We show that our controller succeeds in these tasks, requires only 10 data points for training, can control the system to a desired trajectory in a single iteration, and is robust to noise and modeling error.
△ Less
Submitted 2 February, 2024; v1 submitted 7 July, 2023;
originally announced July 2023.
-
Learning Spatiotemporal Chaos Using Next-Generation Reservoir Computing
Authors:
Wendson A. S. Barbosa,
Daniel J. Gauthier
Abstract:
Forecasting the behavior of high-dimensional dynamical systems using machine learning requires efficient methods to learn the underlying physical model. We demonstrate spatiotemporal chaos prediction using a machine learning architecture that, when combined with a next-generation reservoir computer, displays state-of-the-art performance with a computational time $10^3-10^4$ times faster for traini…
▽ More
Forecasting the behavior of high-dimensional dynamical systems using machine learning requires efficient methods to learn the underlying physical model. We demonstrate spatiotemporal chaos prediction using a machine learning architecture that, when combined with a next-generation reservoir computer, displays state-of-the-art performance with a computational time $10^3-10^4$ times faster for training process and training data set $\sim 10^2$ times smaller than other machine learning algorithms. We also take advantage of the translational symmetry of the model to further reduce the computational cost and training data, each by a factor of $\sim$10.
△ Less
Submitted 30 August, 2022; v1 submitted 24 March, 2022;
originally announced March 2022.
-
Next Generation Reservoir Computing
Authors:
Daniel J. Gauthier,
Erik Bollt,
Aaron Griffith,
Wendson A. S. Barbosa
Abstract:
Reservoir computing is a best-in-class machine learning algorithm for processing information generated by dynamical systems using observed time-series data. Importantly, it requires very small training data sets, uses linear optimization, and thus requires minimal computing resources. However, the algorithm uses randomly sampled matrices to define the underlying recurrent neural network and has a…
▽ More
Reservoir computing is a best-in-class machine learning algorithm for processing information generated by dynamical systems using observed time-series data. Importantly, it requires very small training data sets, uses linear optimization, and thus requires minimal computing resources. However, the algorithm uses randomly sampled matrices to define the underlying recurrent neural network and has a multitude of metaparameters that must be optimized. Recent results demonstrate the equivalence of reservoir computing to nonlinear vector autoregression, which requires no random matrices, fewer metaparameters, and provides interpretable results. Here, we demonstrate that nonlinear vector autoregression excels at reservoir computing benchmark tasks and requires even shorter training data sets and training time, heralding the next generation of reservoir computing.
△ Less
Submitted 22 July, 2021; v1 submitted 14 June, 2021;
originally announced June 2021.
-
Reservoir Computing with Superconducting Electronics
Authors:
Graham E. Rowlands,
Minh-Hai Nguyen,
Guilhem J. Ribeill,
Andrew P. Wagner,
Luke C. G. Govia,
Wendson A. S. Barbosa,
Daniel J. Gauthier,
Thomas A. Ohki
Abstract:
The rapidity and low power consumption of superconducting electronics makes them an ideal substrate for physical reservoir computing, which commandeers the computational power inherent to the evolution of a dynamical system for the purposes of performing machine learning tasks. We focus on a subset of superconducting circuits that exhibit soliton-like dynamics in simple transmission line geometrie…
▽ More
The rapidity and low power consumption of superconducting electronics makes them an ideal substrate for physical reservoir computing, which commandeers the computational power inherent to the evolution of a dynamical system for the purposes of performing machine learning tasks. We focus on a subset of superconducting circuits that exhibit soliton-like dynamics in simple transmission line geometries. With numerical simulations we demonstrate the effectiveness of these circuits in performing higher-order parity calculations and channel equalization at rates approaching 100 Gb/s. The availability of a proven superconducting logic scheme considerably simplifies the path to a fully integrated reservoir computing platform and makes superconducting reservoirs an enticing substrate for high rate signal processing applications.
△ Less
Submitted 3 March, 2021;
originally announced March 2021.
-
Symmetry-Aware Reservoir Computing
Authors:
Wendson A. S. Barbosa,
Aaron Griffith,
Graham E. Rowlands,
Luke C. G. Govia,
Guilhem J. Ribeill,
Minh-Hai Nguyen,
Thomas A. Ohki,
Daniel J. Gauthier
Abstract:
We demonstrate that matching the symmetry properties of a reservoir computer (RC) to the data being processed dramatically increases its processing power. We apply our method to the parity task, a challenging benchmark problem that highlights inversion and permutation symmetries, and to a chaotic system inference task that presents an inversion symmetry rule. For the parity task, our symmetry-awar…
▽ More
We demonstrate that matching the symmetry properties of a reservoir computer (RC) to the data being processed dramatically increases its processing power. We apply our method to the parity task, a challenging benchmark problem that highlights inversion and permutation symmetries, and to a chaotic system inference task that presents an inversion symmetry rule. For the parity task, our symmetry-aware RC obtains zero error using an exponentially reduced neural network and training data, greatly speeding up the time to result and outperforming hand crafted artificial neural networks. When both symmetries are respected, we find that the network size $N$ necessary to obtain zero error for 50 different RC instances scales linearly with the parity-order $n$. Moreover, some symmetry-aware RC instances perform a zero error classification with only $N=1$ for $n\leq7$. Furthermore, we show that a symmetry-aware RC only needs a training data set with size on the order of $(n+n/2)$ to obtain such performance, an exponential reduction in comparison to a regular RC which requires a training data set with size on the order of $n2^n$ to contain all $2^n$ possible $n-$bit-long sequences. For the inference task, we show that a symmetry-aware RC presents a normalized root-mean-square error three orders-of-magnitude smaller than regular RCs. For both tasks, our RC approach respects the symmetries by adjusting only the input and the output layers, and not by problem-based modifications to the neural network. We anticipate that generalizations of our procedure can be applied in information processing for problems with known symmetries.
△ Less
Submitted 22 September, 2021; v1 submitted 30 January, 2021;
originally announced February 2021.
-
The statistics of chaos in a bursting laser
Authors:
Wendson A. S. Barbosa,
Edison J. Rosero,
Jorge R. Tredicce,
Jose R. Rios Leite
Abstract:
We demonstrate experimentally how semiconductor lasers subjected to double optical feedback change the statistics of their chaotic spiking dynamics from Gaussian to long-tail Power Law distributions associated to the emergency of bursting. These chaotic regimes, which are features of excitable complex systems, are quantified by the tail exponent $α$ and appear by changing the ratio between the fee…
▽ More
We demonstrate experimentally how semiconductor lasers subjected to double optical feedback change the statistics of their chaotic spiking dynamics from Gaussian to long-tail Power Law distributions associated to the emergency of bursting. These chaotic regimes, which are features of excitable complex systems, are quantified by the tail exponent $α$ and appear by changing the ratio between the feedback times. Transitions to bursting occur in the neighbourhood of low order Farey fractions. The physics behind these transitions is related to the variation of threshold pump current in the compound system as obtained from a deterministic set of rate equations. Numerical integration also verifies the observed chaos transitions indicating the possibility of controlling the bursting chaotic statistics.
△ Less
Submitted 7 February, 2019;
originally announced February 2019.
-
Correlations in Electrically Coupled Chaotic Lasers
Authors:
E. J. Rosero,
W. A. S. Barbosa,
J. F. Martinez Avila,
A. Z. Khoury,
J. R. Rios Leite
Abstract:
We show how two electrically coupled semiconductor lasers having optical feedback can present simultaneous anti-phase correlated fast power fluctuations, and strong in-phase synchronized spikes of chaotic power drops. This quite counter intuitive phenomenon is demonstrated experimentally and confirmed by numerical solutions of a deterministic dynamical system of rate equations. The occurrence of n…
▽ More
We show how two electrically coupled semiconductor lasers having optical feedback can present simultaneous anti-phase correlated fast power fluctuations, and strong in-phase synchronized spikes of chaotic power drops. This quite counter intuitive phenomenon is demonstrated experimentally and confirmed by numerical solutions of a deterministic dynamical system of rate equations. The occurrence of negative and positive cross correlation between parts of a complex system according to time scales, as proved in our simple arrangement, is relevant for the understanding and characterization of collective properties in complex networks.
△ Less
Submitted 20 July, 2016;
originally announced July 2016.
