-
Reservoir Computing with Noise
Authors:
Chad Nathe,
Chandra Pappu,
Nicholas A. Mecholsky,
Joseph D. Hart,
Thomas Carroll,
Francesco Sorrentino
Abstract:
This paper investigates in detail the effects of noise on the performance of reservoir computing. We focus on an application in which reservoir computers are used to learn the relationship between different state variables of a chaotic system. We recognize that noise can affect differently the training and testing phases. We find that the best performance of the reservoir is achieved when the stre…
▽ More
This paper investigates in detail the effects of noise on the performance of reservoir computing. We focus on an application in which reservoir computers are used to learn the relationship between different state variables of a chaotic system. We recognize that noise can affect differently the training and testing phases. We find that the best performance of the reservoir is achieved when the strength of the noise that affects the input signal in the training phase equals the strength of the noise that affects the input signal in the testing phase. For all the cases we examined, we found that a good remedy to noise is to low-pass filter the input and the training/testing signals; this typically preserves the performance of the reservoir, while reducing the undesired effects of noise.
△ Less
Submitted 28 February, 2023;
originally announced March 2023.
-
Time-shift selection for reservoir computing using a rank-revealing QR algorithm
Authors:
Joseph D. Hart,
Francesco Sorrentino,
Thomas L. Carroll
Abstract:
Reservoir computing, a recurrent neural network paradigm in which only the output layer is trained, has demonstrated remarkable performance on tasks such as prediction and control of nonlinear systems. Recently, it was demonstrated that adding time-shifts to the signals generated by a reservoir can provide large improvements in performance accuracy. In this work, we present a technique to choose t…
▽ More
Reservoir computing, a recurrent neural network paradigm in which only the output layer is trained, has demonstrated remarkable performance on tasks such as prediction and control of nonlinear systems. Recently, it was demonstrated that adding time-shifts to the signals generated by a reservoir can provide large improvements in performance accuracy. In this work, we present a technique to choose the time-shifts by maximizing the rank of the reservoir matrix using a rank-revealing QR algorithm. This technique, which is not task dependent, does not require a model of the system, and therefore is directly applicable to analog hardware reservoir computers. We demonstrate our time-shift selection technique on two types of reservoir computer: one based on an opto-electronic oscillator and the traditional recurrent network with a $tanh$ activation function. We find that our technique provides improved accuracy over random time-shift selection in essentially all cases.
△ Less
Submitted 25 April, 2023; v1 submitted 29 November, 2022;
originally announced November 2022.
-
Reservoir Computers Modal Decomposition and Optimization
Authors:
Chad Nathe,
Enrico Del Frate,
Thomas Carroll,
Louis Pecora,
Afroza Shirin,
Francesco Sorrentino
Abstract:
The topology of a network associated with a reservoir computer is often taken so that the connectivity and the weights are chosen randomly. Optimization is hardly considered as the parameter space is typically too large. Here we investigate this problem for a class of reservoir computers for which we obtain a decomposition of the reservoir dynamics into modes, which can be computed independently o…
▽ More
The topology of a network associated with a reservoir computer is often taken so that the connectivity and the weights are chosen randomly. Optimization is hardly considered as the parameter space is typically too large. Here we investigate this problem for a class of reservoir computers for which we obtain a decomposition of the reservoir dynamics into modes, which can be computed independently of one another. Each mode depends on an eigenvalue of the network adjacency matrix. We then take a parametric approach in which the eigenvalues are parameters that can be appropriately designed and optimized. In addition, we introduce the application of a time shift to each individual mode. We show that manipulations of the individual modes, either in terms of the eigenvalues or the time shifts, can lead to dramatic reductions in the training error.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
Decentralized identification and control of networks of coupled mobile platforms through adaptive synchronization of chaos
Authors:
Nicola Bezzo,
Patricio J. Cruz Davalos,
Francesco Sorrentino,
Rafael Fierro
Abstract:
In this paper we propose an application of adaptive synchronization of chaos to detect changes in the topology of a mobile robotic network. We assume that the network may evolve in time due to the relative motion of the mobile robots and due to unknown environmental conditions, such as the presence of obstacles in the environment. We consider that each robotic agent is equipped with a chaotic osci…
▽ More
In this paper we propose an application of adaptive synchronization of chaos to detect changes in the topology of a mobile robotic network. We assume that the network may evolve in time due to the relative motion of the mobile robots and due to unknown environmental conditions, such as the presence of obstacles in the environment. We consider that each robotic agent is equipped with a chaotic oscillator whose state is propagated to the other robots through wireless communication, with the goal of synchronizing the oscillators. We introduce an adaptive strategy that each agent independently implements to: (i) estimate the net coupling of all the oscillators in its neighborhood and (ii) synchronize the state of the oscillators onto the same time evolution. We show that by using this strategy, synchronization can be attained and changes in the network topology can be detected. We go one step forward and consider the possibility of using this information to control the mobile network. We show the potential applicability of our technique to the problem of maintaining a formation between a set of mobile platforms, which operate in an inhomogeneous and uncertain environment. We discuss the importance of using chaotic oscillators and validate our methodology by numerical simulations.
△ Less
Submitted 24 September, 2013;
originally announced September 2013.
-
Observability of Nonlinear Complex Networks in the Presence of Symmetries: A Graphical Approach
Authors:
Afroza Shirin,
Dionicio F. Rios,
Francesco Sorrentino
Abstract:
Reconstructing the states of the nodes of a dynamical network is a problem of fundamental importance in the study of neuronal and genetic networks. An underlying related problem is that of observability, i.e., identifying the conditions under which such a reconstruction is possible. In this paper we study observability of complex dynamical networks, where we consider the effects of network symmetr…
▽ More
Reconstructing the states of the nodes of a dynamical network is a problem of fundamental importance in the study of neuronal and genetic networks. An underlying related problem is that of observability, i.e., identifying the conditions under which such a reconstruction is possible. In this paper we study observability of complex dynamical networks, where we consider the effects of network symmetries on observability. We present an efficient algorithm that returns a minimal set of necessary sensor nodes for observability in the presence of symmetries.
△ Less
Submitted 30 March, 2017; v1 submitted 23 August, 2013;
originally announced August 2013.
-
Effects of variations of load distribution on network performance
Authors:
David Arrowsmith,
Mario di Bernardo,
Francesco Sorrentino
Abstract:
This paper is concerned with the characterization of the relationship between topology and traffic dynamics. We use a model of network generation that allows the transition from random to scale free networks. Specifically, we consider three different topological types of network: random, scale-free with γ= 3, scale-free with γ= 2. By using a novel LRD traffic generator, we observe best performan…
▽ More
This paper is concerned with the characterization of the relationship between topology and traffic dynamics. We use a model of network generation that allows the transition from random to scale free networks. Specifically, we consider three different topological types of network: random, scale-free with γ= 3, scale-free with γ= 2. By using a novel LRD traffic generator, we observe best performance, in terms of transmission rates and delivered packets, in the case of random networks. We show that, even if scale-free networks are characterized by shorter characteristic-path- length (the lower the exponent, the lower the path-length), they show worst performances in terms of communication. We conjecture this could be explained in terms of changes in the load distribution, defined here as the number of shortest paths going through a given vertex. In fact, that distribu- tion is characterized by (i) a decreasing mean (ii) an increas- ing standard deviation, as the networks becomes scale-free (especially scale-free networks with low exponents). The use of a degree-independent server also discriminates against a scale-free structure. As a result, since the model is un- controlled, most packets will go through the same vertices, favoring the onset of congestion.
△ Less
Submitted 31 March, 2005;
originally announced March 2005.
