-
A master-slave coupling scheme for synchronization and parameter estimation in the generalized Kuramoto-Sivashinsky equation
Authors:
Joaquin Miguez,
Harold Molina-Bulla,
Inés P. Mariño
Abstract:
The problem of estimating the constant parameters of the Kuramoto-Sivashinsky (KS) equation from observed data has received attention from researchers in physics, applied mathematics and statistics. This is motivated by the various physical applications of the equation and, also, because it often serves as a test model for the study of space-time pattern formation. Remarkably, most existing infere…
▽ More
The problem of estimating the constant parameters of the Kuramoto-Sivashinsky (KS) equation from observed data has received attention from researchers in physics, applied mathematics and statistics. This is motivated by the various physical applications of the equation and, also, because it often serves as a test model for the study of space-time pattern formation. Remarkably, most existing inference techniques rely on statistical or machine learning tools, which are computationally very costly yet do not exploit the dynamical features of the system. In this paper we introduce a simple, online parameter estimation method that relies on the synchronization properties of the KS equation. In particular, we describe a master-slave setup where the slave model is driven by observations from the master system. The slave dynamics are data-driven and designed to continuously adapt the model parameters until identical synchronization with the master system is achieved. We provide a simple analysis that supports the proposed approach and also present and discuss the results of an extensive set of computer simulations. Our numerical study shows that the proposed method is computationally fast and also robust to initialization errors, observational noise and variations in the spatial resolution of the numerical scheme used to integrate the KS equation.
△ Less
Submitted 20 April, 2024; v1 submitted 23 November, 2023;
originally announced November 2023.
-
A probabilistic scheme for joint parameter estimation and state prediction in complex dynamical systems
Authors:
Sara Pérez-Vieites,
Inés P. Mariño,
Joaquín Míguez
Abstract:
Many problems in the geophysical sciences demand the ability to calibrate the parameters and predict the time evolution of complex dynamical models using sequentially-collected data. Here we introduce a general methodology for the joint estimation of the static parameters and the forecasting of the state variables of nonlinear, and possibly chaotic, dynamical models. The proposed scheme is essenti…
▽ More
Many problems in the geophysical sciences demand the ability to calibrate the parameters and predict the time evolution of complex dynamical models using sequentially-collected data. Here we introduce a general methodology for the joint estimation of the static parameters and the forecasting of the state variables of nonlinear, and possibly chaotic, dynamical models. The proposed scheme is essentially probabilistic. It aims at recursively computing the sequence of joint posterior probability distributions of the unknown model parameters and its (time varying) state variables conditional on the available observations. The latter are possibly partial and contaminated by noise. The new framework combines a Monte Carlo scheme to approximate the posterior distribution of the fixed parameters with filtering (or {\em data assimilation}) techniques to track and predict the distribution of the state variables. For this reason, we refer to the proposed methodology as {\em nested filtering}. In this paper we specifically explore the use of Gaussian filtering methods, but other approaches fit naturally within the new framework. As an illustrative example, we apply three different implementations of the methodology to the tracking of the state, and the estimation of the fixed parameters, of a stochastic two-scale Lorenz 96 system. This model is commonly used to assess data assimilation procedures in meteorology. For this example, we compare different nested filters and show estimation and forecasting results for a 4,000-dimensional system.
△ Less
Submitted 11 June, 2018; v1 submitted 11 August, 2017;
originally announced August 2017.
-
Multiplex decomposition of non-Markovian dynamics and the hidden layer reconstruction problem
Authors:
Lucas Lacasa,
Inés P. Mariño,
Joaquín Miguez,
Vincenzo Nicosia,
Edgar Roldán,
Ana Lisica,
Stephan W. Grill,
Jesús Gómez-Gardeñes
Abstract:
Elements composing complex systems usually interact in several different ways and as such the interaction architecture is well modelled by a multiplex network. However often this architecture is hidden, as one usually only has experimental access to an aggregated projection. A fundamental challenge is thus to determine whether the hidden underlying architecture of complex systems is better modelle…
▽ More
Elements composing complex systems usually interact in several different ways and as such the interaction architecture is well modelled by a multiplex network. However often this architecture is hidden, as one usually only has experimental access to an aggregated projection. A fundamental challenge is thus to determine whether the hidden underlying architecture of complex systems is better modelled as a single interaction layer or results from the aggregation and interplay of multiple layers. Here we show that using local information provided by a random walker navigating the aggregated network one can decide in a robust way if the underlying structure is a multiplex or not and, in the former case, to determine the most probable number of hidden layers. As a byproduct, we show that the mathematical formalism also provides a principled solution for the optimal decomposition and projection of complex, non-Markovian dynamics into a Markov switching combination of diffusive modes. We validate the proposed methodology with numerical simulations of both (i) random walks navigating hidden multiplex networks (thereby reconstructing the true hidden architecture) and (ii) Markovian and non-Markovian continuous stochastic processes (thereby reconstructing an effective multiplex decomposition where each layer accounts for a different diffusive mode). We also state and prove two existence theorems guaranteeing that an exact reconstruction of the dynamics in terms of these hidden jump-Markov models is always possible for arbitrary finite-order Markovian and fully non-Markovian processes. Finally, we showcase the applicability of the method to experimental recordings from (i) the mobility dynamics of human players in an online multiplayer game and (ii) the dynamics of RNA polymerases at the single-molecule level.
△ Less
Submitted 4 June, 2018; v1 submitted 12 May, 2017;
originally announced May 2017.
-
Analysis of a nonlinear importance sampling scheme for Bayesian parameter estimation in state-space models
Authors:
Joaquin Miguez,
Ines P. Mariño,
Manuel A. Vazquez
Abstract:
The Bayesian estimation of the unknown parameters of state-space (dynamical) systems has received considerable attention over the past decade, with a handful of powerful algorithms being introduced. In this paper we tackle the theoretical analysis of the recently proposed {\it nonlinear} population Monte Carlo (NPMC). This is an iterative importance sampling scheme whose key features, compared to…
▽ More
The Bayesian estimation of the unknown parameters of state-space (dynamical) systems has received considerable attention over the past decade, with a handful of powerful algorithms being introduced. In this paper we tackle the theoretical analysis of the recently proposed {\it nonlinear} population Monte Carlo (NPMC). This is an iterative importance sampling scheme whose key features, compared to conventional importance samplers, are (i) the approximate computation of the importance weights (IWs) assigned to the Monte Carlo samples and (ii) the nonlinear transformation of these IWs in order to prevent the degeneracy problem that flaws the performance of conventional importance samplers. The contribution of the present paper is a rigorous proof of convergence of the nonlinear IS (NIS) scheme as the number of Monte Carlo samples, $M$, increases. Our analysis reveals that the NIS approximation errors converge to 0 almost surely and with the optimal Monte Carlo rate of $M^{-\frac{1}{2}}$. Moreover, we prove that this is achieved even when the mean estimation error of the IWs remains constant, a property that has been termed {\it exact approximation} in the Markov chain Monte Carlo literature. We illustrate these theoretical results by means of a computer simulation example involving the estimation of the parameters of a state-space model typically used for target tracking.
△ Less
Submitted 10 February, 2017;
originally announced February 2017.
-
An iterative importance sampler for Bayesian parameter estimation in stochastic models of multicellular clocks
Authors:
Inés P. Mariño,
Joaquin Miguez,
Alexey Zaikin
Abstract:
We investigate a stochastic version of the synthetic multicellular clock model proposed by Garcia-Ojalvo, Elowitz and Strogatz. By introducing dynamical noise in the model and assuming that the partial observations of the system can be contaminated by additive noise, we enable a principled mechanism to represent experimental uncertainties in the synthesis of the multicellular system and pave the w…
▽ More
We investigate a stochastic version of the synthetic multicellular clock model proposed by Garcia-Ojalvo, Elowitz and Strogatz. By introducing dynamical noise in the model and assuming that the partial observations of the system can be contaminated by additive noise, we enable a principled mechanism to represent experimental uncertainties in the synthesis of the multicellular system and pave the way for the design of probabilistic methods for the estimation of any unknowns in the model. Within this setup, we investigate the use of an iterative importance sampling scheme, termed nonlinear population Monte Carlo (NPMC), for the Bayesian estimation of the model parameters. The algorithm yields a stochastic approximation of the posterior probability distribution of the unknown parameters given the available data (partial and possibly noisy observations). We prove a new theoretical result for this algorithm, which indicates that the approximations converge almost surely to the actual distributions, even when the weights in the importance sampling scheme cannot be computed exactly. We also provide a detailed numerical assessment of the stochastic multicellular model and the accuracy of the proposed NPMC algorithm, including a comparison with the popular particle Metropolis-Hastings algorithm of Andrieu {\em et al.}, 2010, applied to the same model and an approximate Bayesian computation sequential Monte Carlo method introduced by Mariño {\em et al.}, 2013.
△ Less
Submitted 12 December, 2015;
originally announced December 2015.
-
Information encoding in homoclinic chaotic systems
Authors:
I. P. Marino,
E. Allaria,
R. Meucci,
S. Boccaletti,
F. T. Arecchi
Abstract:
In this work we describe a simple method of encoding information at real time in the inter-spike intervals of a homoclinic chaotic system. This has been experimentally tested by means of an instantaneous synchronization between the laser intensity of a CO2 laser with feedback in the regime of Sil'nikov chaos and an external pulsed signal of very low power. The information is previously encoded i…
▽ More
In this work we describe a simple method of encoding information at real time in the inter-spike intervals of a homoclinic chaotic system. This has been experimentally tested by means of an instantaneous synchronization between the laser intensity of a CO2 laser with feedback in the regime of Sil'nikov chaos and an external pulsed signal of very low power. The information is previously encoded in the temporal intervals between consecutive pulses of the external signal. The value of the inter-pulse intervals is varied each time a new pulse is generated.
△ Less
Submitted 20 September, 2001;
originally announced September 2001.
-
Transition to Chaotic Phase Synchronization through Random Phase Jumps
Authors:
D. Pazo,
I. P. Marino,
V. Perez-Munuzuri,
V. Perez-Villar
Abstract:
Phase synchronization is shown to occur between opposite cells of a ring consisting of chaotic Lorenz oscillators coupled unidirectionally through driving. As the coupling strength is diminished, full phase synchronization cannot be achieved due to random generation of phase jumps. The brownian dynamics underlying this process is studied in terms of a stochastic diffusion model of a particle in…
▽ More
Phase synchronization is shown to occur between opposite cells of a ring consisting of chaotic Lorenz oscillators coupled unidirectionally through driving. As the coupling strength is diminished, full phase synchronization cannot be achieved due to random generation of phase jumps. The brownian dynamics underlying this process is studied in terms of a stochastic diffusion model of a particle in a one-dimensional medium.
△ Less
Submitted 15 December, 1999;
originally announced December 1999.
