-
PAC-Bayesian theory for stochastic LTI systems
Authors:
Deividas Eringis,
John Leth,
Zheng-Hua Tan,
Rafal Wisniewski,
Alireza Fakhrizadeh Esfahani,
Mihaly Petreczky
Abstract:
In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dynamical systems, including recurrent neural networks. In turn, PACBayesian error bounds are known to be useful for analyzing machine learning algorithms and for deriving new ones.
In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dynamical systems, including recurrent neural networks. In turn, PACBayesian error bounds are known to be useful for analyzing machine learning algorithms and for deriving new ones.
△ Less
Submitted 25 March, 2021; v1 submitted 23 March, 2021;
originally announced March 2021.
-
Improved PAC-Bayesian Bounds for Linear Regression
Authors:
Vera Shalaeva,
Alireza Fakhrizadeh Esfahani,
Pascal Germain,
Mihaly Petreczky
Abstract:
In this paper, we improve the PAC-Bayesian error bound for linear regression derived in Germain et al. [10]. The improvements are twofold. First, the proposed error bound is tighter, and converges to the generalization loss with a well-chosen temperature parameter. Second, the error bound also holds for training data that are not independently sampled. In particular, the error bound applies to cer…
▽ More
In this paper, we improve the PAC-Bayesian error bound for linear regression derived in Germain et al. [10]. The improvements are twofold. First, the proposed error bound is tighter, and converges to the generalization loss with a well-chosen temperature parameter. Second, the error bound also holds for training data that are not independently sampled. In particular, the error bound applies to certain time series generated by well-known classes of dynamical models, such as ARX models.
△ Less
Submitted 6 December, 2019;
originally announced December 2019.
-
Using the Best Linear Approximation With Varying Excitation Signals for Nonlinear System Characterization
Authors:
Alireza Fakhrizadeh Esfahani,
Johan Schoukens,
Laurent Vanbeylen
Abstract:
Block oriented model structure detection is quite desirable since it helps to imagine the system with real physical elements. In this work we explore experimental methods to detect the internal structure of the system, using a black box approach. Two different strategies are compared and the best combination of these is introduced. The methods are applied on two real systems with a static nonlinea…
▽ More
Block oriented model structure detection is quite desirable since it helps to imagine the system with real physical elements. In this work we explore experimental methods to detect the internal structure of the system, using a black box approach. Two different strategies are compared and the best combination of these is introduced. The methods are applied on two real systems with a static nonlinear block in the feedback path. The main goal is to excite the system in a way that reduces the total distortion in the measured frequency response functions to have more precise measurements and more reliable decision about the structure of the system.
△ Less
Submitted 11 May, 2018;
originally announced May 2018.
-
Parameter reduction in nonlinear state-space identification of hysteresis
Authors:
Alireza Fakhrizadeh Esfahani,
Philippe Dreesen,
Koen Tiels,
Jean-Philippe Noël,
Johan Schoukens
Abstract:
Hysteresis is a highly nonlinear phenomenon, showing up in a wide variety of science and engineering problems. The identification of hysteretic systems from input-output data is a challenging task. Recent work on black-box polynomial nonlinear state-space modeling for hysteresis identification has provided promising results, but struggles with a large number of parameters due to the use of multiva…
▽ More
Hysteresis is a highly nonlinear phenomenon, showing up in a wide variety of science and engineering problems. The identification of hysteretic systems from input-output data is a challenging task. Recent work on black-box polynomial nonlinear state-space modeling for hysteresis identification has provided promising results, but struggles with a large number of parameters due to the use of multivariate polynomials. This drawback is tackled in the current paper by applying a decoupling approach that results in a more parsimonious representation involving univariate polynomials. This work is carried out numerically on input-output data generated by a Bouc-Wen hysteretic model and follows up on earlier work of the authors. The current article discusses the polynomial decoupling approach and explores the selection of the number of univariate polynomials with the polynomial degree, as well as the connections with neural network modeling. We have found that the presented decoupling approach is able to reduce the number of parameters of the full nonlinear model up to about 50\%, while maintaining a comparable output error level.
△ Less
Submitted 29 April, 2017;
originally announced May 2017.
-
A nonlinear state-space approach to hysteresis identification
Authors:
Jean-Philippe Noël,
Alireza F. Esfahani,
Gaetan Kerschen,
Johan Schoukens
Abstract:
Most studies tackling hysteresis identification in the technical literature follow white-box approaches, i.e. they rely on the assumption that measured data obey a specific hysteretic model. Such an assumption may be a hard requirement to handle in real applications, since hysteresis is a highly individualistic nonlinear behaviour. The present paper adopts a black-box approach based on nonlinear s…
▽ More
Most studies tackling hysteresis identification in the technical literature follow white-box approaches, i.e. they rely on the assumption that measured data obey a specific hysteretic model. Such an assumption may be a hard requirement to handle in real applications, since hysteresis is a highly individualistic nonlinear behaviour. The present paper adopts a black-box approach based on nonlinear state-space models to identify hysteresis dynamics. This approach is shown to provide a general framework to hysteresis identification, featuring flexibility and parsimony of representation. Nonlinear model terms are constructed as a multivariate polynomial in the state variables, and parameter estimation is performed by minimising weighted least-squares cost functions. Technical issues, including the selection of the model order and the polynomial degree, are discussed, and model validation is achieved in both broadband and sine conditions. The study is carried out numerically by exploiting synthetic data generated via the Bouc-Wen equations.
△ Less
Submitted 28 October, 2016;
originally announced October 2016.
