-
Decoupling multivariate functions using a nonparametric filtered tensor decomposition
Authors:
Jan Decuyper,
Koen Tiels,
Siep Weiland,
Mark C. Runacres,
Johan Schoukens
Abstract:
Multivariate functions emerge naturally in a wide variety of data-driven models. Popular choices are expressions in the form of basis expansions or neural networks. While highly effective, the resulting functions tend to be hard to interpret, in part because of the large number of required parameters. Decoupling techniques aim at providing an alternative representation of the nonlinearity. The so-…
▽ More
Multivariate functions emerge naturally in a wide variety of data-driven models. Popular choices are expressions in the form of basis expansions or neural networks. While highly effective, the resulting functions tend to be hard to interpret, in part because of the large number of required parameters. Decoupling techniques aim at providing an alternative representation of the nonlinearity. The so-called decoupled form is often a more efficient parameterisation of the relationship while being highly structured, favouring interpretability. In this work two new algorithms, based on filtered tensor decompositions of first order derivative information are introduced. The method returns nonparametric estimates of smooth decoupled functions. Direct applications are found in, i.a. the fields of nonlinear system identification and machine learning.
△ Less
Submitted 23 May, 2022;
originally announced May 2022.
-
Applying Polynomial Decoupling Methods to the Polynomial NARX Model
Authors:
Kiana Karami,
David Westwick,
Johan Schoukens
Abstract:
System identification uses measurements of a dynamic system's input and output to reconstruct a mathematical model for that system. These can be mechanical, electrical, physiological, among others. Since most of the systems around us exhibit some form of nonlinear behavior, nonlinear system identification techniques are the tools that will help us gain a better understanding of our surroundings an…
▽ More
System identification uses measurements of a dynamic system's input and output to reconstruct a mathematical model for that system. These can be mechanical, electrical, physiological, among others. Since most of the systems around us exhibit some form of nonlinear behavior, nonlinear system identification techniques are the tools that will help us gain a better understanding of our surroundings and potentially let us improve their performance. One model that is often used to represent nonlinear systems is the polynomial NARX model, an equation error model where the output is a polynomial function of the past inputs and outputs. That said, a major disadvantage with the polynomial NARX model is that the number of parameters increases rapidly with increasing polynomial order. Furthermore, the polynomial NARX model is a black-box model, and is therefore difficult to interpret. This paper discusses a decoupling algorithm for the polynomial NARX model that substitutes the multivariate polynomial with a transformation matrix followed by a bank of univariate polynomials. This decreases the number of model parameters significantly and also imposes structure on the black-box NARX model. Since a non-convex optimization is required for this identification technique, initialization is an important factor to consider. In this paper the decoupling algorithm is developed in conjunction with several different initialization techniques. The resulting algorithms are applied to two nonlinear benchmark problems: measurement data from the Silver-Box and simulation data from the Bouc-Wen friction model, and the performance is evaluated for different validation signals in both simulation and prediction.
△ Less
Submitted 24 February, 2022;
originally announced February 2022.
-
A frequency domain approach for local module identification in dynamic networks
Authors:
Karthik R. Ramaswamy,
Péter Zoltán Csurcsia,
Johan Schoukens,
Paul M. J. Van den Hof
Abstract:
In classical approaches of dynamic network identification, in order to identify a system (module) embedded in a dynamic network, one has to formulate a Multi-input-Single-output (MISO) identification problem that requires identification of a parametric model for all the modules constituting the MISO setup including (possibly) the noise model, and determine their model order. This requirement leads…
▽ More
In classical approaches of dynamic network identification, in order to identify a system (module) embedded in a dynamic network, one has to formulate a Multi-input-Single-output (MISO) identification problem that requires identification of a parametric model for all the modules constituting the MISO setup including (possibly) the noise model, and determine their model order. This requirement leads to model order selection steps for modules that are of no interest to the experimenter which increases the computational complexity for large-sized networks. Also, identification using a parametric noise model (like BJ method) can suffer from local minima, however neglecting the noise model has its impact on the variance of the estimates. In this paper, we provide a two-step identification approach to avoid these problems. The first step involves performing a non-parametric indirect approach for a MISO identification problem to get the non-parametric frequency response function (FRF) estimates and its variance as a function of frequency. In the second step, the estimated non-parametric FRF of the target module is smoothed using a parametric frequency domain estimator with the estimated variance from the previous step as the non-parametric noise model. The developed approach is practical with weak assumptions on noise, uses the available toolbox, requires a parametric model only for the target module of interest, and uses a non-parametric noise model to reduce the variance of the estimates. Numerical simulations illustrate the potentials of the introduced method in comparison with the classical identification methods.
△ Less
Submitted 23 May, 2021;
originally announced May 2021.
-
PNLSS Toolbox 1.0
Authors:
Jan Decuyper,
Koen Tiels,
Johan Schoukens
Abstract:
This is a demonstration of the PNLSS Toolbox 1.0. The toolbox is designed to identify polynomial nonlinear state-space models from data. Nonlinear state-space models can describe a wide range of nonlinear systems. An illustration is provided on experimental data of an electrical system mimicking the forced Duffing oscillator, and on numerical data of a nonlinear fluid dynamics problem.
This is a demonstration of the PNLSS Toolbox 1.0. The toolbox is designed to identify polynomial nonlinear state-space models from data. Nonlinear state-space models can describe a wide range of nonlinear systems. An illustration is provided on experimental data of an electrical system mimicking the forced Duffing oscillator, and on numerical data of a nonlinear fluid dynamics problem.
△ Less
Submitted 18 May, 2021;
originally announced May 2021.
-
Decoupling P-NARX models using filtered CPD
Authors:
Jan Decuyper,
David Westwick,
Kiana Karami,
Johan Schoukens
Abstract:
Nonlinear Auto-Regressive eXogenous input (NARX) models are a popular class of nonlinear dynamical models. Often a polynomial basis expansion is used to describe the internal multivariate nonlinear map** (P-NARX). Resorting to fixed basis functions is convenient since it results in a closed form solution of the estimation problem. The drawback, however, is that the predefined basis does not nece…
▽ More
Nonlinear Auto-Regressive eXogenous input (NARX) models are a popular class of nonlinear dynamical models. Often a polynomial basis expansion is used to describe the internal multivariate nonlinear map** (P-NARX). Resorting to fixed basis functions is convenient since it results in a closed form solution of the estimation problem. The drawback, however, is that the predefined basis does not necessarily lead to a sparse representation of the relationship, typically resulting in very large numbers of parameters. So-called decoupling techniques were specifically designed to reduce large multivariate functions. It was found that, often, a more efficient parameterisation can be retrieved by rotating towards a new basis. Characteristic to the decoupled structure is that, expressed in the new basis, the relationship is structured such that only single-input single-output nonlinear functions are required. Classical decoupling techniques are unfit to deal with the case of single-output NARX models. In this work, this limitation is overcome by adopting the filtered CPD decoupling method of Decuyper et al. (2021b). The approach is illustrated on data from the Sliverbox benchmark: measurement data from an electronic circuit implementation of a forced Duffing oscillator.
△ Less
Submitted 18 May, 2021;
originally announced May 2021.
-
Decoupling multivariate functions using a non-parametric Filtered CPD approach
Authors:
Jan Decuyper,
Koen Tiels,
Siep Weiland,
Johan Schoukens
Abstract:
Black-box model structures are dominated by large multivariate functions. Usually a generic basis function expansion is used, e.g. a polynomial basis, and the parameters of the function are tuned given the data. This is a pragmatic and often necessary step considering the black-box nature of the problem. However, having identified a suitable function, there is no need to stick to the original basi…
▽ More
Black-box model structures are dominated by large multivariate functions. Usually a generic basis function expansion is used, e.g. a polynomial basis, and the parameters of the function are tuned given the data. This is a pragmatic and often necessary step considering the black-box nature of the problem. However, having identified a suitable function, there is no need to stick to the original basis. So-called decoupling techniques aim at translating multivariate functions into an alternative basis, thereby both reducing the number of parameters and retrieving underlying structure. In this work a filtered canonical polyadic decomposition (CPD) is introduced. It is a non-parametric method which is able to retrieve decoupled functions even when facing non-unique decompositions. Tackling this obstacle paves the way for a large number of modelling applications.
△ Less
Submitted 18 May, 2021;
originally announced May 2021.
-
A nonlinear model of vortex-induced forces on an oscillating cylinder in a fluid flow
Authors:
Jan Decuyper,
Tim De Troyer,
Koen Tiels,
Johan Schoukens,
Mark C. Runacres
Abstract:
A nonlinear model relating the imposed motion of a circular cylinder, submerged in a fluid flow, to the transverse force coefficient is presented. The nonlinear fluid system, featuring vortex shedding patterns, limit cycle oscillations and synchronisation, is studied both for swept sine and multisine excitation. A nonparametric nonlinear distortion analysis (FAST) is used to distinguish odd from e…
▽ More
A nonlinear model relating the imposed motion of a circular cylinder, submerged in a fluid flow, to the transverse force coefficient is presented. The nonlinear fluid system, featuring vortex shedding patterns, limit cycle oscillations and synchronisation, is studied both for swept sine and multisine excitation. A nonparametric nonlinear distortion analysis (FAST) is used to distinguish odd from even nonlinear behaviour. The information which is obtained from the nonlinear analysis is explicitly used in constructing a nonlinear model of the polynomial nonlinear state-space (PNLSS) type. The latter results in a reduction of the number of parameters and an increased accuracy compared to the generic modelling approach where typically no such information of the nonlinearity is used. The obtained model is able to accurately simulate time series of the transverse force coefficient over a wide range of the frequency-amplitude plane of imposed cylinder motion.
△ Less
Submitted 10 June, 2020;
originally announced June 2020.
-
Phase-randomised Fourier transform model for the generation of synthetic wind speeds
Authors:
D. D'Ambrosio,
J. Schoukens,
T. De Troyer,
M. Zivanovic,
M. C. Runacres
Abstract:
The increasing sophistication of wind turbine design and control generates a need for high-quality data. Therefore, the relatively limited set of measured wind data may be extended with computer-generated surrogate data, e.g. to make reliable statistical studies of energy production and mechanical loads. This paper presents a data-driven, statistical model for the generation of realistic surrogate…
▽ More
The increasing sophistication of wind turbine design and control generates a need for high-quality data. Therefore, the relatively limited set of measured wind data may be extended with computer-generated surrogate data, e.g. to make reliable statistical studies of energy production and mechanical loads. This paper presents a data-driven, statistical model for the generation of realistic surrogate time series that is based on the phase-randomised Fourier transform. The proposed model simulates an ergodic, pseudo-random process that makes use of an iterative rank-reordering procedure to yield synthetic time series that possess the power spectral density of the target data and concurrently converges to the probability distribution of the target data with an arbitrary, user-defined precision. A comparison with two established data-driven modelling techniques for generating surrogate wind speeds is presented. The proposed model is tested under the same input conditions given in the test cases of the selected models, and its performance is investigated in terms of the agreement with the target statistical descriptors. Simulation results show that the proposed model can reproduce with high fidelity the statistical descriptors of the input datasets and is able to capture the nonstationary diurnal and seasonal variations of the wind speed.
△ Less
Submitted 26 February, 2021; v1 submitted 13 March, 2020;
originally announced March 2020.
-
Retrieving highly structured models starting from black-box nonlinear state-space models using polynomial decoupling
Authors:
Jan Decuyper,
Koen Tiels,
Mark C. Runacres,
Johan Schoukens
Abstract:
Nonlinear state-space modelling is a very powerful black-box modelling approach. However powerful, the resulting models tend to be complex, described by a large number of parameters. In many cases interpretability is preferred over complexity, making too complex models unfit or undesired. In this work, the complexity of such models is reduced by retrieving a more structured, parsimonious model fro…
▽ More
Nonlinear state-space modelling is a very powerful black-box modelling approach. However powerful, the resulting models tend to be complex, described by a large number of parameters. In many cases interpretability is preferred over complexity, making too complex models unfit or undesired. In this work, the complexity of such models is reduced by retrieving a more structured, parsimonious model from the data, without exploiting physical knowledge. Essential to the method is a translation of all multivariate nonlinear functions, typically found in nonlinear state-space models, into sets of univariate nonlinear functions. The latter is computed from a tensor decomposition. It is shown that typically an excess of degrees of freedom are used in the description of the nonlinear system whereas reduced representations can be found. The method yields highly structured state-space models where the nonlinearity is contained in as little as a single univariate function, with limited loss of performance. Results are illustrated on simulations and experiments for: the forced Duffing oscillator, the forced Van der Pol oscillator, a Bouc-Wen hysteretic system, and a Li-Ion battery model.
△ Less
Submitted 9 January, 2020;
originally announced January 2020.
-
Nonlinear System Identification: A User-Oriented Roadmap
Authors:
Johan Schoukens,
Lennart Ljung
Abstract:
The goal of this article is twofold. Firstly, nonlinear system identification is introduced to a wide audience, guiding practicing engineers and newcomers in the field to a sound solution of their data driven modeling problems for nonlinear dynamic systems. In addition, the article also provides a broad perspective on the topic to researchers that are already familiar with the linear system identi…
▽ More
The goal of this article is twofold. Firstly, nonlinear system identification is introduced to a wide audience, guiding practicing engineers and newcomers in the field to a sound solution of their data driven modeling problems for nonlinear dynamic systems. In addition, the article also provides a broad perspective on the topic to researchers that are already familiar with the linear system identification theory, showing the similarities and differences between the linear and nonlinear problem. The reader will be referred to the existing literature for detailed mathematical explanations and formal proofs. Here the focus is on the basic philosophy, giving an intuitive understanding of the problems and the solutions, by making a guided tour along the wide range of user choices in nonlinear system identification. Guidelines will be given in addition to many examples, to reach that goal.
△ Less
Submitted 2 February, 2019;
originally announced February 2019.
-
Data-Driven Nonlinear Identification of Li-Ion Battery Based on a Frequency Domain Nonparametric Analysis
Authors:
Rishi Relan,
Yousef Firouz,
Jean-Marc Timmermans,
Johan Schoukens
Abstract:
Lithium ion batteries are attracting significant and growing interest, because their high energy and high power density render them an excellent option for energy storage, particularly in hybrid and electric vehicles. In this brief, a data-driven polynomial nonlinear state-space model is proposed for the operating points at the cusp of linear and nonlinear regimes of the battery's electrical opera…
▽ More
Lithium ion batteries are attracting significant and growing interest, because their high energy and high power density render them an excellent option for energy storage, particularly in hybrid and electric vehicles. In this brief, a data-driven polynomial nonlinear state-space model is proposed for the operating points at the cusp of linear and nonlinear regimes of the battery's electrical operation, based on the thorough nonparametric frequency domain characterization and quantification of the battery's behavior in terms of its linear and nonlinear behavior at different levels of the state of charge.
△ Less
Submitted 17 May, 2018;
originally announced May 2018.
-
Data driven discrete-time parsimonious identification of a nonlinear state-space model for a weakly nonlinear system with short data record
Authors:
Rishi Relan,
Koen Tiels,
Anna Marconato,
Philippe Dreesen,
Johan Schoukens
Abstract:
Many real world systems exhibit a quasi linear or weakly nonlinear behavior during normal operation, and a hard saturation effect for high peaks of the input signal. In this paper, a methodology to identify a parsimonious discrete-time nonlinear state space model (NLSS) for the nonlinear dynamical system with relatively short data record is proposed. The capability of the NLSS model structure is d…
▽ More
Many real world systems exhibit a quasi linear or weakly nonlinear behavior during normal operation, and a hard saturation effect for high peaks of the input signal. In this paper, a methodology to identify a parsimonious discrete-time nonlinear state space model (NLSS) for the nonlinear dynamical system with relatively short data record is proposed. The capability of the NLSS model structure is demonstrated by introducing two different initialisation schemes, one of them using multivariate polynomials. In addition, a method using first-order information of the multivariate polynomials and tensor decomposition is employed to obtain the parsimonious decoupled representation of the set of multivariate real polynomials estimated during the identification of NLSS model. Finally, the experimental verification of the model structure is done on the cascaded water-benchmark identification problem.
△ Less
Submitted 16 May, 2018;
originally announced May 2018.
-
A Local Polynomial Approach to Nonparametric Estimation of the Best Linear Approximation of Lithium-Ion Battery From Multiple Datasets
Authors:
Rishi Relan,
Koen Tiels,
Jean-Marc Timmermans,
Johan Schoukens
Abstract:
Battery short-term electrical impedance behavior varies between linear, linear time-varying, or nonlinear at different operating conditions. Data-based electrical impedance modeling techniques often model the battery as a linear time-invariant system at all operating conditions. In addition, these techniques require extensive and time consuming experimentation. Often due to sensor failures during…
▽ More
Battery short-term electrical impedance behavior varies between linear, linear time-varying, or nonlinear at different operating conditions. Data-based electrical impedance modeling techniques often model the battery as a linear time-invariant system at all operating conditions. In addition, these techniques require extensive and time consuming experimentation. Often due to sensor failures during experiments, constraints in data acquisition hardware, varying operating conditions, and the slow dynamics of the battery, it is not always possible to acquire data in a single experiment. Hence, multiple experiments must be performed. In this letter, a local polynomial approach is proposed to estimate nonparametrically the best linear approximation of the electrical impedance affected by varying levels of nonlinear distortion, from a series of input current and output voltage data subrecords of arbitrary length.
△ Less
Submitted 16 May, 2018;
originally announced May 2018.
-
Recursive Discrete-Time Models for Continuous-Time Systems Under Band-Limited Assumptions
Authors:
Rishi Relan,
Johan Schoukens
Abstract:
Discrete-time models are very convenient to simulate a nonlinear system on a computer. In order to build the discrete-time simulation models for the nonlinear feedback systems (which is a very important class of systems in many applications) described as y(t) = g1(u(t), y(t)), one has to solve at each time step a nonlinear algebraic loop for y(t). If a delay is present in the loop, i.e., y(t) = g2…
▽ More
Discrete-time models are very convenient to simulate a nonlinear system on a computer. In order to build the discrete-time simulation models for the nonlinear feedback systems (which is a very important class of systems in many applications) described as y(t) = g1(u(t), y(t)), one has to solve at each time step a nonlinear algebraic loop for y(t). If a delay is present in the loop, i.e., y(t) = g2(u(t), y(t -1)), fast recursive simulation models can be developed and the need to solve the nonlinear differential-algebraic equations is removed. In this paper, we use the latter to model the nonlinear feedback system using recursive discrete-time models. Theoretical error bounds for such kind of approximated models are provided in the case of band-limited signals, and furthermore, a measurement methodology is proposed for quantifying and validating the output error bounds experimentally.
△ Less
Submitted 14 May, 2018;
originally announced May 2018.
-
Using the Best Linear Approximation With Varying Excitation Signals for Nonlinear System Characterization
Authors:
Alireza Fakhrizadeh Esfahani,
Johan Schoukens,
Laurent Vanbeylen
Abstract:
Block oriented model structure detection is quite desirable since it helps to imagine the system with real physical elements. In this work we explore experimental methods to detect the internal structure of the system, using a black box approach. Two different strategies are compared and the best combination of these is introduced. The methods are applied on two real systems with a static nonlinea…
▽ More
Block oriented model structure detection is quite desirable since it helps to imagine the system with real physical elements. In this work we explore experimental methods to detect the internal structure of the system, using a black box approach. Two different strategies are compared and the best combination of these is introduced. The methods are applied on two real systems with a static nonlinear block in the feedback path. The main goal is to excite the system in a way that reduces the total distortion in the measured frequency response functions to have more precise measurements and more reliable decision about the structure of the system.
△ Less
Submitted 11 May, 2018;
originally announced May 2018.
-
Measuring the Noise Cumulative Distribution Function Using Quantized Data
Authors:
Paolo Carbone,
Johan Schoukens,
István Kollár,
Antonio Moschitta
Abstract:
This paper considers the problem of estimating the cumulative distribution function and probability density function of a random variable using data quantized by uniform and non-uniform quantizers. A simple estimator is proposed based on the empirical distribution function that also takes the values of the quantizer transition levels into account. The properties of this estimator are discussed and…
▽ More
This paper considers the problem of estimating the cumulative distribution function and probability density function of a random variable using data quantized by uniform and non-uniform quantizers. A simple estimator is proposed based on the empirical distribution function that also takes the values of the quantizer transition levels into account. The properties of this estimator are discussed and analyzed at first by simulations. Then by removing all assumptions that are difficult to apply, a new procedure is described that does not require neither the transition levels nor the input sequence used to source the quantizer to be known. The experimental results obtained using a commercial 12-b data acquisition system show the applicability of this estimator to real-world type of problems.
△ Less
Submitted 2 May, 2018;
originally announced May 2018.
-
Improved Tactile Resonance Sensor for Robotic Assisted Surgery
Authors:
David Oliva Uribe,
Johan Schoukens,
Ralf Stroop
Abstract:
This paper presents an improved tactile sensor using a piezoelectric bimorph able to differentiate soft materials with similar mechanical characteristics. The final aim is to develop intelligent surgical tools for brain tumour resection using integrated sensors in order to improve tissue tumour delineation and tissue differentiation. The bimorph sensor is driven using a random phase multisine and…
▽ More
This paper presents an improved tactile sensor using a piezoelectric bimorph able to differentiate soft materials with similar mechanical characteristics. The final aim is to develop intelligent surgical tools for brain tumour resection using integrated sensors in order to improve tissue tumour delineation and tissue differentiation. The bimorph sensor is driven using a random phase multisine and the properties of contact between the sensor's tip and a certain load are evaluated by means of the evaluation of the nonparametric FRF. An analysis of the nonlinear contributions is presented to show that the use of a linear model is feasible for the measurement conditions. A series of gelatine phantoms were tested. The tactile sensor is able to identify minimal differences in the consistency of the measured samples considering viscoelastic behaviour. A variance analysis was performed to evaluate the reliability of the sensors and to identify possible error sources due to inconsistencies in the preparation method of the phantoms. The results of the variance analysis are discussed showing that ability of the proposed tactile sensor to perform high quality measurements.
△ Less
Submitted 2 May, 2018;
originally announced May 2018.
-
Grey-box state-space identification of nonlinear mechanical vibrations
Authors:
Jean-Philippe Noël,
Johan Schoukens
Abstract:
The present paper deals with the identification of nonlinear mechanical vibrations. A grey-box, or semi-physical, nonlinear state-space representation is introduced, expressing the nonlinear basis functions using a limited number of measured output variables. This representation assumes that the observed nonlinearities are localised in physical space, which is a generic case in mechanics. A two-st…
▽ More
The present paper deals with the identification of nonlinear mechanical vibrations. A grey-box, or semi-physical, nonlinear state-space representation is introduced, expressing the nonlinear basis functions using a limited number of measured output variables. This representation assumes that the observed nonlinearities are localised in physical space, which is a generic case in mechanics. A two-step identification procedure is derived for the grey-box model parameters, integrating nonlinear subspace initialisation and weighted least-squares optimisation. The complete procedure is applied to an electrical circuit mimicking the behaviour of a single-input, single-output (SISO) nonlinear mechanical system and to a single-input, multiple-output (SIMO) geometrically nonlinear beam structure.
△ Less
Submitted 28 April, 2018;
originally announced April 2018.
-
Accurate Sine-Wave Amplitude Measurements Using Nonlinearly Quantized Data
Authors:
Paolo Carbone,
Johan Schoukens,
István Kollár,
Antonio Moschitta
Abstract:
The estimation of the amplitude of a sine wave from the sequence of its quantized samples is a typical problem in instrumentation and measurement. A standard approach for its solution makes use of a least squares estimator (LSE) that, however, does not perform optimally in the presence of quantization errors. In fact, if the quantization error cannot be modeled as an additive noise source, as it o…
▽ More
The estimation of the amplitude of a sine wave from the sequence of its quantized samples is a typical problem in instrumentation and measurement. A standard approach for its solution makes use of a least squares estimator (LSE) that, however, does not perform optimally in the presence of quantization errors. In fact, if the quantization error cannot be modeled as an additive noise source, as it often happens in practice, the LSE returns biased estimates. In this paper, we consider the estimation of the amplitude of a noisy sine wave after quantization. The proposed technique is based on a uniform distribution of signal phases and it does not require that the quantizer has equally spaced transition levels. The experimental results show that this technique removes the estimation bias associated with the usage of the LSE and that it is sufficiently robust with respect to small uncertainties in the known values of transition levels.
△ Less
Submitted 27 April, 2018;
originally announced April 2018.
-
Regularized Nonparametric Volterra Kernel Estimation
Authors:
Georgios Birpoutsoukis,
Anna Marconato,
John Lataire,
Johan Schoukens
Abstract:
In this paper, the regularization approach introduced recently for nonparametric estimation of linear systems is extended to the estimation of nonlinear systems modelled as Volterra series. The kernels of order higher than one, representing higher dimensional impulse responses in the series, are considered to be realizations of multidimensional Gaussian processes. Based on this, prior information…
▽ More
In this paper, the regularization approach introduced recently for nonparametric estimation of linear systems is extended to the estimation of nonlinear systems modelled as Volterra series. The kernels of order higher than one, representing higher dimensional impulse responses in the series, are considered to be realizations of multidimensional Gaussian processes. Based on this, prior information about the structure of the Volterra kernel is introduced via an appropriate penalization term in the least squares cost function. It is shown that the proposed method is able to deliver accurate estimates of the Volterra kernels even in the case of a small amount of data points.
△ Less
Submitted 27 April, 2018;
originally announced April 2018.
-
Information and Statistical Efficiency When Quantizing Noisy DC Values
Authors:
Antonio Moschitta,
Johan Schoukens,
Paolo Carbone
Abstract:
This paper considers estimation of a quantized constant in noise when using uniform and nonuniform quantizers. Estimators based on simple arithmetic averages, on sample statistical moments and on the maximum-likelihood procedure are considered. It provides expressions for the statistical efficiency of the arithmetic mean by comparing its variance to the proper Cramér-Rao lower bound. It is conject…
▽ More
This paper considers estimation of a quantized constant in noise when using uniform and nonuniform quantizers. Estimators based on simple arithmetic averages, on sample statistical moments and on the maximum-likelihood procedure are considered. It provides expressions for the statistical efficiency of the arithmetic mean by comparing its variance to the proper Cramér-Rao lower bound. It is conjectured that the arithmetic mean is optimal among all estimators with an exactly known bias. Conditions under which its statistical performance are improved by the other estimation procedures when the exact bias is not known are found and analyzed. Using simulations and analysis of experimental data, it is shown that both moment-based and maximum-likelihood-based estimators provide better results, when the noise standard deviation is comparable with the quantization step and the noise model of quantization can not be applied.
△ Less
Submitted 27 April, 2018;
originally announced April 2018.
-
Efficient Multidimensional Regularization for Volterra Series Estimation
Authors:
Georgios Birpoutsoukis,
Péter Zoltán Csurcsia,
Johan Schoukens
Abstract:
This paper presents an efficient nonparametric time domain nonlinear system identification method. It is shown how truncated Volterra series models can be efficiently estimated without the need of long, transient-free measurements. The method is a novel extension of the regularization methods that have been developed for impulse response estimates of linear time invariant systems. To avoid the exc…
▽ More
This paper presents an efficient nonparametric time domain nonlinear system identification method. It is shown how truncated Volterra series models can be efficiently estimated without the need of long, transient-free measurements. The method is a novel extension of the regularization methods that have been developed for impulse response estimates of linear time invariant systems. To avoid the excessive memory needs in case of long measurements or large number of estimated parameters, a practical gradient-based estimation method is also provided, leading to the same numerical results as the proposed Volterra estimation method. Moreover, the transient effects in the simulated output are removed by a special regularization method based on the novel ideas of transient removal for Linear Time-Varying (LTV) systems. Combining the proposed methodologies, the nonparametric Volterra models of the cascaded water tanks benchmark are presented in this paper. The results for different scenarios varying from a simple Finite Impulse Response (FIR) model to a 3rd degree Volterra series with and without transient removal are compared and studied. It is clear that the obtained models capture the system dynamics when tested on a validation dataset, and their performance is comparable with the white-box (physical) models.
△ Less
Submitted 26 April, 2018;
originally announced April 2018.
-
Structure detection of Wiener-Hammerstein systems with process noise
Authors:
Erliang Zhang,
Maarten Schoukens,
Johan Schoukens
Abstract:
Identification of nonlinear block-oriented models has been extensively studied. The presence of the process noise, more precisely its location in the block-oriented model influences essentially the development of a consistent identification algorithm. The present work is proposed with the aim to localize the process noise in the block-oriented model for accurate nonlinear modeling. To this end, th…
▽ More
Identification of nonlinear block-oriented models has been extensively studied. The presence of the process noise, more precisely its location in the block-oriented model influences essentially the development of a consistent identification algorithm. The present work is proposed with the aim to localize the process noise in the block-oriented model for accurate nonlinear modeling. To this end, the response of a Wiener-Hammerstein system is theoretically analyzed, the disturbance component in the output, caused by the process noise preceding the static nonlinearity, is shown to be dependent on the input signal. Inspired by such theoretical observation, a simple and new protocol is developed to determine the location of the process noise with respect to the static nonlinearity by using an input signal that is periodic, but nonstationary within one period. In addition, the proposed technique is promising to detect the type of certain static nonlinearity (e.g., dead-zone, saturation). Finally, it is validated on a simulated example and a real-life benchmark.
△ Less
Submitted 26 April, 2018;
originally announced April 2018.
-
Parametric System Identification Using Quantized Data
Authors:
Antonio Moschitta,
Johan Schoukens,
Paolo Carbone
Abstract:
The estimation of signal parameters using quantized data is a recurrent problem in electrical engineering. As an example, this includes the estimation of a noisy constant value and of the parameters of a sinewave, that is, its amplitude, initial record phase, and offset. Conventional algorithms, such as the arithmetic mean, in the case of the estimation of a constant, are known not to be optimal i…
▽ More
The estimation of signal parameters using quantized data is a recurrent problem in electrical engineering. As an example, this includes the estimation of a noisy constant value and of the parameters of a sinewave, that is, its amplitude, initial record phase, and offset. Conventional algorithms, such as the arithmetic mean, in the case of the estimation of a constant, are known not to be optimal in the presence of quantization errors. They provide biased estimates if particular conditions regarding the quantization process are not met, as it usually happens in practice. In this paper, a quantile-based estimator is presented, which is based on the Gauss-Markov theorem. The general theory is first described and the estimator is then applied to both direct current and alternate current input signals with unknown characteristics. Using simulations and experimental results, it is shown that the new estimator outperforms conventional estimators in both problems, by removing the estimation bias.
△ Less
Submitted 26 April, 2018;
originally announced April 2018.
-
Structure Discrimination in Block-Oriented Models Using Linear Approximations: A Theoretic Framework
Authors:
Johan Schoukens,
Rik Pintelon,
Yves Rolain,
Maarten Schoukens,
Koen Tiels,
Laurent Vanbeylen,
Anne Van Mulders,
Gerd Vandersteen
Abstract:
In this paper we show that it is possible to retrieve structural information about complex block-oriented nonlinear systems, starting from linear approximations of the nonlinear system around different setpoints.The key idea is to monitor the movements of the poles and zeros of the linearized models and to reduce the number of candidate models on the basis of these observations. Besides the well k…
▽ More
In this paper we show that it is possible to retrieve structural information about complex block-oriented nonlinear systems, starting from linear approximations of the nonlinear system around different setpoints.The key idea is to monitor the movements of the poles and zeros of the linearized models and to reduce the number of candidate models on the basis of these observations. Besides the well known open loop single branch Wiener-, Hammerstein-, and Wiener-Hammerstein systems, we also cover a number of more general structures like parallel (multi branch) Wiener-Hammerstein models, and closed loop block oriented models, including linear fractional representation (LFR) models.
△ Less
Submitted 25 April, 2018;
originally announced April 2018.
-
Linear System Identification in a Nonlinear Setting - Nonparametric analysis of the nonlinear distortions and their impact on the best linear approximation
Authors:
Johan Schoukens,
Mark Vaes,
Rik Pintelon
Abstract:
This article addresses the following problems: 1) First, a nonlinearity analysis is made looking for the presence of nonlinearities in an early phase of the identification process. The level and the nature of the nonlinearities should be retrieved without a significant increase in the amount of measured data. 2) Next it is studied if it is safe to use a linear system identification approach, even…
▽ More
This article addresses the following problems: 1) First, a nonlinearity analysis is made looking for the presence of nonlinearities in an early phase of the identification process. The level and the nature of the nonlinearities should be retrieved without a significant increase in the amount of measured data. 2) Next it is studied if it is safe to use a linear system identification approach, even if the presence of nonlinear distortions is detected. The properties of the linear system identification approach under these conditions are studied, and the reliability of the uncertainty bounds is checked. 3) Eventually, tools are provided to check how much can be gained if a nonlinear model were identified instead of a linear model.
Addressing these three questions forms the outline of this article. The possibilities and pitfalls of using a linear identification framework in the presence of nonlinear distortions will be discussed and illustrated on lab-scale and industrial examples.
In this article, the focus is on nonparametric and parametric black box identification methods, however the results might also be useful for physical modeling methods. Knowing the actual nonlinear distortion level can help to choose the required level of detail that is needed in the physical model. This will strongly influence the modeling effort. Also, in this case, significant time can be saved if it is known from experiments that the system behaves almost linearly. The converse is also true. If the experiments show that some (sub-)systems are highly nonlinear, it helps to focus the physical modeling effort on these critical elements.
△ Less
Submitted 25 April, 2018;
originally announced April 2018.
-
Improved Initialization for Nonlinear State-Space Modeling
Authors:
A. Marconato,
J. Sjöberg,
J. A. K. Suykens,
J. Schoukens
Abstract:
This paper discusses a novel initialization algorithm for the estimation of nonlinear state-space models. Good initial values for the model parameters are obtained by identifying separately the linear dynamics and the nonlinear terms in the model. In particular, the nonlinear dynamic problem is transformed into an approximate static formulation, and simple regression methods are applied to obtain…
▽ More
This paper discusses a novel initialization algorithm for the estimation of nonlinear state-space models. Good initial values for the model parameters are obtained by identifying separately the linear dynamics and the nonlinear terms in the model. In particular, the nonlinear dynamic problem is transformed into an approximate static formulation, and simple regression methods are applied to obtain the solution in a fast and efficient way. The proposed method is validated by means of two measurement examples: the Wiener-Hammerstein benchmark problem, and the identification of a crystal detector.
△ Less
Submitted 23 April, 2018;
originally announced April 2018.
-
Nonlinear state-space modelling of the kinematics of an oscillating circular cylinder in a fluid flow
Authors:
Jan Decuyper,
Tim De Troyer,
Mark Runacres,
Koen Tiels,
Johan Schoukens
Abstract:
The flow-induced vibration of bluff bodies is an important problem of many marine, civil, or mechanical engineers. In the design phase of such structures, it is vital to obtain good predictions of the fluid forces acting on the structure. Current methods rely on computational fluid dynamic simulations (CFD), with a too high computational cost to be effectively used in the design phase or for contr…
▽ More
The flow-induced vibration of bluff bodies is an important problem of many marine, civil, or mechanical engineers. In the design phase of such structures, it is vital to obtain good predictions of the fluid forces acting on the structure. Current methods rely on computational fluid dynamic simulations (CFD), with a too high computational cost to be effectively used in the design phase or for control applications. Alternative methods use heuristic mathematical models of the fluid forces, but these lack the accuracy (they often assume the system to be linear) or flexibility to be useful over a wide operating range.
In this work we show that it is possible to build an accurate, flexible and low-computational-cost mathematical model using nonlinear system identification techniques. This model is data driven: it is trained over a user-defined region of interest using data obtained from experiments or simulations, or both. Here we use a Van der Pol oscillator as well as CFD simulations of an oscillating circular cylinder to generate the training data. Then a discrete-time polynomial nonlinear state-space model is fit to the data. This model relates the oscillation of the cylinder to the force that the fluid exerts on the cylinder. The model is finally validated over a wide range of oscillation frequencies and amplitudes, both inside and outside the so-called lock-in region. We show that forces simulated by the model are in good agreement with the data obtained from CFD.
△ Less
Submitted 23 April, 2018;
originally announced April 2018.
-
Practical Issues in the Synthesis of Ternary Sequences
Authors:
Alessio De Angelis,
Johan Schoukens,
Keith R. Godfrey,
Paolo Carbone
Abstract:
Several issues related to the practical synthesis of ternary sequences with specified spectra are addressed in this paper. Specifically, sequences with harmonic multiples of two and three suppressed are studied, given their relevance when testing and characterizing nonlinear systems. In particular, the effect of non-uniform Digital to Analog Converter (DAC) levels on the spectral properties of the…
▽ More
Several issues related to the practical synthesis of ternary sequences with specified spectra are addressed in this paper. Specifically, sequences with harmonic multiples of two and three suppressed are studied, given their relevance when testing and characterizing nonlinear systems. In particular, the effect of non-uniform Digital to Analog Converter (DAC) levels on the spectral properties of the generated signal is analyzed. It is analytically shown that the DAC non-uniform levels result in degraded harmonic suppression performance. Moreover, a new approach is proposed for designing ternary sequences, which is flexible and can be adapted to suit different requirements. The resulting sequences, denoted as randomized constrained sequences, are characterized theoretically by deriving an analytical expression of the power spectral density. Furthermore, they are extensively compared with three synthesis approaches proposed in the literature. The approach is validated by numerical simulations and experimental results, showing the potential to achieve harmonic suppression performance of approximately 100 dB.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
A Rigorous Analysis of Least Squares Sine Fitting Using Quantized Data: the Random Phase Case
Authors:
Paolo Carbone,
Johan Schoukens
Abstract:
This paper considers least-square based estimation of the amplitude and square amplitude of a quantized sine wave, done by considering random initial record phase. Using amplitude- and frequency-domain modeling techniques, it is shown that the estimator is inconsistent, biased and has a variance that may be underestimated if the simple model of quantization is applied. The effects of both sine wav…
▽ More
This paper considers least-square based estimation of the amplitude and square amplitude of a quantized sine wave, done by considering random initial record phase. Using amplitude- and frequency-domain modeling techniques, it is shown that the estimator is inconsistent, biased and has a variance that may be underestimated if the simple model of quantization is applied. The effects of both sine wave offset values and additive Gaussian noise are taken into account. General estimator properties are derived, without making simplifying assumptions on the role of the quantization process, to allow assessment of measurement uncertainty, when this least-square procedure is used.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
Extending the Best Linear Approximation Framework to the Process Noise Case
Authors:
Maarten Schoukens,
Rik Pintelon,
Tadeusz P. Dobrowiecki,
Johan Schoukens
Abstract:
The Best Linear Approximation (BLA) framework has already proven to be a valuable tool to analyze nonlinear systems and to start the nonlinear modeling process. The existing BLA framework is limited to systems with additive (colored) noise at the output. Such a noise framework is a simplified representation of reality. Process noise can play an important role in many real-life applications.
This…
▽ More
The Best Linear Approximation (BLA) framework has already proven to be a valuable tool to analyze nonlinear systems and to start the nonlinear modeling process. The existing BLA framework is limited to systems with additive (colored) noise at the output. Such a noise framework is a simplified representation of reality. Process noise can play an important role in many real-life applications.
This paper generalizes the Best Linear Approximation framework to account also for the process noise, both for the open-loop and the closed-loop setting, and shows that the most important properties of the existing BLA framework remain valid. The impact of the process noise contributions on the robust BLA estimation method is also analyzed.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
Comparison of several data-driven nonlinear system identification methods on a simplified glucoregulatory system example
Authors:
Anna Marconato,
Maarten Schoukens,
Koen Tiels,
W. Dhammika Widanage,
Amjad Abu-Rmileh,
Johan Schoukens
Abstract:
In this paper, several advanced data-driven nonlinear identification techniques are compared on a specific problem: a simplified glucoregulatory system modeling example. This problem represents a challenge in the development of an artificial pancreas for T1DM treatment, since for this application good nonlinear models are needed to design accurate closed-loop controllers to regulate the glucose le…
▽ More
In this paper, several advanced data-driven nonlinear identification techniques are compared on a specific problem: a simplified glucoregulatory system modeling example. This problem represents a challenge in the development of an artificial pancreas for T1DM treatment, since for this application good nonlinear models are needed to design accurate closed-loop controllers to regulate the glucose level in the blood. Block-oriented as well as state-space models are used to describe both the dynamics and the nonlinear behavior of the insulin-glucose system, and the advantages and drawbacks of each method are pointed out. The obtained nonlinear models are accurate in simulating the patient's behavior, and some of them are also sufficiently simple to be considered in the implementation of a model-based controller to develop the artificial pancreas.
△ Less
Submitted 19 April, 2018;
originally announced April 2018.
-
Best Linear Approximation of Wiener Systems Using Multilevel Signals: Theory and Experiments
Authors:
A. De Angelis,
J. Schoukens,
K. R. Godfrey,
P. Carbone
Abstract:
The problem of measuring the best linear approximation of a nonlinear system by means of multilevel excitation sequences is analyzed. A comparison between different types of sequences applied at the input of Wiener systems is provided by numerical simulations and by experiments on a practical circuit including an analog filter and a clip** nonlinearity. The performance of the sequences is compar…
▽ More
The problem of measuring the best linear approximation of a nonlinear system by means of multilevel excitation sequences is analyzed. A comparison between different types of sequences applied at the input of Wiener systems is provided by numerical simulations and by experiments on a practical circuit including an analog filter and a clip** nonlinearity. The performance of the sequences is compared with a white Gaussian noise signal for reference purposes. The theoretical characterization of the best linear approximation when using randomized constrained sequences is derived analytically for the cubic nonlinearity case. Numerical and experimental results show that the randomized constrained approach for designing ternary sequences has a low sensitivity to both even and odd order nonlinearities, resulting in a response close to the actual response of the underlying linear system.
△ Less
Submitted 19 October, 2017;
originally announced October 2017.
-
Parameter reduction in nonlinear state-space identification of hysteresis
Authors:
Alireza Fakhrizadeh Esfahani,
Philippe Dreesen,
Koen Tiels,
Jean-Philippe Noël,
Johan Schoukens
Abstract:
Hysteresis is a highly nonlinear phenomenon, showing up in a wide variety of science and engineering problems. The identification of hysteretic systems from input-output data is a challenging task. Recent work on black-box polynomial nonlinear state-space modeling for hysteresis identification has provided promising results, but struggles with a large number of parameters due to the use of multiva…
▽ More
Hysteresis is a highly nonlinear phenomenon, showing up in a wide variety of science and engineering problems. The identification of hysteretic systems from input-output data is a challenging task. Recent work on black-box polynomial nonlinear state-space modeling for hysteresis identification has provided promising results, but struggles with a large number of parameters due to the use of multivariate polynomials. This drawback is tackled in the current paper by applying a decoupling approach that results in a more parsimonious representation involving univariate polynomials. This work is carried out numerically on input-output data generated by a Bouc-Wen hysteretic model and follows up on earlier work of the authors. The current article discusses the polynomial decoupling approach and explores the selection of the number of univariate polynomials with the polynomial degree, as well as the connections with neural network modeling. We have found that the presented decoupling approach is able to reduce the number of parameters of the full nonlinear model up to about 50\%, while maintaining a comparable output error level.
△ Less
Submitted 29 April, 2017;
originally announced May 2017.
-
D-Optimal Input Design for Nonlinear FIR-type Systems:A Dispersion-based Approach
Authors:
Alexander De Cock,
Michel Gevers,
Johan Schoukens
Abstract:
Optimal input design is an important step of the identification process in order to reduce the model variance. In this work a D-optimal input design method for finite-impulse-response-type nonlinear systems is presented. The optimization of the determinant of the Fisher information matrix is expressed as a convex optimization problem. This problem is then solved using a dispersion-based optimizati…
▽ More
Optimal input design is an important step of the identification process in order to reduce the model variance. In this work a D-optimal input design method for finite-impulse-response-type nonlinear systems is presented. The optimization of the determinant of the Fisher information matrix is expressed as a convex optimization problem. This problem is then solved using a dispersion-based optimization scheme, which is easy to implement and converges monotonically to the optimal solution. Without constraints, the optimal design cannot be realized as a time sequence. By imposing that the design should lie in the subspace described by a symmetric and non-overlap** set, a realizable design is found. A graph-based method is used in order to find a time sequence that realizes this optimal constrained design. These methods are illustrated on a numerical example of which the results are thoroughly discussed. Additionally the computational speed of the algorithm is compared with the general convex optimizer cvx.
△ Less
Submitted 24 March, 2017;
originally announced March 2017.
-
Initial estimates for Wiener-Hammerstein models using phase-coupled multisines
Authors:
Koen Tiels,
Maarten Schoukens,
Johan Schoukens
Abstract:
Block-oriented models are often used to model nonlinear systems. These models consist of linear dynamic (L) and nonlinear static (N) sub-blocks. This paper addresses the generation of initial estimates for a Wiener-Hammerstein model (LNL cascade). While it is easy to measure the product of the two linear blocks using a Gaussian excitation and linear identification methods, it is difficult to split…
▽ More
Block-oriented models are often used to model nonlinear systems. These models consist of linear dynamic (L) and nonlinear static (N) sub-blocks. This paper addresses the generation of initial estimates for a Wiener-Hammerstein model (LNL cascade). While it is easy to measure the product of the two linear blocks using a Gaussian excitation and linear identification methods, it is difficult to split the global dynamics over the individual blocks. This paper first proposes a well-designed multisine excitation with pairwise coupled random phases. Next, a modified best linear approximation is estimated on a shifted frequency grid. It is shown that this procedure creates a shift of the input dynamics with a known frequency offset, while the output dynamics do not shift. The resulting transfer function, which has complex coefficients due to the frequency shift, is estimated with a modified frequency domain estimation method. The identified poles and zeros can be assigned to either the input or output dynamics. Once this is done, it is shown in the literature that the remaining initialization problem can be solved much easier than the original one. The method is illustrated on experimental data obtained from the Wiener-Hammerstein benchmark system.
△ Less
Submitted 14 December, 2016;
originally announced December 2016.
-
Wiener system identification with generalized orthonormal basis functions
Authors:
Koen Tiels,
Johan Schoukens
Abstract:
Many nonlinear systems can be described by a Wiener-Schetzen model. In this model, the linear dynamics are formulated in terms of orthonormal basis functions (OBFs). The nonlinearity is modeled by a multivariate polynomial. In general, an infinite number of OBFs is needed for an exact representation of the system. This paper considers the approximation of a Wiener system with finite-order infinite…
▽ More
Many nonlinear systems can be described by a Wiener-Schetzen model. In this model, the linear dynamics are formulated in terms of orthonormal basis functions (OBFs). The nonlinearity is modeled by a multivariate polynomial. In general, an infinite number of OBFs is needed for an exact representation of the system. This paper considers the approximation of a Wiener system with finite-order infinite impulse response dynamics and a polynomial nonlinearity. We propose to use a limited number of generalized OBFs (GOBFs). The pole locations, needed to construct the GOBFs, are estimated via the best linear approximation of the system. The coefficients of the multivariate polynomial are determined with a linear regression. This paper provides a convergence analysis for the proposed identification scheme. It is shown that the estimated output converges in probability to the exact output. Fast convergence rates, in the order $O_p({N_F}^{-n_{rep}/2})$, can be achieved, with $N_F$ the number of excited frequencies and $n_{rep}$ the number of repetitions of the GOBFs.
△ Less
Submitted 14 December, 2016;
originally announced December 2016.
-
Grey-box nonlinear state-space modelling for mechanical vibrations identification
Authors:
Jean-Philippe Noël,
Johan Schoukens,
Gaetan Kerschen
Abstract:
In the present paper, a flexible and parsimonious model of the vibrations of nonlinear mechanical systems is introduced in the form of state-space equations. It is shown that the nonlinear model terms can be formed using a limited number of output measurements. A two-step identification procedure is derived for this grey-box model, integrating nonlinear subspace initialisation and maximum likeliho…
▽ More
In the present paper, a flexible and parsimonious model of the vibrations of nonlinear mechanical systems is introduced in the form of state-space equations. It is shown that the nonlinear model terms can be formed using a limited number of output measurements. A two-step identification procedure is derived for this grey-box model, integrating nonlinear subspace initialisation and maximum likelihood optimisation. The complete procedure is demonstrated on the Silverbox benchmark, which is an electrical mimicry of a single-degree-of-freedom mechanical system with one displacement-dependent nonlinearity.
△ Less
Submitted 28 October, 2016;
originally announced October 2016.
-
A nonlinear state-space approach to hysteresis identification
Authors:
Jean-Philippe Noël,
Alireza F. Esfahani,
Gaetan Kerschen,
Johan Schoukens
Abstract:
Most studies tackling hysteresis identification in the technical literature follow white-box approaches, i.e. they rely on the assumption that measured data obey a specific hysteretic model. Such an assumption may be a hard requirement to handle in real applications, since hysteresis is a highly individualistic nonlinear behaviour. The present paper adopts a black-box approach based on nonlinear s…
▽ More
Most studies tackling hysteresis identification in the technical literature follow white-box approaches, i.e. they rely on the assumption that measured data obey a specific hysteretic model. Such an assumption may be a hard requirement to handle in real applications, since hysteresis is a highly individualistic nonlinear behaviour. The present paper adopts a black-box approach based on nonlinear state-space models to identify hysteresis dynamics. This approach is shown to provide a general framework to hysteresis identification, featuring flexibility and parsimony of representation. Nonlinear model terms are constructed as a multivariate polynomial in the state variables, and parameter estimation is performed by minimising weighted least-squares cost functions. Technical issues, including the selection of the model order and the polynomial degree, are discussed, and model validation is achieved in both broadband and sine conditions. The study is carried out numerically by exploiting synthetic data generated via the Bouc-Wen equations.
△ Less
Submitted 28 October, 2016;
originally announced October 2016.
-
Filter-based regularisation for impulse response modelling
Authors:
Anna Marconato,
Maarten Schoukens,
Johan Schoukens
Abstract:
In the last years, the success of kernel-based regularisation techniques in solving impulse response modelling tasks has revived the interest on linear system identification. In this work, an alternative perspective on the same problem is introduced. Instead of relying on a Bayesian framework to include assumptions about the system in the definition of the covariance matrix of the parameters, here…
▽ More
In the last years, the success of kernel-based regularisation techniques in solving impulse response modelling tasks has revived the interest on linear system identification. In this work, an alternative perspective on the same problem is introduced. Instead of relying on a Bayesian framework to include assumptions about the system in the definition of the covariance matrix of the parameters, here the prior knowledge is injected at the cost function level. The key idea is to define the regularisation matrix as a filtering operation on the parameters, which allows for a more intuitive formulation of the problem from an engineering point of view. Moreover, this results in a unified framework to model low-pass, band-pass and high-pass systems, and systems with one or more resonances. The proposed filter-based approach outperforms the existing regularisation method based on the TC and DC kernels, as illustrated by means of Monte Carlo simulations on several linear modelling examples.
△ Less
Submitted 24 October, 2016;
originally announced October 2016.
-
Modeling Parallel Wiener-Hammerstein Systems Using Tensor Decomposition of Volterra Kernels
Authors:
Philippe Dreesen,
David Westwick,
Johan Schoukens,
Mariya Ishteva
Abstract:
Providing flexibility and user-interpretability in nonlinear system identification can be achieved by means of block-oriented methods. One of such block-oriented system structures is the parallel Wiener-Hammerstein system, which is a sum of Wiener-Hammerstein branches, consisting of static nonlinearities sandwiched between linear dynamical blocks. Parallel Wiener-Hammerstein models have more descr…
▽ More
Providing flexibility and user-interpretability in nonlinear system identification can be achieved by means of block-oriented methods. One of such block-oriented system structures is the parallel Wiener-Hammerstein system, which is a sum of Wiener-Hammerstein branches, consisting of static nonlinearities sandwiched between linear dynamical blocks. Parallel Wiener-Hammerstein models have more descriptive power than their single-branch counterparts, but their identification is a non-trivial task that requires tailored system identification methods. In this work, we will tackle the identification problem by performing a tensor decomposition of the Volterra kernels obtained from the nonlinear system. We illustrate how the parallel Wiener-Hammerstein block-structure gives rise to a joint tensor decomposition of the Volterra kernels with block-circulant structured factors. The combination of Volterra kernels and tensor methods is a fruitful way to tackle the parallel Wiener-Hammerstein system identification task. In simulation experiments, we were able to reconstruct very accurately the underlying blocks under noisy conditions.
△ Less
Submitted 26 September, 2016;
originally announced September 2016.
-
Weighted tensor decomposition for approximate decoupling of multivariate polynomials
Authors:
Gabriel Hollander,
Philippe Dreesen,
Mariya Ishteva,
Johan Schoukens
Abstract:
Multivariate polynomials arise in many different disciplines. Representing such a polynomial as a vector of univariate polynomials can offer useful insight, as well as more intuitive understanding. For this, techniques based on tensor methods are known, but these have only been studied in the exact case. In this paper, we generalize an existing method to the noisy case, by introducing a weight fac…
▽ More
Multivariate polynomials arise in many different disciplines. Representing such a polynomial as a vector of univariate polynomials can offer useful insight, as well as more intuitive understanding. For this, techniques based on tensor methods are known, but these have only been studied in the exact case. In this paper, we generalize an existing method to the noisy case, by introducing a weight factor in the tensor decomposition. Finally, we apply the proposed weighted decoupling algorithm in the domain of system identification, and observe smaller model errors.
△ Less
Submitted 28 January, 2016;
originally announced January 2016.
-
Gaussian information matrix for Wiener model identification
Authors:
Kaushik Mahata,
Johan Schoukens
Abstract:
We present a closed form expression for the information matrix associated with the Wiener model identification problem under the assumption that the input signal is a stationary Gaussian process. This expression holds under quite generic assumptions. We allow the linear sub-system to have a rational transfer function of arbitrary order, and the static nonlinearity to be a polynomial of arbitrary d…
▽ More
We present a closed form expression for the information matrix associated with the Wiener model identification problem under the assumption that the input signal is a stationary Gaussian process. This expression holds under quite generic assumptions. We allow the linear sub-system to have a rational transfer function of arbitrary order, and the static nonlinearity to be a polynomial of arbitrary degree. We also present a simple expression for the determinant of the information matrix. The expressions presented herein has been used for optimal experiment design for Wiener model identification.
△ Less
Submitted 11 October, 2015;
originally announced October 2015.
-
Perturbed Datasets Methods for Hypothesis Testing and Structure of Corresponding Confidence Sets
Authors:
Sándor Kolumbán,
István Vajk,
Johan Schoukens
Abstract:
Hypothesis testing methods that do not rely on exact distribution assumptions have been emerging lately. The method of sign-perturbed sums (SPS) is capable of characterizing confidence regions with exact confidence levels for linear regression and linear dynamical systems parameter estimation problems if the noise distribution is symmetric. This paper describes a general family of hypothesis testi…
▽ More
Hypothesis testing methods that do not rely on exact distribution assumptions have been emerging lately. The method of sign-perturbed sums (SPS) is capable of characterizing confidence regions with exact confidence levels for linear regression and linear dynamical systems parameter estimation problems if the noise distribution is symmetric. This paper describes a general family of hypothesis testing methods that have an exact user chosen confidence level based on finite sample count and without relying on an assumed noise distribution. It is shown that the SPS method belongs to this family and we provide another hypothesis test for the case where the symmetry assumption is replaced with exchangeability. In the case of linear regression problems it is shown that the confidence regions are connected, bounded and possibly non-convex sets in both cases. To highlight the importance of understanding the structure of confidence regions corresponding to such hypothesis tests it is shown that confidence sets for linear dynamical systems parameter estimates generated using the SPS method can have non-connected parts, which have far reaching consequences.
△ Less
Submitted 7 December, 2014;
originally announced December 2014.
-
Decoupling Multivariate Polynomials Using First-Order Information
Authors:
Philippe Dreesen,
Mariya Ishteva,
Johan Schoukens
Abstract:
We present a method to decompose a set of multivariate real polynomials into linear combinations of univariate polynomials in linear forms of the input variables. The method proceeds by collecting the first-order information of the polynomials in a set of operating points, which is captured by the Jacobian matrix evaluated at the operating points. The polyadic canonical decomposition of the three-…
▽ More
We present a method to decompose a set of multivariate real polynomials into linear combinations of univariate polynomials in linear forms of the input variables. The method proceeds by collecting the first-order information of the polynomials in a set of operating points, which is captured by the Jacobian matrix evaluated at the operating points. The polyadic canonical decomposition of the three-way tensor of Jacobian matrices directly returns the unknown linear relations, as well as the necessary information to reconstruct the univariate polynomials. The conditions under which this decoupling procedure works are discussed, and the method is illustrated on several numerical examples.
△ Less
Submitted 15 October, 2014;
originally announced October 2014.
