-
Statistical Analysis of Block Coordinate Descent Algorithms for Linear Continuous-time System Identification
Authors:
Rodrigo A. González,
Koen Classens,
Cristian R. Rojas,
James S. Welsh,
Tom Oomen
Abstract:
Block coordinate descent is an optimization technique that is used for estimating multi-input single-output (MISO) continuous-time models, as well as single-input single output (SISO) models in additive form. Despite its widespread use in various optimization contexts, the statistical properties of block coordinate descent in continuous-time system identification have not been covered in the liter…
▽ More
Block coordinate descent is an optimization technique that is used for estimating multi-input single-output (MISO) continuous-time models, as well as single-input single output (SISO) models in additive form. Despite its widespread use in various optimization contexts, the statistical properties of block coordinate descent in continuous-time system identification have not been covered in the literature. The aim of this paper is to formally analyze the bias properties of the block coordinate descent approach for the identification of MISO and additive SISO systems. We characterize the asymptotic bias at each iteration, and provide sufficient conditions for the consistency of the estimator for each identification setting. The theoretical results are supported by simulation examples.
△ Less
Submitted 13 April, 2024;
originally announced April 2024.
-
Consistency analysis of refined instrumental variable methods for continuous-time system identification in closed-loop
Authors:
Rodrigo A. González,
Siqi Pan,
Cristian R. Rojas,
James S. Welsh
Abstract:
Refined instrumental variable methods have been broadly used for identification of continuous-time systems in both open and closed-loop settings. However, the theoretical properties of these methods are still yet to be fully understood when operating in closed-loop. In this paper, we address the consistency of the simplified refined instrumental variable method for continuous-time systems (SRIVC)…
▽ More
Refined instrumental variable methods have been broadly used for identification of continuous-time systems in both open and closed-loop settings. However, the theoretical properties of these methods are still yet to be fully understood when operating in closed-loop. In this paper, we address the consistency of the simplified refined instrumental variable method for continuous-time systems (SRIVC) and its closed-loop variant CLSRIVC when they are applied on data that is generated from a feedback loop. In particular, we consider feedback loops consisting of continuous-time controllers, as well as the discrete-time control case. This paper proves that the SRIVC and CLSRIVC estimators are not generically consistent when there is a continuous-time controller in the loop, and that generic consistency can be achieved when the controller is implemented in discrete-time. Numerical simulations are presented to support the theoretical results.
△ Less
Submitted 13 April, 2024;
originally announced April 2024.
-
Identification of Additive Continuous-time Systems in Open and Closed-loop
Authors:
Rodrigo A. González,
Koen Classens,
Cristian R. Rojas,
James S. Welsh,
Tom Oomen
Abstract:
When identifying electrical, mechanical, or biological systems, parametric continuous-time identification methods can lead to interpretable and parsimonious models when the model structure aligns with the physical properties of the system. Traditional linear system identification may not consider the most parsimonious model when relying solely on unfactored transfer functions, which typically resu…
▽ More
When identifying electrical, mechanical, or biological systems, parametric continuous-time identification methods can lead to interpretable and parsimonious models when the model structure aligns with the physical properties of the system. Traditional linear system identification may not consider the most parsimonious model when relying solely on unfactored transfer functions, which typically result from standard direct approaches. This paper presents a novel identification method that delivers additive models for both open and closed-loop setups. The estimators that are derived are shown to be generically consistent, and can admit the identification of marginally stable additive systems. Numerical simulations show the efficacy of the proposed approach, and its performance in identifying a modal representation of a flexible beam is verified using experimental data.
△ Less
Submitted 2 January, 2024;
originally announced January 2024.
-
On the Relation between Discrete and Continuous-time Refined Instrumental Variable Methods
Authors:
Rodrigo A. González,
Cristian R. Rojas,
Siqi Pan,
James S. Welsh
Abstract:
The Refined Instrumental Variable method for discrete-time systems (RIV) and its variant for continuous-time systems (RIVC) are popular methods for the identification of linear systems in open-loop. The continuous-time equivalent of the transfer function estimate given by the RIV method is commonly used as an initialization point for the RIVC estimator. In this paper, we prove that these estimator…
▽ More
The Refined Instrumental Variable method for discrete-time systems (RIV) and its variant for continuous-time systems (RIVC) are popular methods for the identification of linear systems in open-loop. The continuous-time equivalent of the transfer function estimate given by the RIV method is commonly used as an initialization point for the RIVC estimator. In this paper, we prove that these estimators share the same converging points for finite sample size when the continuous-time model has relative degree zero or one. This relation does not hold for higher relative degrees. Then, we propose a modification of the RIV method whose continuous-time equivalent is equal to the RIVC estimator for any non-negative relative degree. The implications of the theoretical results are illustrated via a simulation example.
△ Less
Submitted 31 May, 2023;
originally announced May 2023.
-
Parsimonious Identification of Continuous-Time Systems: A Block-Coordinate Descent Approach
Authors:
Rodrigo A. González,
Cristian R. Rojas,
Siqi Pan,
James S. Welsh
Abstract:
The identification of electrical, mechanical, and biological systems using data can benefit greatly from prior knowledge extracted from physical modeling. Parametric continuous-time identification methods can naturally incorporate this knowledge, which leads to interpretable and parsimonious models. However, some applications lead to model structures that lack parsimonious descriptions using unfac…
▽ More
The identification of electrical, mechanical, and biological systems using data can benefit greatly from prior knowledge extracted from physical modeling. Parametric continuous-time identification methods can naturally incorporate this knowledge, which leads to interpretable and parsimonious models. However, some applications lead to model structures that lack parsimonious descriptions using unfactored transfer functions, which are commonly used in standard direct approaches for continuous-time system identification. In this paper we characterize this parsimony problem, and develop a block-coordinate descent algorithm that delivers parsimonious models by sequentially estimating an additive decomposition of the transfer function of interest. Numerical simulations show the efficacy of the proposed approach.
△ Less
Submitted 6 April, 2023;
originally announced April 2023.
-
Consistency Analysis of the Closed-loop SRIVC Estimator
Authors:
Siqi Pan,
James S. Welsh,
Rodrigo A. Gonzalez,
Cristian R. Rojas
Abstract:
The Consistency of the Closed-Loop Simplified Refined Instrumental Variable method for Continuous-time system (CLSRIVC) is analysed based on sampled data. It is proven that the CLSRIVC estimator is not consistent when a continuous-time controller is used in the closed-loop.
The Consistency of the Closed-Loop Simplified Refined Instrumental Variable method for Continuous-time system (CLSRIVC) is analysed based on sampled data. It is proven that the CLSRIVC estimator is not consistent when a continuous-time controller is used in the closed-loop.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Consistent identification of continuous-time systems under multisine input signal excitation
Authors:
Rodrigo A. González,
Cristian R. Rojas,
Siqi Pan,
James S. Welsh
Abstract:
For many years, the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC) has been widely used for identification. The intersample behaviour of the input plays an important role in this method, and it has been shown recently that the SRIVC estimator is not consistent if an incorrect assumption on the intersample behaviour is considered. In this paper, we present an ex…
▽ More
For many years, the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC) has been widely used for identification. The intersample behaviour of the input plays an important role in this method, and it has been shown recently that the SRIVC estimator is not consistent if an incorrect assumption on the intersample behaviour is considered. In this paper, we present an extension of the SRIVC algorithm that is able to deal with continuous-time multisine signals, which cannot be interpolated exactly through hold reconstructions. The proposed estimator is generically consistent for any input reconstructed through zero or first-order-hold devices, and we show that it is generically consistent for continuous-time multisine inputs as well. The statistical performance of the proposed estimator is compared to the standard SRIVC estimator through extensive simulations.
△ Less
Submitted 12 March, 2021; v1 submitted 6 May, 2020;
originally announced May 2020.
-
Efficiency Analysis of the Simplified Refined Instrumental Variable Method for Continuous-time Systems
Authors:
Siqi Pan,
James S. Welsh,
Rodrigo A. González,
Cristian R. Rojas
Abstract:
In this paper, we derive the asymptotic Cramér-Rao lower bound for the continuous-time output error model structure and provide an analysis of the statistical efficiency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC) based on sampled data.It is shown that the asymptotic Cramér-Rao lower bound is independent of the intersample behaviour of the noise-free…
▽ More
In this paper, we derive the asymptotic Cramér-Rao lower bound for the continuous-time output error model structure and provide an analysis of the statistical efficiency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC) based on sampled data.It is shown that the asymptotic Cramér-Rao lower bound is independent of the intersample behaviour of the noise-free system output and hence only depends on the intersample behaviour of the system input. We have also shown that, at the converging point of the SRIVC algorithm, the estimates do not depend on the intersample behaviour of the measured output. It is then proven that the SRIVC estimator is asymptotically efficient for the output error model structure under mild conditions. Monte Carlo simulations are performed to verify the asymptotic Cramér-Rao lower bound and the asymptotic covariance of the SRIVC estimates.
△ Less
Submitted 17 July, 2020; v1 submitted 2 February, 2020;
originally announced February 2020.
-
Consistency Analysis of the Simplified Refined Instrumental Variable Method for Continuous-time Systems
Authors:
Siqi Pan,
Rodrigo A. González,
James S. Welsh,
Cristian R. Rojas
Abstract:
In this paper, we analyse the consistency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC). It is well known that the intersample behaviour of the input signal influences the quality and accuracy of the results when estimating and simulating continuous-time models. Here, we present a comprehensive analysis on the consistency of the SRIVC estimator while ta…
▽ More
In this paper, we analyse the consistency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC). It is well known that the intersample behaviour of the input signal influences the quality and accuracy of the results when estimating and simulating continuous-time models. Here, we present a comprehensive analysis on the consistency of the SRIVC estimator while taking into account the intersample behaviour of the input signal. The main result of the paper shows that, under some mild conditions, the SRIVC estimator is generically consistent. We also describe some conditions when consistency is not achieved, which is important from a practical standpoint. The theoretical results are supported by simulation examples.
△ Less
Submitted 30 September, 2019;
originally announced October 2019.
-
Volterra Kernel Identification using Regularized Orthonormal Basis Functions
Authors:
Jeremy G. Stoddard,
James S. Welsh
Abstract:
The Volterra series is a powerful tool in modelling a broad range of nonlinear dynamic systems. However, due to its nonparametric nature, the number of parameters in the series increases rapidly with memory length and series order, with the uncertainty in resulting model estimates increasing accordingly. In this paper, we propose an identification method where the Volterra kernels are estimated in…
▽ More
The Volterra series is a powerful tool in modelling a broad range of nonlinear dynamic systems. However, due to its nonparametric nature, the number of parameters in the series increases rapidly with memory length and series order, with the uncertainty in resulting model estimates increasing accordingly. In this paper, we propose an identification method where the Volterra kernels are estimated indirectly through orthonormal basis function expansions, with regularization applied directly to the expansion coefficients to reduce variance in the final model estimate and provide access to useful models at previously unfeasible series orders. The higher dimensional kernel expansions are regularized using a method that allows smoothness and decay to be imposed on the entire hyper-surface. Numerical examples demonstrate improved Volterra series estimation up to the 4th order using the regularized basis function method.
△ Less
Submitted 19 April, 2018;
originally announced April 2018.
-
An asymptotically optimal indirect approach to continuous-time system identification
Authors:
Rodrigo A. González,
Cristian R. Rojas,
James S. Welsh
Abstract:
The indirect approach to continuous-time system identification consists in estimating continuous-time models by first determining an appropriate discrete-time model. For a zero-order hold sampling mechanism, this approach usually leads to a transfer function estimate with relative degree 1, independent of the relative degree of the strictly proper real system. In this paper, a refinement of these…
▽ More
The indirect approach to continuous-time system identification consists in estimating continuous-time models by first determining an appropriate discrete-time model. For a zero-order hold sampling mechanism, this approach usually leads to a transfer function estimate with relative degree 1, independent of the relative degree of the strictly proper real system. In this paper, a refinement of these methods is developed. Inspired by indirect PEM, we propose a method that enforces a fixed relative degree in the continuous-time transfer function estimate, and show that the resulting estimator is consistent and asymptotically efficient. Extensive numerical simulations are put forward to show the performance of this estimator when contrasted with other indirect and direct methods for continuous-time system identification.
△ Less
Submitted 22 March, 2018;
originally announced March 2018.
