-
Grey-box Recursive Parameter Identification of a Nonlinear Dynamic Model for Mineral Flotation
Authors:
Rodrigo A. González,
Paulina Quintanilla
Abstract:
This study presents a grey-box recursive identification technique to estimate key parameters in a mineral flotation process across two scenarios. The method is applied to a nonlinear physics-based dynamic model validated at a laboratory scale, allowing real-time updates of two model parameters, n and C, in response to changing conditions. The proposed approach effectively adapts to process variabi…
▽ More
This study presents a grey-box recursive identification technique to estimate key parameters in a mineral flotation process across two scenarios. The method is applied to a nonlinear physics-based dynamic model validated at a laboratory scale, allowing real-time updates of two model parameters, n and C, in response to changing conditions. The proposed approach effectively adapts to process variability and allows for continuous adjustments based on operational fluctuations, resulting in a significantly improved estimation of concentrate grade - one key performance indicator. In Scenario 1, parameters n and C achieved fit metrics of 97.99 and 96.86, respectively, with concentrate grade estimations improving from 75.1 to 98.69 using recursive identification. In Scenario 2, the fit metrics for n and C were 96.27 and 95.48, respectively, with the concentrate grade estimations increasing from 96.27 to 99.45 with recursive identification. The results demonstrate the effectiveness of the proposed grey-box recursive identification method in accurately estimating parameters and predicting concentrate grade in a mineral flotation process.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
Statistical Analysis of Block Coordinate Descent Algorithms for Linear Continuous-time System Identification
Authors:
Rodrigo A. González,
Koen Classens,
Cristian R. Rojas,
James S. Welsh,
Tom Oomen
Abstract:
Block coordinate descent is an optimization technique that is used for estimating multi-input single-output (MISO) continuous-time models, as well as single-input single output (SISO) models in additive form. Despite its widespread use in various optimization contexts, the statistical properties of block coordinate descent in continuous-time system identification have not been covered in the liter…
▽ More
Block coordinate descent is an optimization technique that is used for estimating multi-input single-output (MISO) continuous-time models, as well as single-input single output (SISO) models in additive form. Despite its widespread use in various optimization contexts, the statistical properties of block coordinate descent in continuous-time system identification have not been covered in the literature. The aim of this paper is to formally analyze the bias properties of the block coordinate descent approach for the identification of MISO and additive SISO systems. We characterize the asymptotic bias at each iteration, and provide sufficient conditions for the consistency of the estimator for each identification setting. The theoretical results are supported by simulation examples.
△ Less
Submitted 13 April, 2024;
originally announced April 2024.
-
Consistency analysis of refined instrumental variable methods for continuous-time system identification in closed-loop
Authors:
Rodrigo A. González,
Siqi Pan,
Cristian R. Rojas,
James S. Welsh
Abstract:
Refined instrumental variable methods have been broadly used for identification of continuous-time systems in both open and closed-loop settings. However, the theoretical properties of these methods are still yet to be fully understood when operating in closed-loop. In this paper, we address the consistency of the simplified refined instrumental variable method for continuous-time systems (SRIVC)…
▽ More
Refined instrumental variable methods have been broadly used for identification of continuous-time systems in both open and closed-loop settings. However, the theoretical properties of these methods are still yet to be fully understood when operating in closed-loop. In this paper, we address the consistency of the simplified refined instrumental variable method for continuous-time systems (SRIVC) and its closed-loop variant CLSRIVC when they are applied on data that is generated from a feedback loop. In particular, we consider feedback loops consisting of continuous-time controllers, as well as the discrete-time control case. This paper proves that the SRIVC and CLSRIVC estimators are not generically consistent when there is a continuous-time controller in the loop, and that generic consistency can be achieved when the controller is implemented in discrete-time. Numerical simulations are presented to support the theoretical results.
△ Less
Submitted 13 April, 2024;
originally announced April 2024.
-
Identification of Additive Continuous-time Systems in Open and Closed-loop
Authors:
Rodrigo A. González,
Koen Classens,
Cristian R. Rojas,
James S. Welsh,
Tom Oomen
Abstract:
When identifying electrical, mechanical, or biological systems, parametric continuous-time identification methods can lead to interpretable and parsimonious models when the model structure aligns with the physical properties of the system. Traditional linear system identification may not consider the most parsimonious model when relying solely on unfactored transfer functions, which typically resu…
▽ More
When identifying electrical, mechanical, or biological systems, parametric continuous-time identification methods can lead to interpretable and parsimonious models when the model structure aligns with the physical properties of the system. Traditional linear system identification may not consider the most parsimonious model when relying solely on unfactored transfer functions, which typically result from standard direct approaches. This paper presents a novel identification method that delivers additive models for both open and closed-loop setups. The estimators that are derived are shown to be generically consistent, and can admit the identification of marginally stable additive systems. Numerical simulations show the efficacy of the proposed approach, and its performance in identifying a modal representation of a flexible beam is verified using experimental data.
△ Less
Submitted 2 January, 2024;
originally announced January 2024.
-
Nonlinear Bayesian Identification for Motor Commutation: Applied to Switched Reluctance Motors
Authors:
Max van Meer,
Rodrigo A. González,
Gert Witvoet,
Tom Oomen
Abstract:
Switched Reluctance Motors (SRMs) enable power-efficient actuation with mechanically simple designs. This paper aims to identify the nonlinear relationship between torque, rotor angle, and currents, to design commutation functions that minimize torque ripple in SRMs. This is achieved by conducting specific closed-loop experiments using purposely imperfect commutation functions and identifying the…
▽ More
Switched Reluctance Motors (SRMs) enable power-efficient actuation with mechanically simple designs. This paper aims to identify the nonlinear relationship between torque, rotor angle, and currents, to design commutation functions that minimize torque ripple in SRMs. This is achieved by conducting specific closed-loop experiments using purposely imperfect commutation functions and identifying the nonlinear dynamics via Bayesian estimation. A simulation example shows that the presented method is robust to position-dependent disturbances, and experiments suggest that the identification method enables the design of commutation functions that significantly increase performance. The developed approach enables accurate identification of the torque-current-angle relationship in SRMs, without the need for torque sensors, an accurate linear model, or an accurate model of position-dependent disturbances, making it easy to implement in production.
△ Less
Submitted 29 September, 2023;
originally announced September 2023.
-
On the Relation between Discrete and Continuous-time Refined Instrumental Variable Methods
Authors:
Rodrigo A. González,
Cristian R. Rojas,
Siqi Pan,
James S. Welsh
Abstract:
The Refined Instrumental Variable method for discrete-time systems (RIV) and its variant for continuous-time systems (RIVC) are popular methods for the identification of linear systems in open-loop. The continuous-time equivalent of the transfer function estimate given by the RIV method is commonly used as an initialization point for the RIVC estimator. In this paper, we prove that these estimator…
▽ More
The Refined Instrumental Variable method for discrete-time systems (RIV) and its variant for continuous-time systems (RIVC) are popular methods for the identification of linear systems in open-loop. The continuous-time equivalent of the transfer function estimate given by the RIV method is commonly used as an initialization point for the RIVC estimator. In this paper, we prove that these estimators share the same converging points for finite sample size when the continuous-time model has relative degree zero or one. This relation does not hold for higher relative degrees. Then, we propose a modification of the RIV method whose continuous-time equivalent is equal to the RIVC estimator for any non-negative relative degree. The implications of the theoretical results are illustrated via a simulation example.
△ Less
Submitted 31 May, 2023;
originally announced May 2023.
-
An EM Algorithm for Lebesgue-sampled State-space Continuous-time System Identification
Authors:
Rodrigo A. González,
Angel L. Cedeño,
María Coronel,
Juan C. Agüero,
Cristian R. Rojas
Abstract:
This paper concerns the identification of continuous-time systems in state-space form that are subject to Lebesgue sampling. Contrary to equidistant (Riemann) sampling, Lebesgue sampling consists of taking measurements of a continuous-time signal whenever it crosses fixed and regularly partitioned thresholds. The knowledge of the intersample behavior of the output data is exploited in this work to…
▽ More
This paper concerns the identification of continuous-time systems in state-space form that are subject to Lebesgue sampling. Contrary to equidistant (Riemann) sampling, Lebesgue sampling consists of taking measurements of a continuous-time signal whenever it crosses fixed and regularly partitioned thresholds. The knowledge of the intersample behavior of the output data is exploited in this work to derive an expectation-maximization (EM) algorithm for parameter estimation of the state-space and noise covariance matrices. For this purpose, we use the incremental discrete-time equivalent of the system, which leads to EM iterations of the continuous-time state-space matrices that can be computed by standard filtering and smoothing procedures. The effectiveness of the identification method is tested via Monte Carlo simulations.
△ Less
Submitted 6 April, 2023;
originally announced April 2023.
-
Identifying Lebesgue-sampled Continuous-time Impulse Response Models: A Kernel-based Approach
Authors:
Rodrigo A. González,
Koen Tiels,
Tom Oomen
Abstract:
Control applications are increasingly sampled non-equidistantly in time, including in motion control, networked control, resource-aware control, and event-triggered control. Some of these applications use measurement devices that sample equidistantly in the amplitude domain. The aim of this paper is to develop a non-parametric estimator of the impulse response of continuous-time systems based on s…
▽ More
Control applications are increasingly sampled non-equidistantly in time, including in motion control, networked control, resource-aware control, and event-triggered control. Some of these applications use measurement devices that sample equidistantly in the amplitude domain. The aim of this paper is to develop a non-parametric estimator of the impulse response of continuous-time systems based on such sampling strategy, known as Lebesgue-sampling. To this end, kernel methods are developed to formulate an algorithm that adequately takes into account the output intersample behavior, which ultimately leads to more accurate models and more efficient output sampling compared to the standard approach. The efficacy of this method is demonstrated through a mass-spring damper case study.
△ Less
Submitted 6 April, 2023;
originally announced April 2023.
-
Parsimonious Identification of Continuous-Time Systems: A Block-Coordinate Descent Approach
Authors:
Rodrigo A. González,
Cristian R. Rojas,
Siqi Pan,
James S. Welsh
Abstract:
The identification of electrical, mechanical, and biological systems using data can benefit greatly from prior knowledge extracted from physical modeling. Parametric continuous-time identification methods can naturally incorporate this knowledge, which leads to interpretable and parsimonious models. However, some applications lead to model structures that lack parsimonious descriptions using unfac…
▽ More
The identification of electrical, mechanical, and biological systems using data can benefit greatly from prior knowledge extracted from physical modeling. Parametric continuous-time identification methods can naturally incorporate this knowledge, which leads to interpretable and parsimonious models. However, some applications lead to model structures that lack parsimonious descriptions using unfactored transfer functions, which are commonly used in standard direct approaches for continuous-time system identification. In this paper we characterize this parsimony problem, and develop a block-coordinate descent algorithm that delivers parsimonious models by sequentially estimating an additive decomposition of the transfer function of interest. Numerical simulations show the efficacy of the proposed approach.
△ Less
Submitted 6 April, 2023;
originally announced April 2023.
-
Kernel-based identification using Lebesgue-sampled data
Authors:
Rodrigo A. González,
Koen Tiels,
Tom Oomen
Abstract:
Sampling in control applications is increasingly done non-equidistantly in time. This includes applications in motion control, networked control, resource-aware control, and event-based control. Some of these applications, like the ones where displacement is tracked using incremental encoders, are driven by signals that are only measured when their values cross fixed thresholds in the amplitude do…
▽ More
Sampling in control applications is increasingly done non-equidistantly in time. This includes applications in motion control, networked control, resource-aware control, and event-based control. Some of these applications, like the ones where displacement is tracked using incremental encoders, are driven by signals that are only measured when their values cross fixed thresholds in the amplitude domain. This paper introduces a non-parametric estimator of the impulse response and transfer function of continuous-time systems based on such amplitude-equidistant sampling strategy, known as Lebesgue sampling. To this end, kernel methods are developed to formulate an algorithm that adequately takes into account the bounded output uncertainty between the event timestamps, which ultimately leads to more accurate models and more efficient output sampling compared to the equidistantly-sampled kernel-based approach. The efficacy of our proposed method is demonstrated through a mass-spring damper example with encoder measurements and extensive Monte Carlo simulation studies on system benchmarks.
△ Less
Submitted 23 February, 2024; v1 submitted 10 March, 2023;
originally announced March 2023.
-
Consistency Analysis of the Closed-loop SRIVC Estimator
Authors:
Siqi Pan,
James S. Welsh,
Rodrigo A. Gonzalez,
Cristian R. Rojas
Abstract:
The Consistency of the Closed-Loop Simplified Refined Instrumental Variable method for Continuous-time system (CLSRIVC) is analysed based on sampled data. It is proven that the CLSRIVC estimator is not consistent when a continuous-time controller is used in the closed-loop.
The Consistency of the Closed-Loop Simplified Refined Instrumental Variable method for Continuous-time system (CLSRIVC) is analysed based on sampled data. It is proven that the CLSRIVC estimator is not consistent when a continuous-time controller is used in the closed-loop.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Non-causal regularized least-squares for continuous-time system identification with band-limited input excitations
Authors:
Rodrigo A. González,
Cristian R. Rojas,
Håkan Hjalmarsson
Abstract:
In continuous-time system identification, the intersample behavior of the input signal is known to play a crucial role in the performance of estimation methods. One common input behavior assumption is that the spectrum of the input is band-limited. The sinc interpolation property of these input signals yields equivalent discrete-time representations that are non-causal. This observation, often ove…
▽ More
In continuous-time system identification, the intersample behavior of the input signal is known to play a crucial role in the performance of estimation methods. One common input behavior assumption is that the spectrum of the input is band-limited. The sinc interpolation property of these input signals yields equivalent discrete-time representations that are non-causal. This observation, often overlooked in the literature, is exploited in this work to study non-parametric frequency response estimators of linear continuous-time systems. We study the properties of non-causal least-square estimators for continuous-time system identification, and propose a kernel-based non-causal regularized least-squares approach for estimating the band-limited equivalent impulse response. The proposed methods are tested via extensive numerical simulations.
△ Less
Submitted 19 March, 2021;
originally announced March 2021.
-
Consistent identification of continuous-time systems under multisine input signal excitation
Authors:
Rodrigo A. González,
Cristian R. Rojas,
Siqi Pan,
James S. Welsh
Abstract:
For many years, the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC) has been widely used for identification. The intersample behaviour of the input plays an important role in this method, and it has been shown recently that the SRIVC estimator is not consistent if an incorrect assumption on the intersample behaviour is considered. In this paper, we present an ex…
▽ More
For many years, the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC) has been widely used for identification. The intersample behaviour of the input plays an important role in this method, and it has been shown recently that the SRIVC estimator is not consistent if an incorrect assumption on the intersample behaviour is considered. In this paper, we present an extension of the SRIVC algorithm that is able to deal with continuous-time multisine signals, which cannot be interpolated exactly through hold reconstructions. The proposed estimator is generically consistent for any input reconstructed through zero or first-order-hold devices, and we show that it is generically consistent for continuous-time multisine inputs as well. The statistical performance of the proposed estimator is compared to the standard SRIVC estimator through extensive simulations.
△ Less
Submitted 12 March, 2021; v1 submitted 6 May, 2020;
originally announced May 2020.
-
Efficiency Analysis of the Simplified Refined Instrumental Variable Method for Continuous-time Systems
Authors:
Siqi Pan,
James S. Welsh,
Rodrigo A. González,
Cristian R. Rojas
Abstract:
In this paper, we derive the asymptotic Cramér-Rao lower bound for the continuous-time output error model structure and provide an analysis of the statistical efficiency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC) based on sampled data.It is shown that the asymptotic Cramér-Rao lower bound is independent of the intersample behaviour of the noise-free…
▽ More
In this paper, we derive the asymptotic Cramér-Rao lower bound for the continuous-time output error model structure and provide an analysis of the statistical efficiency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC) based on sampled data.It is shown that the asymptotic Cramér-Rao lower bound is independent of the intersample behaviour of the noise-free system output and hence only depends on the intersample behaviour of the system input. We have also shown that, at the converging point of the SRIVC algorithm, the estimates do not depend on the intersample behaviour of the measured output. It is then proven that the SRIVC estimator is asymptotically efficient for the output error model structure under mild conditions. Monte Carlo simulations are performed to verify the asymptotic Cramér-Rao lower bound and the asymptotic covariance of the SRIVC estimates.
△ Less
Submitted 17 July, 2020; v1 submitted 2 February, 2020;
originally announced February 2020.
-
A Finite-Sample Deviation Bound for Stable Autoregressive Processes
Authors:
Rodrigo A. González,
Cristian R. Rojas
Abstract:
In this paper, we study non-asymptotic deviation bounds of the least squares estimator in Gaussian AR($n$) processes. By relying on martingale concentration inequalities and a tail-bound for $χ^2$ distributed variables, we provide a concentration bound for the sample covariance matrix of the process output. With this, we present a problem-dependent finite-time bound on the deviation probability of…
▽ More
In this paper, we study non-asymptotic deviation bounds of the least squares estimator in Gaussian AR($n$) processes. By relying on martingale concentration inequalities and a tail-bound for $χ^2$ distributed variables, we provide a concentration bound for the sample covariance matrix of the process output. With this, we present a problem-dependent finite-time bound on the deviation probability of any fixed linear combination of the estimated parameters of the AR$(n)$ process. We discuss extensions and limitations of our approach.
△ Less
Submitted 25 May, 2020; v1 submitted 17 December, 2019;
originally announced December 2019.
-
Finite sample deviation and variance bounds for first order autoregressive processes
Authors:
Rodrigo A. González,
Cristian R. Rojas
Abstract:
In this paper, we study finite-sample properties of the least squares estimator in first order autoregressive processes. By leveraging a result from decoupling theory, we derive upper bounds on the probability that the estimate deviates by at least a positive $\varepsilon$ from its true value. Our results consider both stable and unstable processes. Afterwards, we obtain problem-dependent non-asym…
▽ More
In this paper, we study finite-sample properties of the least squares estimator in first order autoregressive processes. By leveraging a result from decoupling theory, we derive upper bounds on the probability that the estimate deviates by at least a positive $\varepsilon$ from its true value. Our results consider both stable and unstable processes. Afterwards, we obtain problem-dependent non-asymptotic bounds on the variance of this estimator, valid for sample sizes greater than or equal to seven. Via simulations we analyze the conservatism of our bounds, and show that they reliably capture the true behavior of the quantities of interest.
△ Less
Submitted 25 May, 2020; v1 submitted 17 October, 2019;
originally announced October 2019.
-
Consistency Analysis of the Simplified Refined Instrumental Variable Method for Continuous-time Systems
Authors:
Siqi Pan,
Rodrigo A. González,
James S. Welsh,
Cristian R. Rojas
Abstract:
In this paper, we analyse the consistency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC). It is well known that the intersample behaviour of the input signal influences the quality and accuracy of the results when estimating and simulating continuous-time models. Here, we present a comprehensive analysis on the consistency of the SRIVC estimator while ta…
▽ More
In this paper, we analyse the consistency of the Simplified Refined Instrumental Variable method for Continuous-time systems (SRIVC). It is well known that the intersample behaviour of the input signal influences the quality and accuracy of the results when estimating and simulating continuous-time models. Here, we present a comprehensive analysis on the consistency of the SRIVC estimator while taking into account the intersample behaviour of the input signal. The main result of the paper shows that, under some mild conditions, the SRIVC estimator is generically consistent. We also describe some conditions when consistency is not achieved, which is important from a practical standpoint. The theoretical results are supported by simulation examples.
△ Less
Submitted 30 September, 2019;
originally announced October 2019.
-
An asymptotically optimal indirect approach to continuous-time system identification
Authors:
Rodrigo A. González,
Cristian R. Rojas,
James S. Welsh
Abstract:
The indirect approach to continuous-time system identification consists in estimating continuous-time models by first determining an appropriate discrete-time model. For a zero-order hold sampling mechanism, this approach usually leads to a transfer function estimate with relative degree 1, independent of the relative degree of the strictly proper real system. In this paper, a refinement of these…
▽ More
The indirect approach to continuous-time system identification consists in estimating continuous-time models by first determining an appropriate discrete-time model. For a zero-order hold sampling mechanism, this approach usually leads to a transfer function estimate with relative degree 1, independent of the relative degree of the strictly proper real system. In this paper, a refinement of these methods is developed. Inspired by indirect PEM, we propose a method that enforces a fixed relative degree in the continuous-time transfer function estimate, and show that the resulting estimator is consistent and asymptotically efficient. Extensive numerical simulations are put forward to show the performance of this estimator when contrasted with other indirect and direct methods for continuous-time system identification.
△ Less
Submitted 22 March, 2018;
originally announced March 2018.
