-
Robust positive model reduction via monotone matrices
Authors:
Marco Cortese,
Tommaso Grigoletto,
Francesco Ticozzi,
Augusto Ferrante
Abstract:
This work focuses on the problem of exact model reduction of positive linear systems, by leveraging minimal realization theory. While even determining the existence of a positive reachable realization remains an open problem, we are able to fully characterize the cases in which the new model is obtained with non-negative reduction matrices, and hence positivity of the reduced model is robust with…
▽ More
This work focuses on the problem of exact model reduction of positive linear systems, by leveraging minimal realization theory. While even determining the existence of a positive reachable realization remains an open problem, we are able to fully characterize the cases in which the new model is obtained with non-negative reduction matrices, and hence positivity of the reduced model is robust with respect to small perturbations of original system. The characterization is obtained by specializing monotone matrix theory to positive matrices. In addition, we provide positive reduction also when minimal ones are not available, by exploiting algebraic techniques.
△ Less
Submitted 17 June, 2024;
originally announced June 2024.
-
Distributionally Robust LQG control under Distributed Uncertainty
Authors:
Lucia Falconi,
Augusto Ferrante,
Mattia Zorzi
Abstract:
A new paradigm is proposed for the robustification of the LQG controller against distributional uncertainties on the noise process. Our controller optimizes the closed-loop performances in the worst possible scenario under the constraint that the noise distributional aberrance does not exceed a certain threshold limiting the relative entropy pseudo-distance between the actual noise distribution th…
▽ More
A new paradigm is proposed for the robustification of the LQG controller against distributional uncertainties on the noise process. Our controller optimizes the closed-loop performances in the worst possible scenario under the constraint that the noise distributional aberrance does not exceed a certain threshold limiting the relative entropy pseudo-distance between the actual noise distribution the nominal one. The main novelty is that the bounds on the distributional aberrance can be arbitrarily distributed along the whole disturbance trajectory. We discuss why this can, in principle, be a substantial advantage and we provide simulation results that substantiate such a principle.
△ Less
Submitted 8 June, 2023;
originally announced June 2023.
-
Hidden Factor estimation in Dynamic Generalized Factor Analysis Models
Authors:
Giorgio Picci,
Lucia Falconi,
Augusto Ferrante,
Mattia Zorzi
Abstract:
This paper deals with the estimation of the hidden factor in Dynamic Generalized Factor Analysis via a generalization of Kalman filtering. Asymptotic consistency is discussed and it is shown that the Kalman one-step predictor is not the right tool while the pure filter yields a consistent estimate.
This paper deals with the estimation of the hidden factor in Dynamic Generalized Factor Analysis via a generalization of Kalman filtering. Asymptotic consistency is discussed and it is shown that the Kalman one-step predictor is not the right tool while the pure filter yields a consistent estimate.
△ Less
Submitted 23 November, 2022;
originally announced November 2022.
-
M$^2$-Spectral Estimation: A Flexible Approach Ensuring Rational Solutions
Authors:
Bin Zhu,
Augusto Ferrante,
Johan Karlsson,
Mattia Zorzi
Abstract:
This paper concerns a spectral estimation problem for multivariate (i.e., vector-valued) signals defined on a multidimensional domain, abbreviated as M$^2$. The problem is posed as solving a finite number of trigonometric moment equations for a nonnegative matricial measure, which is well known as the \emph{covariance extension problem} in the literature of systems and control. This inverse proble…
▽ More
This paper concerns a spectral estimation problem for multivariate (i.e., vector-valued) signals defined on a multidimensional domain, abbreviated as M$^2$. The problem is posed as solving a finite number of trigonometric moment equations for a nonnegative matricial measure, which is well known as the \emph{covariance extension problem} in the literature of systems and control. This inverse problem and its various generalizations have been extensively studied in the past three decades, and they find applications in diverse fields such as modeling and system identification, signal and image processing, robust control, circuit theory, etc. In this paper, we address the challenging M$^2$ version of the problem, and elaborate on a solution technique via convex optimization with the $τ$-divergence family. As a major contribution of this work, we show that by properly choosing the parameter of the divergence index, the optimal spectrum is a rational function, that is, the solution is a spectral density which can be represented by a finite-dimensional system, as desired in many practical applications.
△ Less
Submitted 12 October, 2021; v1 submitted 30 April, 2020;
originally announced April 2020.
-
M$^2$-Spectral Estimation: A Relative Entropy Approach
Authors:
Bin Zhu,
Augusto Ferrante,
Johan Karlsson,
Mattia Zorzi
Abstract:
This paper deals with M$^2$-signals, namely multivariate (or vector-valued) signals defined over a multidimensional domain. In particular, we propose an optimization technique to solve the covariance extension problem for stationary random vector fields. The multidimensional Itakura-Saito distance is employed as an optimization criterion to select the solution among the spectra satisfying a finite…
▽ More
This paper deals with M$^2$-signals, namely multivariate (or vector-valued) signals defined over a multidimensional domain. In particular, we propose an optimization technique to solve the covariance extension problem for stationary random vector fields. The multidimensional Itakura-Saito distance is employed as an optimization criterion to select the solution among the spectra satisfying a finite number of moment constraints. In order to avoid technicalities that may happen on the boundary of the feasible set, we deal with the discrete version of the problem where the multidimensional integrals are approximated by Riemann sums. The spectrum solution is also discrete, which occurs naturally when the underlying random field is periodic. We show that a solution to the discrete problem exists, is unique and depends smoothly on the problem data. Therefore, we have a well-posed problem whose solution can be tuned in a smooth manner. Finally, we have applied our theory to the target parameter estimation problem in an integrated system of automotive modules. Simulation results show that our spectral estimator has promising performance.
△ Less
Submitted 16 September, 2020; v1 submitted 26 August, 2019;
originally announced August 2019.
-
Fusion of Sensors Data in Automotive Radar Systems: A Spectral Estimation Approach
Authors:
Bin Zhu,
Augusto Ferrante,
Johan Karlsson,
Mattia Zorzi
Abstract:
To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to improve the accuracy and robustness of such estimates. First we pose the target estimation problem as a multivariate multidimensional spectral estimation proble…
▽ More
To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to improve the accuracy and robustness of such estimates. First we pose the target estimation problem as a multivariate multidimensional spectral estimation problem. The problem is multivariate since each radar sensor gives rise to a measurement channel. Then we investigate how the use of the cross-spectra affects target estimates. We see that the use of the magnitude of the cross-spectrum significantly improves the accuracy of the target estimates, whereas an attempt to compensate the phase lag of the cross-spectrum only gives marginal improvement. This paper may be viewed as a first step towards applying high-resolution methods that builds on multidimensional multivariate spectral estimation for sensor fusion.
△ Less
Submitted 7 August, 2019;
originally announced August 2019.
-
On the state space and dynamics selection in linear stochastic models: a spectral factorization approach
Authors:
Augusto Ferrante,
Giorgio Picci
Abstract:
Matrix spectral factorization is traditionally described as finding spectral factors having a fixed analytic pole configuration. The classification of spectral factors then involves studying the solutions of a certain algebraic Riccati equation which parametrizes their zero structure. The pole structure of the spectral factors can be also parametrized in terms of solutions of another Riccati equat…
▽ More
Matrix spectral factorization is traditionally described as finding spectral factors having a fixed analytic pole configuration. The classification of spectral factors then involves studying the solutions of a certain algebraic Riccati equation which parametrizes their zero structure. The pole structure of the spectral factors can be also parametrized in terms of solutions of another Riccati equation. We study the relation between the solution sets of these two Riccati equations and describe the construction of general spectral factors which involve both zero- and pole-flip** on an arbitrary reference spectral factor.
△ Less
Submitted 1 February, 2018;
originally announced February 2018.
-
Time series kernel similarities for predicting Paroxysmal Atrial Fibrillation from ECGs
Authors:
Filippo Maria Bianchi,
Lorenzo Livi,
Alberto Ferrante,
Jelena Milosevic,
Miroslaw Malek
Abstract:
We tackle the problem of classifying Electrocardiography (ECG) signals with the aim of predicting the onset of Paroxysmal Atrial Fibrillation (PAF). Atrial fibrillation is the most common type of arrhythmia, but in many cases PAF episodes are asymptomatic. Therefore, in order to help diagnosing PAF, it is important to design procedures for detecting and, more importantly, predicting PAF episodes.…
▽ More
We tackle the problem of classifying Electrocardiography (ECG) signals with the aim of predicting the onset of Paroxysmal Atrial Fibrillation (PAF). Atrial fibrillation is the most common type of arrhythmia, but in many cases PAF episodes are asymptomatic. Therefore, in order to help diagnosing PAF, it is important to design procedures for detecting and, more importantly, predicting PAF episodes. We propose a method for predicting PAF events whose first step consists of a feature extraction procedure that represents each ECG as a multi-variate time series. Successively, we design a classification framework based on kernel similarities for multi-variate time series, capable of handling missing data. We consider different approaches to perform classification in the original space of the multi-variate time series and in an embedding space, defined by the kernel similarity measure. We achieve a classification accuracy comparable with state of the art methods, with the additional advantage of detecting the PAF onset up to 15 minutes in advance.
△ Less
Submitted 4 April, 2018; v1 submitted 21 January, 2018;
originally announced January 2018.
-
An Efficient Algorithm for Maximum-Entropy Extension of Block-Circulant Covariance Matrices
Authors:
Francesca P. Carli,
Augusto Ferrante,
Michele Pavon,
Giorgio Picci
Abstract:
This paper deals with maximum entropy completion of partially specified block-circulant matrices. Since positive definite symmetric circulants happen to be covariance matrices of stationary periodic processes, in particular of stationary reciprocal processes, this problem has applications in signal processing, in particular to image modeling. In fact it is strictly related to maximum likelihood es…
▽ More
This paper deals with maximum entropy completion of partially specified block-circulant matrices. Since positive definite symmetric circulants happen to be covariance matrices of stationary periodic processes, in particular of stationary reciprocal processes, this problem has applications in signal processing, in particular to image modeling. In fact it is strictly related to maximum likelihood estimation of bilateral AR-type representations of acausal signals subject to certain conditional independence constraints. The maximum entropy completion problem for block-circulant matrices has recently been solved by the authors, although leaving open the problem of an efficient computation of the solution. In this paper, we provide an effcient algorithm for computing its solution which compares very favourably with existing algorithms designed for positive definite matrix extension problems. The proposed algorithm benefits from the analysis of the relationship between our problem and the band-extension problem for block-Toeplitz matrices also developed in this paper.
△ Less
Submitted 8 February, 2013; v1 submitted 13 July, 2011;
originally announced July 2011.
-
Time and spectral domain relative entropy: A new approach to multivariate spectral estimation
Authors:
Augusto Ferrante,
Chiara Masiero,
Michele Pavon
Abstract:
The concept of spectral relative entropy rate is introduced for jointly stationary Gaussian processes. Using classical information-theoretic results, we establish a remarkable connection between time and spectral domain relative entropy rates. This naturally leads to a new spectral estimation technique where a multivariate version of the Itakura-Saito distance is employed}. It may be viewed as an…
▽ More
The concept of spectral relative entropy rate is introduced for jointly stationary Gaussian processes. Using classical information-theoretic results, we establish a remarkable connection between time and spectral domain relative entropy rates. This naturally leads to a new spectral estimation technique where a multivariate version of the Itakura-Saito distance is employed}. It may be viewed as an extension of the approach, called THREE, introduced by Byrnes, Georgiou and Lindquist in 2000 which, in turn, followed in the footsteps of the Burg-Jaynes Maximum Entropy Method. Spectral estimation is here recast in the form of a constrained spectrum approximation problem where the distance is equal to the processes relative entropy rate. The corresponding solution entails a complexity upper bound which improves on the one so far available in the multichannel framework. Indeed, it is equal to the one featured by THREE in the scalar case. The solution is computed via a globally convergent matricial Newton-type algorithm. Simulations suggest the effectiveness of the new technique in tackling multivariate spectral estimation tasks, especially in the case of short data records.
△ Less
Submitted 29 September, 2011; v1 submitted 29 March, 2011;
originally announced March 2011.
-
A Maximum Entropy solution of the Covariance Extension Problem for Reciprocal Processes
Authors:
Francesca Carli,
Augusto Ferrante,
Michele Pavon,
Giorgio Picci
Abstract:
Stationary reciprocal processes defined on a finite interval of the integer line can be seen as a special class of Markov random fields restricted to one dimension. Non stationary reciprocal processes have been extensively studied in the past especially by Jamison, Krener, Levy and co-workers. The specialization of the non-stationary theory to the stationary case, however, does not seem to have be…
▽ More
Stationary reciprocal processes defined on a finite interval of the integer line can be seen as a special class of Markov random fields restricted to one dimension. Non stationary reciprocal processes have been extensively studied in the past especially by Jamison, Krener, Levy and co-workers. The specialization of the non-stationary theory to the stationary case, however, does not seem to have been pursued in sufficient depth in the literature. Stationary reciprocal processes (and reciprocal stochastic models) are potentially useful for describing signals which naturally live in a finite region of the time (or space) line. Estimation or identification of these models starting from observed data seems still to be an open problem which can lead to many interesting applications in signal and image processing. In this paper, we discuss a class of reciprocal processes which is the acausal analog of auto-regressive (AR) processes, familiar in control and signal processing. We show that maximum likelihood identification of these processes leads to a covariance extension problem for block-circulant covariance matrices. This generalizes the famous covariance band extension problem for stationary processes on the integer line. As in the usual stationary setting on the integer line, the covariance extension problem turns out to be a basic conceptual and practical step in solving the identification problem. We show that the maximum entropy principle leads to a complete solution of the problem.
△ Less
Submitted 25 January, 2011;
originally announced January 2011.