-
Affine-Invariant Midrange Statistics
Authors:
Cyrus Mostajeran,
Christian Grussler,
Rodolphe Sepulchre
Abstract:
We formulate and discuss the affine-invariant matrix midrange problem on the cone of $n\times n$ positive definite Hermitian matrices $\mathbb{P}(n)$, which is based on the Thompson metric. A particular computationally efficient midpoint of this metric is investigated as a highly scalable candidate for an average of two positive definite matrices within this context, before studying the $N$-point…
▽ More
We formulate and discuss the affine-invariant matrix midrange problem on the cone of $n\times n$ positive definite Hermitian matrices $\mathbb{P}(n)$, which is based on the Thompson metric. A particular computationally efficient midpoint of this metric is investigated as a highly scalable candidate for an average of two positive definite matrices within this context, before studying the $N$-point problem in the vector and matrix settings.
△ Less
Submitted 28 June, 2022;
originally announced June 2022.
-
Internally Hankel $k$-positive systems
Authors:
Christian Grussler,
Thiago B. Burghi,
Somayeh Sojoudi
Abstract:
The classes of externally Hankel $k$-positive LTI systems and autonomous $k$-positive systems have recently been defined, and their properties and applications began to be explored using the framework of total positivity and variation diminishing operators. In this work, these two system classes are subsumed under a new class of internally Hankel $k$-positive systems, which we define as state-spac…
▽ More
The classes of externally Hankel $k$-positive LTI systems and autonomous $k$-positive systems have recently been defined, and their properties and applications began to be explored using the framework of total positivity and variation diminishing operators. In this work, these two system classes are subsumed under a new class of internally Hankel $k$-positive systems, which we define as state-space LTI systems with $k$-positive controllability and observability operators. We show that internal Hankel $k$-positivity is a natural extension of the celebrated property of internal positivity ($k=1$), and we derive tractable conditions for verifying the cases $k> 1$ in the form of internal positivity of the first $k$ compound systems. As these conditions define a new positive realization problem, we also discuss geometric conditions for when a minimal internally Hankel $k$-positive realization exists. Finally, we use our results to establish a new framework for bounding the number of over- and undershoots in the step response of general LTI systems.
△ Less
Submitted 11 March, 2021;
originally announced March 2021.
-
On the Similarity to Nonnegative and Metzler Hessenberg Forms
Authors:
Christian Grussler,
Anders Rantzer
Abstract:
We address the issue of establishing standard forms for nonnegative and Metzler matrices by considering their similarity to nonnegative and Metzler Hessenberg matrices. It is shown that for dimensions $n \geq 3$, there always exists a subset of nonnegative matrices that are not similar to a nonnegative Hessenberg form, which in case of $n=3$ also provides a complete characterization of all such ma…
▽ More
We address the issue of establishing standard forms for nonnegative and Metzler matrices by considering their similarity to nonnegative and Metzler Hessenberg matrices. It is shown that for dimensions $n \geq 3$, there always exists a subset of nonnegative matrices that are not similar to a nonnegative Hessenberg form, which in case of $n=3$ also provides a complete characterization of all such matrices. For Metzler matrices, we further establish that they are similar to Metzler Hessenberg matrices if $n \leq 4$. In particular, this provides the first standard form for controllable third order continuous-time positive systems via a positive controller-Hessenberg form. Finally, we present an example which illustrates why this result is not easily transferred to discrete-time positive systems. While many of our supplementary results are proven in general, it remains an open question if Metzler matrices of dimensions $n \geq 5$ remain similar to Metzler Hessenberg matrices.
△ Less
Submitted 25 May, 2021; v1 submitted 8 March, 2021;
originally announced March 2021.
-
Balanced truncation of $k$-positive systems
Authors:
Christian Grussler,
Tobias Damm,
Rodolphe Sepulchre
Abstract:
This paper considers balanced truncation of discrete-time Hankel $k$-positive systems, characterized by Hankel matrices whose minors up to order $k$ are nonnegative. Our main result shows that if the truncated system has order $k$ or less, then it is Hankel totally positive ($\infty$-positive), meaning that it is a sum of first order lags. This result can be understood as a bridge between two know…
▽ More
This paper considers balanced truncation of discrete-time Hankel $k$-positive systems, characterized by Hankel matrices whose minors up to order $k$ are nonnegative. Our main result shows that if the truncated system has order $k$ or less, then it is Hankel totally positive ($\infty$-positive), meaning that it is a sum of first order lags. This result can be understood as a bridge between two known results: the property that the first-order truncation of a positive system is positive ($k=1$), and the property that balanced truncation preserves state-space symmetry. It provides a broad class of systems where balanced truncation is guaranteed to result in a minimal internally positive system.
△ Less
Submitted 29 January, 2021; v1 submitted 23 June, 2020;
originally announced June 2020.
-
Variation diminishing linear time-invariant systems
Authors:
Christian Grussler,
Rodolphe Sepulchre
Abstract:
This paper studies the variation diminishing property of $k$-positive linear time-invariant (LTI) systems, which map inputs with $k-1$ sign changes to outputs with at most the same variation. We characterize this property for the Toeplitz and Hankel operators of finite-dimensional systems. Our main result is that these operators have a dominant approximation in the form of series or parallel inter…
▽ More
This paper studies the variation diminishing property of $k$-positive linear time-invariant (LTI) systems, which map inputs with $k-1$ sign changes to outputs with at most the same variation. We characterize this property for the Toeplitz and Hankel operators of finite-dimensional systems. Our main result is that these operators have a dominant approximation in the form of series or parallel interconnections of $k$ first order positive systems. This is shown by expressing the $k$-positivity of a LTI system as the external positivity (that is, $1$-positivity) of $k$ compound LTI systems. Our characterization generalizes well known properties of externally positive systems ($k=1$) and totally positive systems ($k=\infty$; also known as relaxation systems).
△ Less
Submitted 3 February, 2021; v1 submitted 17 June, 2020;
originally announced June 2020.
-
Geometric Matrix Midranges
Authors:
Cyrus Mostajeran,
Christian Grussler,
Rodolphe Sepulchre
Abstract:
We define geometric matrix midranges for positive definite Hermitian matrices and study the midrange problem from a number of perspectives. Special attention is given to the midrange of two positive definite matrices before considering the extension of the problem to $N > 2$ matrices. We compare matrix midrange statistics with the scalar and vector midrange problem and note the special significanc…
▽ More
We define geometric matrix midranges for positive definite Hermitian matrices and study the midrange problem from a number of perspectives. Special attention is given to the midrange of two positive definite matrices before considering the extension of the problem to $N > 2$ matrices. We compare matrix midrange statistics with the scalar and vector midrange problem and note the special significance of the matrix problem from a computational standpoint. We also study various aspects of geometric matrix midrange statistics from the viewpoint of linear algebra, differential geometry and convex optimization.
△ Less
Submitted 27 May, 2020; v1 submitted 8 July, 2019;
originally announced July 2019.
-
On second-order cone positive systems
Authors:
Christian Grussler,
Anders Rantzer
Abstract:
Internal positivity offers a computationally cheap certificate for external (input-output) positivity of a linear time-invariant system. However, the drawback with this certificate lies in its realization dependency. Firstly, computing such a realization requires to find a polyhedral cone with a potentially high number of extremal generators that lifts the dimension of the state-space representati…
▽ More
Internal positivity offers a computationally cheap certificate for external (input-output) positivity of a linear time-invariant system. However, the drawback with this certificate lies in its realization dependency. Firstly, computing such a realization requires to find a polyhedral cone with a potentially high number of extremal generators that lifts the dimension of the state-space representation, significantly. Secondly, not all externally positive systems posses an internally positive realization. Thirdly, in many typical applications such as controller design, system identification and model order reduction, internal positivity is not preserved. To overcome these drawbacks, we present a tractable sufficient certificate of external positivity based on second-order cones. This certificate does not require any special state-space realization: if it succeeds with a possibly non-minimal realization, then it will do so with any minimal realization. While there exist systems where this certificate is also necessary, we also demonstrate how to construct systems, where both second-order and polyhedral cones as well as other certificates fail. Nonetheless, in contrast to other realization independent certificates, the present one appears to be favourable in terms of applicability and conservatism. Three applications are representatively discussed to underline its potential. We show how the certificate can be used to find externally positive approximations of nearly externally positive systems and demonstrated that this may help to reduce system identification errors. The same algorithm is used then to design state-feedback controllers that provide closed-loop external positivity, a common approach to avoid over- and undershooting of the step response. Lastly, we present modifications to generalized balanced truncation such that external positivity is preserved where our certificate applies.
△ Less
Submitted 8 March, 2021; v1 submitted 14 June, 2019;
originally announced June 2019.
-
Strongly unimodal systems
Authors:
Christian Grussler,
Rodolphe Sepulchre
Abstract:
We investigate the property for an input-output system to map unimodal inputs to unimodal outputs. As a first step, we analyse this property for linear time-invariant (LTI) systems, static nonlinearities, and interconnections of those. In particular, we show how unimodality is closely related to the concepts of positivity, monotonicity, and total positivity.
We investigate the property for an input-output system to map unimodal inputs to unimodal outputs. As a first step, we analyse this property for linear time-invariant (LTI) systems, static nonlinearities, and interconnections of those. In particular, we show how unimodality is closely related to the concepts of positivity, monotonicity, and total positivity.
△ Less
Submitted 9 November, 2018;
originally announced November 2018.
-
Efficient Proximal Map** Computation for Unitarily Invariant Low-Rank Inducing Norms
Authors:
Christian Grussler,
Pontus Giselsson
Abstract:
Low-rank inducing unitarily invariant norms have been introduced to convexify problems with low-rank/sparsity constraint. They are the convex envelope of a unitary invariant norm and the indicator function of an upper bounding rank constraint. The most well-known member of this family is the so-called nuclear norm. To solve optimization problems involving such norms with proximal splitting methods…
▽ More
Low-rank inducing unitarily invariant norms have been introduced to convexify problems with low-rank/sparsity constraint. They are the convex envelope of a unitary invariant norm and the indicator function of an upper bounding rank constraint. The most well-known member of this family is the so-called nuclear norm. To solve optimization problems involving such norms with proximal splitting methods, efficient ways of evaluating the proximal map** of the low-rank inducing norms are needed. This is known for the nuclear norm, but not for most other members of the low-rank inducing family. This work supplies a framework that reduces the proximal map** evaluation into a nested binary search, in which each iteration requires the solution of a much simpler problem. This simpler problem can often be solved analytically as it is demonstrated for the so-called low-rank inducing Frobenius and spectral norms. Moreover, the framework allows to compute the proximal map** of compositions of these norms with increasing convex functions and the projections onto their epigraphs. This has the additional advantage that we can also deal with compositions of increasing convex functions and low-rank inducing norms in proximal splitting methods.
△ Less
Submitted 17 October, 2018;
originally announced October 2018.
-
Local Convergence of Proximal Splitting Methods for Rank Constrained Problems
Authors:
Christian Grussler,
Pontus Giselsson
Abstract:
We analyze the local convergence of proximal splitting algorithms to solve optimization problems that are convex besides a rank constraint. For this, we show conditions under which the proximal operator of a function involving the rank constraint is locally identical to the proximal operator of its convex envelope, hence implying local convergence. The conditions imply that the non-convex algorith…
▽ More
We analyze the local convergence of proximal splitting algorithms to solve optimization problems that are convex besides a rank constraint. For this, we show conditions under which the proximal operator of a function involving the rank constraint is locally identical to the proximal operator of its convex envelope, hence implying local convergence. The conditions imply that the non-convex algorithms locally converge to a solution whenever a convex relaxation involving the convex envelope can be expected to solve the non-convex problem.
△ Less
Submitted 11 October, 2017;
originally announced October 2017.
-
Low-Rank Inducing Norms with Optimality Interpretations
Authors:
Christian Grussler,
Pontus Giselsson
Abstract:
Optimization problems with rank constraints appear in many diverse fields such as control, machine learning and image analysis. Since the rank constraint is non-convex, these problems are often approximately solved via convex relaxations. Nuclear norm regularization is the prevailing convexifying technique for dealing with these types of problem. This paper introduces a family of low-rank inducing…
▽ More
Optimization problems with rank constraints appear in many diverse fields such as control, machine learning and image analysis. Since the rank constraint is non-convex, these problems are often approximately solved via convex relaxations. Nuclear norm regularization is the prevailing convexifying technique for dealing with these types of problem. This paper introduces a family of low-rank inducing norms and regularizers which includes the nuclear norm as a special case. A posteriori guarantees on solving an underlying rank constrained optimization problem with these convex relaxations are provided. We evaluate the performance of the low-rank inducing norms on three matrix completion problems. In all examples, the nuclear norm heuristic is outperformed by convex relaxations based on other low-rank inducing norms. For two of the problems there exist low-rank inducing norms that succeed in recovering the partially unknown matrix, while the nuclear norm fails. These low-rank inducing norms are shown to be representable as semi-definite programs. Moreover, these norms have cheaply computable proximal map**s, which makes it possible to also solve problems of large size using first-order methods.
△ Less
Submitted 11 June, 2018; v1 submitted 9 December, 2016;
originally announced December 2016.
-
Low-rank Optimization with Convex Constraints
Authors:
Christian Grussler,
Anders Rantzer,
Pontus Giselsson
Abstract:
The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the objective is to find a low-rank approximation that meets rank and convex constraints, while minimizing the distance to the matrix in the squared Frobenius norm. In man…
▽ More
The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the objective is to find a low-rank approximation that meets rank and convex constraints, while minimizing the distance to the matrix in the squared Frobenius norm. In many situations, this non-convex problem is convexified by nuclear norm regularization. However, we will see that the approximations obtained by this method may be far from optimal. In this paper, we propose an alternative convex relaxation that uses the convex envelope of the squared Frobenius norm and the rank constraint. With this approach, easily verifiable conditions are obtained under which the solutions to the convex relaxation and the original non-convex problem coincide. An SDP representation of the convex envelope is derived, which allows us to apply this approach to several known problems. Our example on optimal low-rank Hankel approximation/model reduction illustrates that the proposed convex relaxation performs consistently better than nuclear norm regularization and may outperform balanced truncation.
△ Less
Submitted 6 March, 2018; v1 submitted 6 June, 2016;
originally announced June 2016.
