-
Joint Sparse Estimation with Cardinality Constraint via Mixed-Integer Semidefinite Programming
Authors:
Tianyi Liu,
Frederic Matter,
Alexander Sorg,
Marc E. Pfetsch,
Martin Haardt,
Marius Pesavento
Abstract:
The multiple measurement vectors (MMV) problem refers to the joint estimation of a row-sparse signal matrix from multiple realizations of mixtures with a known dictionary. As a generalization of the standard sparse representation problem for a single measurement, this problem is fundamental in various applications in signal processing, e.g., spectral analysis and direction-of-arrival (DOA) estimat…
▽ More
The multiple measurement vectors (MMV) problem refers to the joint estimation of a row-sparse signal matrix from multiple realizations of mixtures with a known dictionary. As a generalization of the standard sparse representation problem for a single measurement, this problem is fundamental in various applications in signal processing, e.g., spectral analysis and direction-of-arrival (DOA) estimation. In this paper, we consider the maximum a posteriori (MAP) estimation for the MMV problem, which is classically formulated as a regularized least-squares (LS) problem with an $\ell_{2,0}$-norm constraint, and derive an equivalent mixed-integer semidefinite program (MISDP) reformulation. The proposed MISDP reformulation can be exactly solved by a generic MISDP solver, which, however, becomes computationally demanding for problems of extremely large dimensions. To further reduce the computation time in such scenarios, a relaxation-based approach can be employed to obtain an approximate solution of the MISDP reformulation, at the expense of a reduced estimation performance. Numerical simulations in the context of DOA estimation demonstrate the improved error performance of our proposed method in comparison to several popular DOA estimation methods. In particular, compared to the deterministic maximum likelihood (DML) estimator, which is often used as a benchmark, the proposed method applied with a state-of-the-art MISDP solver exhibits a superior estimation performance at a significantly reduced running time. Moreover, unlike other nonconvex approaches for the MMV problem, including the greedy methods and the sparse Bayesian learning, the proposed MISDP-based method offers a guarantee of finding a global optimum.
△ Less
Submitted 6 November, 2023;
originally announced November 2023.
-
Enabling Research through the SCIP Optimization Suite 8.0
Authors:
Ksenia Bestuzheva,
Mathieu Besançon,
Wei-Kun Chen,
Antonia Chmiela,
Tim Donkiewicz,
Jasper van Doornmalen,
Leon Eifler,
Oliver Gaul,
Gerald Gamrath,
Ambros Gleixner,
Leona Gottwald,
Christoph Graczyk,
Katrin Halbig,
Alexander Hoen,
Christopher Hojny,
Rolf van der Hulst,
Thorsten Koch,
Marco Lübbecke,
Stephen J. Maher,
Frederic Matter,
Erik Mühmer,
Benjamin Müller,
Marc E. Pfetsch,
Daniel Rehfeldt,
Steffan Schlein
, et al. (10 additional authors not shown)
Abstract:
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization centered around the constraint integer programming framework SCIP. The focus of this paper is on the role of the SCIP Optimization Suite in supporting research. SCIP's main design principles are discussed, followed by a presentation of the latest performance improvements and developments in version…
▽ More
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization centered around the constraint integer programming framework SCIP. The focus of this paper is on the role of the SCIP Optimization Suite in supporting research. SCIP's main design principles are discussed, followed by a presentation of the latest performance improvements and developments in version 8.0, which serve both as examples of SCIP's application as a research tool and as a platform for further developments. Further, the paper gives an overview of interfaces to other programming and modeling languages, new features that expand the possibilities for user interaction with the framework, and the latest developments in several extensions built upon SCIP.
△ Less
Submitted 13 March, 2023;
originally announced March 2023.
-
The SCIP Optimization Suite 8.0
Authors:
Ksenia Bestuzheva,
Mathieu Besançon,
Wei-Kun Chen,
Antonia Chmiela,
Tim Donkiewicz,
Jasper van Doornmalen,
Leon Eifler,
Oliver Gaul,
Gerald Gamrath,
Ambros Gleixner,
Leona Gottwald,
Christoph Graczyk,
Katrin Halbig,
Alexander Hoen,
Christopher Hojny,
Rolf van der Hulst,
Thorsten Koch,
Marco Lübbecke,
Stephen J. Maher,
Frederic Matter,
Erik Mühmer,
Benjamin Müller,
Marc E. Pfetsch,
Daniel Rehfeldt,
Steffan Schlein
, et al. (10 additional authors not shown)
Abstract:
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization centered around the constraint integer programming framework SCIP. This paper discusses enhancements and extensions contained in version 8.0 of the SCIP Optimization Suite. Major updates in SCIP include improvements in symmetry handling and decomposition algorithms, new cutting planes, a new plugin…
▽ More
The SCIP Optimization Suite provides a collection of software packages for mathematical optimization centered around the constraint integer programming framework SCIP. This paper discusses enhancements and extensions contained in version 8.0 of the SCIP Optimization Suite. Major updates in SCIP include improvements in symmetry handling and decomposition algorithms, new cutting planes, a new plugin type for cut selection, and a complete rework of the way nonlinear constraints are handled. Additionally, SCIP 8.0 now supports interfaces for Julia as well as Matlab. Further, UG now includes a unified framework to parallelize all solvers, a utility to analyze computational experiments has been added to GCG, dual solutions can be postsolved by PaPILO, new heuristics and presolving methods were added to SCIP-SDP, and additional problem classes and major performance improvements are available in SCIP-Jack.
△ Less
Submitted 16 December, 2021;
originally announced December 2021.
-
Ambiguities in Direction-of-Arrival Estimation with Linear Arrays
Authors:
Frederic Matter,
Tobias Fischer,
Marius Pesavento,
Marc E. Pfetsch
Abstract:
In this paper, we present a novel approach to compute ambiguities in thinned uniform linear arrays, i.e., sparse non-uniform linear arrays, via a mixed-integer program. Ambiguities arise when there exists a set of distinct directions-of-arrival, for which the corresponding steering matrix is rank-deficient and are associated with nonunique parameter estimation. Our approach uses Young tableaux for…
▽ More
In this paper, we present a novel approach to compute ambiguities in thinned uniform linear arrays, i.e., sparse non-uniform linear arrays, via a mixed-integer program. Ambiguities arise when there exists a set of distinct directions-of-arrival, for which the corresponding steering matrix is rank-deficient and are associated with nonunique parameter estimation. Our approach uses Young tableaux for which a submatrix of the steering matrix has a vanishing determinant, which can be expressed through vanishing sums of unit roots. Each of these vanishing sums then corresponds to an ambiguous set of directions-of-arrival. We derive a method to enumerate such ambiguous sets using a mixed-integer program and present results on several examples.
△ Less
Submitted 20 October, 2021;
originally announced October 2021.
-
Recovery under Side Constraints
Authors:
Khaled Ardah,
Martin Haardt,
Tianyi Liu,
Frederic Matter,
Marius Pesavento,
Marc E. Pfetsch
Abstract:
This paper addresses sparse signal reconstruction under various types of structural side constraints with applications in multi-antenna systems. Side constraints may result from prior information on the measurement system and the sparse signal structure. They may involve the structure of the sensing matrix, the structure of the non-zero support values, the temporal structure of the sparse represen…
▽ More
This paper addresses sparse signal reconstruction under various types of structural side constraints with applications in multi-antenna systems. Side constraints may result from prior information on the measurement system and the sparse signal structure. They may involve the structure of the sensing matrix, the structure of the non-zero support values, the temporal structure of the sparse representationvector, and the nonlinear measurement structure. First, we demonstrate how a priori information in form of structural side constraints influence recovery guarantees (null space properties) using L1-minimization. Furthermore, for constant modulus signals, signals with row-, block- and rank-sparsity, as well as non-circular signals, we illustrate how structural prior information can be used to devise efficient algorithms with improved recovery performance and reduced computational complexity. Finally, we address the measurement system design for linear and nonlinear measurements of sparse signals. Moreover, we discuss the linear mixing matrix design based on coherence minimization. Then we extend our focus to nonlinear measurement systems where we design parallel optimization algorithms to efficiently compute stationary points in the sparse phase retrieval problem with and without dictionary learning.
△ Less
Submitted 17 June, 2021;
originally announced June 2021.
-
Block-sparse Recovery of Semidefinite Systems and Generalized Null Space Conditions
Authors:
Janin Heuer,
Frederic Matter,
Marc E. Pfetsch,
Thorsten Theobald
Abstract:
This article considers the recovery of low-rank matrices via a convex nuclear-norm minimization problem and presents two null space properties (NSP) which characterize uniform recovery for the case of block-diagonal matrices and block-diagonal positive semidefinite matrices. These null-space conditions turn out to be special cases of a new general setup, which allows to derive the mentioned NSPs a…
▽ More
This article considers the recovery of low-rank matrices via a convex nuclear-norm minimization problem and presents two null space properties (NSP) which characterize uniform recovery for the case of block-diagonal matrices and block-diagonal positive semidefinite matrices. These null-space conditions turn out to be special cases of a new general setup, which allows to derive the mentioned NSPs and well-known NSPs from the literature. We discuss the relative strength of these conditions and also present a deterministic class of matrices that satisfies the block-diagonal semidefinite NSP.
△ Less
Submitted 26 June, 2020; v1 submitted 22 July, 2019;
originally announced July 2019.
-
Joint Antenna Selection and Phase-Only Beamforming Using Mixed-Integer Nonlinear Programming
Authors:
Tobias Fischer,
Ganapati Hegde,
Frederic Matter,
Marius Pesavento,
Marc E. Pfetsch,
Andreas M. Tillmann
Abstract:
In this paper, we consider the problem of joint antenna selection and analog beamformer design in downlink single-group multicast networks. Our objective is to reduce the hardware costs by minimizing the number of required phase shifters at the transmitter while fulfilling given distortion limits at the receivers. We formulate the problem as an L0 minimization problem and devise a novel branch-and…
▽ More
In this paper, we consider the problem of joint antenna selection and analog beamformer design in downlink single-group multicast networks. Our objective is to reduce the hardware costs by minimizing the number of required phase shifters at the transmitter while fulfilling given distortion limits at the receivers. We formulate the problem as an L0 minimization problem and devise a novel branch-and-cut based algorithm to solve the resulting mixed-integer nonlinear program to optimality. We also propose a suboptimal heuristic algorithm to solve the above problem approximately with a low computational complexity. Computational results illustrate that the solutions produced by the proposed heuristic algorithm are optimal in most cases. The results also indicate that the performance of the optimal methods can be significantly improved by initializing with the result of the suboptimal method.
△ Less
Submitted 22 February, 2018;
originally announced February 2018.
