-
Generalized Cuts and Grothendieck Covers: a Primal-Dual Approximation Framework Extending the Goemans--Williamson Algorithm
Authors:
Nathan Benedetto Proença,
Marcel K. de Carli Silva,
Cristiane M. Sato,
Levent Tunçel
Abstract:
We provide a primal-dual framework for randomized approximation algorithms utilizing semidefinite programming (SDP) relaxations. Our framework pairs a continuum of APX-complete problems including MaxCut, Max2Sat, MaxDicut, and more generally, Max-Boolean Constraint Satisfaction and MaxQ (maximization of a positive semidefinite quadratic form over the hypercube) with new APX-complete problems which…
▽ More
We provide a primal-dual framework for randomized approximation algorithms utilizing semidefinite programming (SDP) relaxations. Our framework pairs a continuum of APX-complete problems including MaxCut, Max2Sat, MaxDicut, and more generally, Max-Boolean Constraint Satisfaction and MaxQ (maximization of a positive semidefinite quadratic form over the hypercube) with new APX-complete problems which are stated as convex optimization problems with exponentially many variables. These new dual counterparts, based on what we call Grothendieck covers, range from fractional cut covering problems (for MaxCut) to tensor sign covering problems (for MaxQ). For each of these problem pairs, our framework transforms the randomized approximation algorithms with the best known approximation factors for the primal problems to randomized approximation algorithms for their dual counterparts with reciprocal approximation factors which are tight with respect to the Unique Games Conjecture. For each APX-complete pair, our algorithms solve a single SDP relaxation and generate feasible solutions for both problems which also provide approximate optimality certificates for each other. Our work utilizes techniques from areas of randomized approximation algorithms, convex optimization, spectral sparsification, as well as Chernoff-type concentration results for random matrices.
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
On Rank-Monotone Graph Operations and Minimal Obstruction Graphs for the Lovász--Schrijver SDP Hierarchy
Authors:
Yu Hin Au,
Levent Tunçel
Abstract:
We study the lift-and-project rank of the stable set polytopes of graphs with respect to the Lovász--Schrijver SDP operator $\text{LS}_+$, with a particular focus on finding and characterizing the smallest graphs with a given $\text{LS}_+$-rank (the least number of iterations of the $\text{LS}_+$ operator on the fractional stable set polytope to compute the stable set polytope). We introduce a gen…
▽ More
We study the lift-and-project rank of the stable set polytopes of graphs with respect to the Lovász--Schrijver SDP operator $\text{LS}_+$, with a particular focus on finding and characterizing the smallest graphs with a given $\text{LS}_+$-rank (the least number of iterations of the $\text{LS}_+$ operator on the fractional stable set polytope to compute the stable set polytope). We introduce a generalized vertex-stretching operation that appears to be promising in generating $\text{LS}_+$-minimal graphs and study its properties. We also provide several new $\text{LS}_+$-minimal graphs, most notably the first known instances of $12$-vertex graphs with $\text{LS}_+$-rank $4$, which provides the first advance in this direction since Escalante, Montelar, and Nasini's discovery of a $9$-vertex graph with $\text{LS}_+$-rank $3$ in 2006.
△ Less
Submitted 2 January, 2024;
originally announced January 2024.
-
Efficient Implementation of Interior-Point Methods for Quantum Relative Entropy
Authors:
Mehdi Karimi,
Levent Tuncel
Abstract:
Quantum Relative Entropy (QRE) programming is a recently popular and challenging class of convex optimization problems with significant applications in quantum computing and quantum information theory. We are interested in modern interior point (IP) methods based on optimal self-concordant barriers for the QRE cone. A range of theoretical and numerical challenges associated with such barrier funct…
▽ More
Quantum Relative Entropy (QRE) programming is a recently popular and challenging class of convex optimization problems with significant applications in quantum computing and quantum information theory. We are interested in modern interior point (IP) methods based on optimal self-concordant barriers for the QRE cone. A range of theoretical and numerical challenges associated with such barrier functions and the QRE cones have hindered the scalability of IP methods. To address these challenges, we propose a series of numerical and linear algebraic techniques and heuristics aimed at enhancing the efficiency of gradient and Hessian computations for the self-concordant barrier function, solving linear systems, and performing matrix-vector products. We also introduce and deliberate about some interesting concepts related to QRE such as symmetric quantum relative entropy (SQRE). We also introduce a two-phase method for performing facial reduction that can significantly improve the performance of QRE programming. Our new techniques have been implemented in the latest version (DDS 2.2) of the software package DDS. In addition to handling QRE constraints, DDS accepts any combination of several other conic and non-conic convex constraints. Our comprehensive numerical experiments encompass several parts including 1) a comparison of DDS 2.2 with Hypatia for the nearest correlation matrix problem, 2) using DDS for combining QRE constraints with various other constraint types, and 3) calculating the key rate for quantum key distribution (QKD) channels and presenting results for several QKD protocols.
△ Less
Submitted 9 March, 2024; v1 submitted 12 December, 2023;
originally announced December 2023.
-
Everything is possible: constructing spectrahedra with prescribed facial dimensions
Authors:
Vera Roshchina,
Levent Tunçel
Abstract:
Given any finite set of nonnegative integers, there exists a closed convex set whose facial dimension signature coincides with this set of integers, that is, the dimensions of its nonempty faces comprise exactly this set of integers. In this work, we show that such sets can be realised as solution sets of systems of finitely many convex quadratic inequalities, and hence are representable via secon…
▽ More
Given any finite set of nonnegative integers, there exists a closed convex set whose facial dimension signature coincides with this set of integers, that is, the dimensions of its nonempty faces comprise exactly this set of integers. In this work, we show that such sets can be realised as solution sets of systems of finitely many convex quadratic inequalities, and hence are representable via second-order cone programming problems, and are, in particular, spectrahedral. It also follows that these sets are facially exposed, in contrast to earlier constructions. We obtain a lower bound on the minimum number of convex quadratic inequalities needed to represent a closed convex set with prescribed facial dimension signature, and show that our bound is tight for some special cases. Finally, we relate the question of finding efficient representations with indecomposability of integer sequences and other topics, and discuss a substantial number of open questions.
△ Less
Submitted 1 March, 2024; v1 submitted 7 December, 2023;
originally announced December 2023.
-
A Primal-Dual Extension of the Goemans--Williamson Algorithm for the Weighted Fractional Cut-Covering Problem
Authors:
Nathan Benedetto Proença,
Marcel K. de Carli Silva,
Cristiane M. Sato,
Levent Tunçel
Abstract:
We study a weighted generalization of the fractional cut-covering problem, which we relate to the maximum cut problem via antiblocker and gauge duality. This relationship allows us to introduce a semidefinite programming (SDP) relaxation whose solutions may be rounded into fractional cut covers by sampling via the random hyperplane technique. We then provide a…
▽ More
We study a weighted generalization of the fractional cut-covering problem, which we relate to the maximum cut problem via antiblocker and gauge duality. This relationship allows us to introduce a semidefinite programming (SDP) relaxation whose solutions may be rounded into fractional cut covers by sampling via the random hyperplane technique. We then provide a $1/α_{\scriptscriptstyle \mathrm{GW}}$-approximation algorithm for the weighted fractional cut-covering problem, where $α_{\scriptscriptstyle \mathrm{GW}} \approx 0.878$ is the approximation factor of the celebrated Goemans--Williamson algorithm for the maximum cut problem. Nearly optimal solutions of the SDPs in our duality framework allow one to consider instances of the maximum cut and the fractional cut-covering problems as primal-dual pairs, where cuts and fractional cut covers simultaneously certify each other's approximation quality. We exploit this relationship to introduce new combinatorial certificates for both problems, as well as a randomized polynomial-time algorithm for producing such certificates. In~particular, we~show how the Goemans--Williamson algorithm implicitly approximates a weighted instance of the fractional cut-covering problem, and how our new algorithm explicitly approximates a weighted instance of the maximum cut problem. We conclude by discussing the role played by geometric representations of graphs in our results, and by proving our algorithms and analyses to be optimal in several aspects.
△ Less
Submitted 26 November, 2023;
originally announced November 2023.
-
Dyadic linear programming and extensions
Authors:
Ahmad Abdi,
Gérard Cornuéjols,
Bertrand Guenin,
Levent Tunçel
Abstract:
A rational number is dyadic if it has a finite binary representation $p/2^k$, where $p$ is an integer and $k$ is a nonnegative integer. Dyadic rationals are important for numerical computations because they have an exact representation in floating-point arithmetic on a computer. A vector is dyadic if all its entries are dyadic rationals. We study the problem of finding a dyadic optimal solution to…
▽ More
A rational number is dyadic if it has a finite binary representation $p/2^k$, where $p$ is an integer and $k$ is a nonnegative integer. Dyadic rationals are important for numerical computations because they have an exact representation in floating-point arithmetic on a computer. A vector is dyadic if all its entries are dyadic rationals. We study the problem of finding a dyadic optimal solution to a linear program, if one exists. We show how to solve dyadic linear programs in polynomial time. We give bounds on the size of the support of a solution as well as on the size of the denominators. We identify properties that make the solution of dyadic linear programs possible: closure under addition and negation, and density, and we extend the algorithmic framework beyond the dyadic case.
△ Less
Submitted 8 September, 2023;
originally announced September 2023.
-
Stable Set Polytopes with High Lift-and-Project Ranks for the Lovász-Schrijver SDP Operator
Authors:
Yu Hin Au,
Levent Tunçel
Abstract:
We study the lift-and-project rank of the stable set polytopes of graphs with respect to the Lovász-Schrijver SDP operator $\text{LS}_+$. In particular, we focus on a search for relatively small graphs with high $\text{LS}_+$-rank (i.e., the least number of iterations of the $\text{LS}_+$ operator on the fractional stable set polytope to compute the stable set polytope). We provide families of gra…
▽ More
We study the lift-and-project rank of the stable set polytopes of graphs with respect to the Lovász-Schrijver SDP operator $\text{LS}_+$. In particular, we focus on a search for relatively small graphs with high $\text{LS}_+$-rank (i.e., the least number of iterations of the $\text{LS}_+$ operator on the fractional stable set polytope to compute the stable set polytope). We provide families of graphs whose $\text{LS}_+$-rank is asymptotically a linear function of its number of vertices, which is the best possible up to improvements in the constant factor. This improves upon the previous best result in this direction from 1999, which yielded graphs whose $\text{LS}_+$-rank only grew with the square root of the number of vertices.
△ Less
Submitted 24 April, 2024; v1 submitted 15 March, 2023;
originally announced March 2023.
-
Graphs with large girth and chromatic number are hard for Nullstellensatz
Authors:
Julian Romero,
Levent Tunçel
Abstract:
We study the computational efficiency of approaches, based on Hilbert's Nullstellensatz, which use systems of linear equations for detecting non-colorability of graphs having large girth and chromatic number. We show that for every non-$k$-colorable graph with $n$ vertices and girth $g>4k$, the algorithm is required to solve systems of size at least $n^{Ω(g)}$ in order to detect its non-$k$-colora…
▽ More
We study the computational efficiency of approaches, based on Hilbert's Nullstellensatz, which use systems of linear equations for detecting non-colorability of graphs having large girth and chromatic number. We show that for every non-$k$-colorable graph with $n$ vertices and girth $g>4k$, the algorithm is required to solve systems of size at least $n^{Ω(g)}$ in order to detect its non-$k$-colorability.
△ Less
Submitted 10 December, 2022;
originally announced December 2022.
-
Linear optimization over homogeneous matrix cones
Authors:
Levent Tunçel,
Lieven Vandenberghe
Abstract:
A convex cone is homogeneous if its automorphism group acts transitively on the interior of the cone, i.e., for every pair of points in the interior of the cone, there exists a cone automorphism that maps one point to the other. Cones that are homogeneous and self-dual are called symmetric. The symmetric cones include the positive semidefinite matrix cone and the second order cone as important pra…
▽ More
A convex cone is homogeneous if its automorphism group acts transitively on the interior of the cone, i.e., for every pair of points in the interior of the cone, there exists a cone automorphism that maps one point to the other. Cones that are homogeneous and self-dual are called symmetric. The symmetric cones include the positive semidefinite matrix cone and the second order cone as important practical examples. In this paper, we consider the less well-studied conic optimization problems over cones that are homogeneous but not necessarily self-dual. We start with cones of positive semidefinite symmetric matrices with a given sparsity pattern. Homogeneous cones in this class are characterized by nested block-arrow sparsity patterns, a subset of the chordal sparsity patterns. We describe transitive subsets of the automorphism groups of the cones and their duals, and important properties of the composition of log-det barrier functions with the automorphisms in this set. Next, we consider extensions to linear slices of the positive semidefinite cone, i.e., intersection of the positive semidefinite cone with a linear subspace, and review conditions that make the cone homogeneous. In the third part of the paper we give a high-level overview of the classical algebraic theory of homogeneous cones due to Vinberg and Rothaus. A fundamental consequence of this theory is that every homogeneous cone admits a spectrahedral (linear matrix inequality) representation. We conclude by discussing the role of homogeneous cone structure in primal-dual symmetric interior-point methods.
△ Less
Submitted 1 November, 2022;
originally announced November 2022.
-
Computational complexity of decomposing a symmetric matrix as a sum of positive semidefinite and diagonal matrices
Authors:
Levent Tunçel,
Stephen A. Vavasis,
**gye Xu
Abstract:
We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis and they have been studied for many decades. On the one hand, we prove that when the rank of the positive semidefinite matrix in the decomposition is bounded above by an absolute constant, the problem can b…
▽ More
We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis and they have been studied for many decades. On the one hand, we prove that when the rank of the positive semidefinite matrix in the decomposition is bounded above by an absolute constant, the problem can be solved in polynomial time. On the other hand, we prove that, in general, these problems as well as their certain approximation versions are all NP-hard. Finally, we prove that many of these low-rank decomposition problems are complete in the first-order theory of the reals; i.e., given any system of polynomial equations, we can write down a low-rank decomposition problem in polynomial time so that the original system has a solution iff our corresponding decomposition problem has a feasible solution of certain (lowest) rank.
△ Less
Submitted 28 September, 2023; v1 submitted 12 September, 2022;
originally announced September 2022.
-
Testing idealness in the filter oracle model
Authors:
Ahmad Abdi,
Gérard Cornuéjols,
Bertrand Guenin,
Levent Tunçel
Abstract:
A filter oracle for a clutter consists of a finite set $V$ along with an oracle which, given any set $X\subseteq V$, decides in unit time whether or not $X$ contains a member of the clutter. Let $\mathfrak{A}_{2n}$ be an algorithm that, given any clutter $\mathcal{C}$ over $2n$ elements via a filter oracle, decides whether or not $\mathcal{C}$ is ideal. We prove that in the worst case,…
▽ More
A filter oracle for a clutter consists of a finite set $V$ along with an oracle which, given any set $X\subseteq V$, decides in unit time whether or not $X$ contains a member of the clutter. Let $\mathfrak{A}_{2n}$ be an algorithm that, given any clutter $\mathcal{C}$ over $2n$ elements via a filter oracle, decides whether or not $\mathcal{C}$ is ideal. We prove that in the worst case, $\mathfrak{A}_{2n}$ must make at least $2^n$ calls to the filter oracle. Our proof uses the theory of cuboids.
△ Less
Submitted 15 February, 2022;
originally announced February 2022.
-
Total dual dyadicness and dyadic generating sets
Authors:
Ahmad Abdi,
Gérard Cornuéjols,
Bertrand Guenin,
Levent Tunçel
Abstract:
A vector is \emph{dyadic} if each of its entries is a dyadic rational number, i.e. of the form $\frac{a}{2^k}$ for some integers $a,k$ with $k\geq 0$. A linear system $Ax\leq b$ with integral data is \emph{totally dual dyadic} if whenever $\min\{b^\top y:A^\top y=w,y\geq {\bf 0}\}$ for $w$ integral, has an optimal solution, it has a dyadic optimal solution. In this paper, we study total dual dyadi…
▽ More
A vector is \emph{dyadic} if each of its entries is a dyadic rational number, i.e. of the form $\frac{a}{2^k}$ for some integers $a,k$ with $k\geq 0$. A linear system $Ax\leq b$ with integral data is \emph{totally dual dyadic} if whenever $\min\{b^\top y:A^\top y=w,y\geq {\bf 0}\}$ for $w$ integral, has an optimal solution, it has a dyadic optimal solution. In this paper, we study total dual dyadicness, and give a co-NP characterization of it in terms of \emph{dyadic generating sets for cones and subspaces}, the former being the dyadic analogue of \emph{Hilbert bases}, and the latter a polynomial-time recognizable relaxation of the former. Along the way, we see some surprising turn of events when compared to total dual integrality, primarily led by the \emph{density} of the dyadic rationals. Our study ultimately leads to a better understanding of total dual integrality and polyhedral integrality. We see examples from dyadic matrices, $T$-joins, cycles, and perfect matchings of a graph.
△ Less
Submitted 13 March, 2022; v1 submitted 10 November, 2021;
originally announced November 2021.
-
On Connections Between Association Schemes and Analyses of Polyhedral and Positive Semidefinite Lift-and-Project Relaxations
Authors:
Yu Hin Au,
Nathan Lindzey,
Levent Tunçel
Abstract:
We explore some connections between association schemes and the analyses of the semidefinite programming (SDP) based convex relaxations of combinatorial optimization problems in the Lovász--Schrijver lift-and-project hierarchy. Our analysis of the relaxations of the stable set polytope leads to bounds on the clique and stability numbers of some regular graphs reminiscent of classical bounds by Del…
▽ More
We explore some connections between association schemes and the analyses of the semidefinite programming (SDP) based convex relaxations of combinatorial optimization problems in the Lovász--Schrijver lift-and-project hierarchy. Our analysis of the relaxations of the stable set polytope leads to bounds on the clique and stability numbers of some regular graphs reminiscent of classical bounds by Delsarte and Hoffman, as well as the notion of deeply vertex-transitive graphs -- highly symmetric graphs that we show arise naturally from some association schemes. We also study relaxations of the hypergraph matching problem, and determine exactly or provide bounds on the lift-and-project ranks of these relaxations. Our proofs for these results also inspire the study of the general hypermatching pseudo-scheme, which is an association scheme except it is generally non-commutative. We then illustrate the usefulness of obtaining commutative subschemes from non-commutative pseudo-schemes via contraction in this context.
△ Less
Submitted 22 December, 2023; v1 submitted 19 August, 2020;
originally announced August 2020.
-
Domain-Driven Solver (DDS) Version 2.0: a MATLAB-based Software Package for Convex Optimization Problems in Domain-Driven Form
Authors:
Mehdi Karimi,
Levent Tunçel
Abstract:
Domain-Driven Solver (DDS) is a MATLAB-based software package for convex optimization problems in Domain-Driven form [Karimi and Tunçel, arXiv:1804.06925]. The current version of DDS accepts every combination of the following function/set constraints: (1) symmetric cones (LP, SOCP, and SDP); (2) quadratic constraints that are SOCP representable; (3) direct sums of an arbitrary collection of 2-dime…
▽ More
Domain-Driven Solver (DDS) is a MATLAB-based software package for convex optimization problems in Domain-Driven form [Karimi and Tunçel, arXiv:1804.06925]. The current version of DDS accepts every combination of the following function/set constraints: (1) symmetric cones (LP, SOCP, and SDP); (2) quadratic constraints that are SOCP representable; (3) direct sums of an arbitrary collection of 2-dimensional convex sets defined as the epigraphs of univariate convex functions (including as special cases geometric programming and entropy programming); (4) generalized power cone; (5) epigraphs of matrix norms (including as a special case minimization of nuclear norm over a linear subspace); (6) vector relative entropy; (7) epigraphs of quantum entropy and quantum relative entropy; and (8) constraints involving hyperbolic polynomials. DDS is a practical implementation of the infeasible-start primal-dual algorithm designed and analyzed in [Karimi and Tunçel, arXiv:1804.06925]. This manuscript contains the users' guide, as well as theoretical results needed for the implementation of the algorithms. To help the users, we included many examples. We also discussed some implementation details and techniques we used to improve the efficiency and further expansion of the software to cover the emerging classes of convex optimization problems.
△ Less
Submitted 10 November, 2020; v1 submitted 7 August, 2019;
originally announced August 2019.
-
Status Determination by Interior-Point Methods for Convex Optimization Problems in Domain-Driven Form
Authors:
Mehdi Karimi,
Levent Tunçel
Abstract:
We study the geometry of convex optimization problems given in a Domain-Driven form and categorize possible statuses of these problems using duality theory. Our duality theory for the Domain-Driven form, which accepts both conic and non-conic constraints, lets us determine and certify statuses of a problem as rigorously as the best approaches for conic formulations (which have been demonstrably ve…
▽ More
We study the geometry of convex optimization problems given in a Domain-Driven form and categorize possible statuses of these problems using duality theory. Our duality theory for the Domain-Driven form, which accepts both conic and non-conic constraints, lets us determine and certify statuses of a problem as rigorously as the best approaches for conic formulations (which have been demonstrably very efficient in this context). We analyze the performance of an infeasible-start primal-dual algorithm for the Domain-Driven form in returning the certificates for the defined statuses. Our iteration complexity bounds for this more practical Domain-Driven form match the best ones available for conic formulations. At the end, we propose some stop** criteria for practical algorithms based on insights gained from our analyses.
△ Less
Submitted 21 January, 2019;
originally announced January 2019.
-
Strict Complementarity in MaxCut SDP
Authors:
Marcel K. de Carli Silva,
Levent Tunçel
Abstract:
The MaxCut SDP is one of the most well-known semidefinite programs, and it has many favorable properties. One of its nicest geometric/duality properties is the fact that the vertices of its feasible region correspond exactly to the cuts of a graph, as proved by Laurent and Poljak in 1995. Recall that a boundary point $x$ of a convex set $C$ is called a vertex of $C$ if the normal cone of $C$ at…
▽ More
The MaxCut SDP is one of the most well-known semidefinite programs, and it has many favorable properties. One of its nicest geometric/duality properties is the fact that the vertices of its feasible region correspond exactly to the cuts of a graph, as proved by Laurent and Poljak in 1995. Recall that a boundary point $x$ of a convex set $C$ is called a vertex of $C$ if the normal cone of $C$ at $x$ is full-dimensional.
We study how often strict complementarity holds or fails for the MaxCut SDP when a vertex of the feasible region is optimal, i.e., when the SDP relaxation is tight. While strict complementarity is known to hold when the objective function is in the interior of the normal cone at any vertex, we prove that it fails generically at the boundary of such normal cone. In this regard, the MaxCut SDP displays the nastiest behavior possible for a convex optimization problem.
We also study strict complementarity with respect to two classes of objective functions. We show that, when the objective functions are sampled uniformly from the negative semidefinite rank-one matrices in the boundary of the normal cone at any vertex, the probability that strict complementarity holds lies in $(0,1)$. We also extend a construction due to Laurent and Poljak of weighted Laplacian matrices for which strict complementarity fails. Their construction works for complete graphs, and we extend it to cosums of graphs under some mild conditions.
△ Less
Submitted 4 June, 2018;
originally announced June 2018.
-
On the spectral structure of Jordan-Kronecker products of symmetric and skew-symmetric matrices
Authors:
Nargiz Kalantarova,
Levent Tunçel
Abstract:
Motivated by the conjectures formulated in 2003 by Tunçel et al., we study interlacing properties of the eigenvalues of $A\otimes B + B\otimes A$ for pairs of $n$-by-$n$ matrices $A, B$. We prove that for every pair of symmetric matrices (and skew-symmetric matrices) with one of them at most rank two, the \emph{odd spectrum} (those eigenvalues determined by skew-symmetric eigenvectors) of…
▽ More
Motivated by the conjectures formulated in 2003 by Tunçel et al., we study interlacing properties of the eigenvalues of $A\otimes B + B\otimes A$ for pairs of $n$-by-$n$ matrices $A, B$. We prove that for every pair of symmetric matrices (and skew-symmetric matrices) with one of them at most rank two, the \emph{odd spectrum} (those eigenvalues determined by skew-symmetric eigenvectors) of $A\otimes B + B\otimes A$ interlaces its \emph{even spectrum} (those eigenvalues determined by symmetric eigenvectors). Using this result, we also show that when $n \leq 3$, the odd spectrum of $A\otimes B + B\otimes A$ interlaces its even spectrum for every pair $A, B$. The interlacing results also specify the structure of the eigenvectors corresponding to the extreme eigenvalues. In addition, we identify where the conjecture(s) and some interlacing properties hold for a number of structured matrices. We settle the conjectures of Tunçel et al. and show they fail for some pairs of symmetric matrices $A, B$, when $n\geq 4$ and the ranks of $A$ and $B$ are at least $3$.
△ Less
Submitted 7 August, 2020; v1 submitted 24 May, 2018;
originally announced May 2018.
-
Primal-Dual Interior-Point Methods for Domain-Driven Formulations
Authors:
Mehdi Karimi,
Levent Tunçel
Abstract:
We study infeasible-start primal-dual interior-point methods for convex optimization problems given in a typically natural form we denote as Domain-Driven formulation. Our algorithms extend many advantages of primal-dual interior-point techniques available for conic formulations, such as the current best complexity bounds, and more robust certificates of approximate optimality, unboundedness, and…
▽ More
We study infeasible-start primal-dual interior-point methods for convex optimization problems given in a typically natural form we denote as Domain-Driven formulation. Our algorithms extend many advantages of primal-dual interior-point techniques available for conic formulations, such as the current best complexity bounds, and more robust certificates of approximate optimality, unboundedness, and infeasibility, to Domain-Driven formulations. The complexity results are new for the infeasible-start setup used, even in the case of linear programming. In addition to complexity results, our algorithms aim for expanding the applications of, and software for interior-point methods to wider classes of problems beyond optimization over symmetric cones.
△ Less
Submitted 13 March, 2019; v1 submitted 18 April, 2018;
originally announced April 2018.
-
Pointed Closed Convex Sets are the Intersection of All Rational Supporting Closed Halfspaces
Authors:
Marcel K. de Carli Silva,
Levent Tunçel
Abstract:
We prove that every pointed closed convex set in $\mathbb{R}^n$ is the intersection of all the rational closed halfspaces that contain it. This generalizes a previous result by the authors for compact convex sets.
We prove that every pointed closed convex set in $\mathbb{R}^n$ is the intersection of all the rational closed halfspaces that contain it. This generalizes a previous result by the authors for compact convex sets.
△ Less
Submitted 8 February, 2018;
originally announced February 2018.
-
A Notion of Total Dual Integrality for Convex, Semidefinite, and Extended Formulations
Authors:
Marcel K. de Carli Silva,
Levent Tunçel
Abstract:
Total dual integrality is a powerful and unifying concept in polyhedral combinatorics and integer programming that enables the refinement of geometric min-max relations given by linear programming Strong Duality into combinatorial min-max theorems. The definition of total dual integrality (TDI) revolves around the existence of optimal dual solutions that are integral, and thus naturally applies to…
▽ More
Total dual integrality is a powerful and unifying concept in polyhedral combinatorics and integer programming that enables the refinement of geometric min-max relations given by linear programming Strong Duality into combinatorial min-max theorems. The definition of total dual integrality (TDI) revolves around the existence of optimal dual solutions that are integral, and thus naturally applies to a host of combinatorial optimization problems that are cast as integer programs whose LP relaxations have the TDIness property. However, when combinatorial problems are formulated using more general convex relaxations, such as semidefinite programs (SDPs), it is not at all clear what an appropriate notion of integrality in the dual program is, thus inhibiting the generalization of the theory to more general forms of structured convex optimization. (In fact, we argue that the rank-one constraint usually added to SDP relaxations is not adequate in the dual SDP.)
In this paper, we propose a notion of total dual integrality for SDPs that generalizes the notion for LPs, by relying on an "integrality constraint" for SDPs that is primal-dual symmetric. A key ingredient for the theory is a generalization to compact convex sets of a result of Hoffman for polytopes, fundamental for generalizing the polyhedral notion of total dual integrality introduced by Edmonds and Giles. We study the corresponding theory applied to SDP formulations for stable sets in graphs using the Lovász theta function and show that total dual integrality in this case corresponds to the underlying graph being perfect. We also relate dual integrality of an SDP formulation for the maximum cut problem to bipartite graphs. Total dual integrality for extended formulations naturally comes into play in this context.
△ Less
Submitted 27 January, 2018;
originally announced January 2018.
-
Facially Dual Complete (Nice) cones and lexicographic tangents
Authors:
Vera Roshchina,
Levent Tunçel
Abstract:
We study the boundary structure of closed convex cones, with a focus on facially dual complete (nice) cones. These cones form a proper subset of facially exposed convex cones, and they behave well in the context of duality theory for convex optimization. Using the well-known and commonly used concept of tangent cones in nonlinear optimization, we introduce some new notions for exposure of faces of…
▽ More
We study the boundary structure of closed convex cones, with a focus on facially dual complete (nice) cones. These cones form a proper subset of facially exposed convex cones, and they behave well in the context of duality theory for convex optimization. Using the well-known and commonly used concept of tangent cones in nonlinear optimization, we introduce some new notions for exposure of faces of convex sets. Based on these new notions, we obtain a necessary condition and a sufficient condition for a cone to be facially dual complete. In our sufficient condition, we utilize a new notion called lexicographic tangent cones (these are a family of cones obtained from a recursive application of the tangent cone concept). Lexicographic tangent cones are related to Nesterov's lexicographic derivatives and to the notion of subtransversality in the context of variational analysis.
△ Less
Submitted 27 February, 2019; v1 submitted 20 April, 2017;
originally announced April 2017.
-
Elementary polytopes with high lift-and-project ranks for strong positive semidefinite operators
Authors:
Yu Hin Au,
Levent Tunçel
Abstract:
We consider operators acting on convex subsets of the unit hypercube. These operators are used in constructing convex relaxations of combinatorial optimization problems presented as a 0,1 integer programming problem or a 0,1 polynomial optimization problem. Our focus is mostly on operators that, when expressed as a lift-and-project operator, involve the use of semidefiniteness constraints in the l…
▽ More
We consider operators acting on convex subsets of the unit hypercube. These operators are used in constructing convex relaxations of combinatorial optimization problems presented as a 0,1 integer programming problem or a 0,1 polynomial optimization problem. Our focus is mostly on operators that, when expressed as a lift-and-project operator, involve the use of semidefiniteness constraints in the lifted space, including operators due to Lasserre and variants of the Sherali--Adams and Bienstock--Zuckerberg operators. We study the performance of these semidefinite-optimization-based lift-and-project operators on some elementary polytopes --- hypercubes that are chipped (at least one vertex of the hypercube removed by intersection with a closed halfspace) or cropped (all $2^n$ vertices of the hypercube removed by intersection with $2^n$ closed halfspaces) to varying degrees of severity $ρ$. We prove bounds on $ρ$ where these operators would perform badly on the aforementioned examples. We also show that the integrality gap of the chipped hypercube is invariant under the application of several lift-and-project operators of varying strengths.
△ Less
Submitted 26 August, 2016;
originally announced August 2016.
-
Approximation Ratio of LD Algorithm for Multi-Processor Scheduling and the Coffman-Sethi Conjecture
Authors:
Peruvemba Sundaram Ravi,
Levent Tuncel
Abstract:
Coffman and Sethi proposed a heuristic algorithm, called LD, for multi-processor scheduling, to minimize makespan over flowtime-optimal schedules. LD algorithm is a natural extension of a very well-known list scheduling algorithm, Longest Processing Time (LPT) list scheduling, to our bicriteria scheduling problem. Moreover, in 1976, Coffman and Sethi conjectured that LD algorithm has precisely the…
▽ More
Coffman and Sethi proposed a heuristic algorithm, called LD, for multi-processor scheduling, to minimize makespan over flowtime-optimal schedules. LD algorithm is a natural extension of a very well-known list scheduling algorithm, Longest Processing Time (LPT) list scheduling, to our bicriteria scheduling problem. Moreover, in 1976, Coffman and Sethi conjectured that LD algorithm has precisely the following worst-case performance bound: $\frac{5}{4} - \frac{3}{4(4m-1)}$, where m is the number of machines. In this paper, utilizing some recent work by the authors and Huang, from 2013, which exposed some very strong combinatorial properties of various presumed minimal counterexamples to the conjecture, we provide a proof of this conjecture. The problem and the LD algorithm have connections to other fundamental problems (such as the assembly line-balancing problem) and to other algorithms.
△ Less
Submitted 6 May, 2015; v1 submitted 5 May, 2015;
originally announced May 2015.
-
Quantum and classical coin-flip** protocols based on bit-commitment and their point games
Authors:
Ashwin Nayak,
Jamie Sikora,
Levent Tunçel
Abstract:
We focus on a family of quantum coin-flip** protocols based on bit-commitment. We discuss how the semidefinite programming formulations of cheating strategies can be reduced to optimizing a linear combination of fidelity functions over a polytope. These turn out to be much simpler semidefinite programs which can be modelled using second-order cone programming problems. We then use these simplifi…
▽ More
We focus on a family of quantum coin-flip** protocols based on bit-commitment. We discuss how the semidefinite programming formulations of cheating strategies can be reduced to optimizing a linear combination of fidelity functions over a polytope. These turn out to be much simpler semidefinite programs which can be modelled using second-order cone programming problems. We then use these simplifications to construct their point games as developed by Kitaev. We also study the classical version of these protocols and use linear optimization to formulate optimal cheating strategies. We then construct the point games for the classical protocols as well using the analysis for the quantum case.
We discuss the philosophical connections between the classical and quantum protocols and their point games as viewed from optimization theory. In particular, we observe an analogy between a spectrum of physical theories (from classical to quantum) and a spectrum of convex optimization problems (from linear programming to semidefinite programming, through second-order cone programming). In this analogy, classical systems correspond to linear programming problems and the level of quantum features in the system is correlated to the level of sophistication of the semidefinite programming models on the optimization side.
Concerning security analysis, we use the classical point games to prove that every classical protocol of this type allows exactly one of the parties to entirely determine the coin-flip. Using the relationships between the quantum and classical protocols, we show that only "classical" protocols can saturate Kitaev's lower bound for strong coin-flip**. Moreover, if the product of Alice and Bob's optimal cheating probabilities is 1/2, then one party can cheat with probability 1. This rules out quantum protocols of this type from attaining the optimal level of security.
△ Less
Submitted 16 April, 2015;
originally announced April 2015.
-
An Axiomatic Duality Framework for the Theta Body and Related Convex Corners
Authors:
Marcel K. de Carli Silva,
Levent Tunçel
Abstract:
Lovasz theta function and the related theta body of graphs have been in the center of the intersection of four research areas: combinatorial optimization, graph theory, information theory, and semidefinite optimization. In this paper, utilizing a modern convex optimization viewpoint, we provide a set of minimal conditions (axioms) under which certain key, desired properties are generalized, includ…
▽ More
Lovasz theta function and the related theta body of graphs have been in the center of the intersection of four research areas: combinatorial optimization, graph theory, information theory, and semidefinite optimization. In this paper, utilizing a modern convex optimization viewpoint, we provide a set of minimal conditions (axioms) under which certain key, desired properties are generalized, including the main equivalent characterizations of the theta function, the theta body of graphs, and the corresponding antiblocking duality relations. Our framework describes several semidefinite and polyhedral relaxations of the stable set polytope of a graph as generalized theta bodies. As a by-product of our approach, we introduce the notion of "Schur Lifting" of cones which is dual to PSD Lifting (more commonly used in SDP relaxations of combinatorial optimization problems) in our axiomatic generalization. We also generalize the notion of complements of graphs to diagonally scaling-invariant polyhedral cones. Finally, we provide a weighted generalization of the copositive formulation of the fractional chromatic number by Dukanovic and Rendl.
△ Less
Submitted 5 December, 2014;
originally announced December 2014.
-
Local Superlinear Convergence of Polynomial-Time Interior-Point Methods for Hyperbolic Cone Optimization Problems
Authors:
Yu. Nesterov,
Levent Tuncel
Abstract:
In this paper, we establish the local superlinear convergence property of some polynomial-time interior-point methods for an important family of conic optimization problems. The main structural property used in our analysis is the logarithmic homogeneity of self-concordant barrier function, which must have {\em negative curvature}. We propose a new path-following predictor-corrector scheme, which…
▽ More
In this paper, we establish the local superlinear convergence property of some polynomial-time interior-point methods for an important family of conic optimization problems. The main structural property used in our analysis is the logarithmic homogeneity of self-concordant barrier function, which must have {\em negative curvature}. We propose a new path-following predictor-corrector scheme, which work only in the dual space. It is based on an easily computable gradient proximity measure, which ensures an automatic transformation of the global linear rate of convergence to the local superlinear one under some mild assumptions. Our step-size procedure for the predictor step is related to the maximum step size maintaining feasibility. As the optimal solution set is approached, our algorithm automatically tightens the neighborhood of the central path proportionally to the current duality gap.
△ Less
Submitted 4 December, 2014;
originally announced December 2014.
-
Interior-point algorithms for convex optimization based on primal-dual metrics
Authors:
Tor Myklebust,
Levent Tunçel
Abstract:
We propose and analyse primal-dual interior-point algorithms for convex optimization problems in conic form. The families of algorithms we analyse are so-called short-step algorithms and they match the current best iteration complexity bounds for primal-dual symmetric interior-point algorithm of Nesterov and Todd, for symmetric cone programming problems with given self-scaled barriers. Our results…
▽ More
We propose and analyse primal-dual interior-point algorithms for convex optimization problems in conic form. The families of algorithms we analyse are so-called short-step algorithms and they match the current best iteration complexity bounds for primal-dual symmetric interior-point algorithm of Nesterov and Todd, for symmetric cone programming problems with given self-scaled barriers. Our results apply to any self-concordant barrier for any convex cone. We also prove that certain specializations of our algorithms to hyperbolic cone programming problems (which lie strictly between symmetric cone programming and general convex optimization problems in terms of generality) can take advantage of the favourable special structure of hyperbolic barriers. We make new connections to Riemannian geometry, integrals over operator spaces, Gaussian quadrature, and strengthen the connection of our algorithms to quasi-Newton updates and hence first-order methods in general.
△ Less
Submitted 8 November, 2014;
originally announced November 2014.
-
Lovász-Schrijver SDP-operator, near-perfect graphs and near-bipartite graphs
Authors:
S. Bianchi,
M. Escalante,
G. Nasini,
L. Tunçel
Abstract:
We study the Lovász-Schrijver lift-and-project operator ($LS_+$) based on the cone of symmetric, positive semidefinite matrices, applied to the fractional stable set polytope of graphs. The problem of obtaining a combinatorial characterization of graphs for which the $LS_+$-operator generates the stable set polytope in one step has been open since 1990. We call these graphs $LS_+$-perfect. In the…
▽ More
We study the Lovász-Schrijver lift-and-project operator ($LS_+$) based on the cone of symmetric, positive semidefinite matrices, applied to the fractional stable set polytope of graphs. The problem of obtaining a combinatorial characterization of graphs for which the $LS_+$-operator generates the stable set polytope in one step has been open since 1990. We call these graphs $LS_+$-perfect. In the current contribution, we pursue a full combinatorial characterization of $LS_+$-perfect graphs and make progress towards such a characterization by establishing a new, close relationship among $LS_+$-perfect graphs, near-bipartite graphs and a newly introduced concept of full-support-perfect graphs.
△ Less
Submitted 7 November, 2014;
originally announced November 2014.
-
Primal-Dual Entropy Based Interior-Point Algorithms for Linear Optimization
Authors:
Mehdi Karimi,
Shen Lou,
Levent Tunçel
Abstract:
We propose a family of search directions based on primal-dual entropy in the context of interior-point methods for linear optimization. We show that by using entropy based search directions in the predictor step of a predictor-corrector algorithm together with a homogeneous self-dual embedding, we can achieve the current best iteration complexity bound for linear optimization. Then, we focus on so…
▽ More
We propose a family of search directions based on primal-dual entropy in the context of interior-point methods for linear optimization. We show that by using entropy based search directions in the predictor step of a predictor-corrector algorithm together with a homogeneous self-dual embedding, we can achieve the current best iteration complexity bound for linear optimization. Then, we focus on some wide neighborhood algorithms and show that in our family of entropy based search directions, we can find the best search direction and step size combination by performing a plane search at each iteration. For this purpose, we propose a heuristic plane search algorithm as well as an exact one. Finally, we perform computational experiments to study the performance of entropy-based search directions in wide neighborhoods of the central path, with and without utilizing the plane search algorithms.
△ Less
Submitted 29 October, 2014;
originally announced October 2014.
-
A search for quantum coin-flip** protocols using optimization techniques
Authors:
Ashwin Nayak,
Jamie Sikora,
Levent Tunçel
Abstract:
Coin-flip** is a cryptographic task in which two physically separated, mistrustful parties wish to generate a fair coin-flip by communicating with each other. Chailloux and Kerenidis (2009) designed quantum protocols that guarantee coin-flips with near optimal bias. The probability of any outcome in these protocols is provably at most $1/\sqrt{2} + δ$ for any given $δ> 0$. However, no explicit d…
▽ More
Coin-flip** is a cryptographic task in which two physically separated, mistrustful parties wish to generate a fair coin-flip by communicating with each other. Chailloux and Kerenidis (2009) designed quantum protocols that guarantee coin-flips with near optimal bias. The probability of any outcome in these protocols is provably at most $1/\sqrt{2} + δ$ for any given $δ> 0$. However, no explicit description of these protocols is known, and the number of rounds in the protocols tends to infinity as $δ$ goes to 0. In fact, the smallest bias achieved by known explicit protocols is $1/4$ (Ambainis, 2001).
We take a computational optimization approach, based mostly on convex optimization, to the search for simple and explicit quantum strong coin-flip** protocols. We present a search algorithm to identify protocols with low bias within a natural class, protocols based on bit-commitment (Nayak and Shor, 2003) restricting to commitment states used by Mochon (2005). An analysis of the resulting protocols via semidefinite programs (SDPs) unveils a simple structure. For example, we show that the SDPs reduce to second-order cone programs. We devise novel cheating strategies in the protocol by restricting the semidefinite programs and use the strategies to prune the search.
The techniques we develop enable a computational search for protocols given by a mesh over the parameter space. The protocols have up to six rounds of communication, with messages of varying dimension and include the best known explicit protocol (with bias 1/4). We conduct two kinds of search: one for protocols with bias below 0.2499, and one for protocols in the neighbourhood of protocols with bias 1/4. Neither of these searches yields better bias. Based on the mathematical ideas behind the search algorithm, we prove a lower bound on the bias of a class of four-round protocols.
△ Less
Submitted 3 March, 2014;
originally announced March 2014.
-
A Comprehensive Analysis of Polyhedral Lift-and-Project Methods
Authors:
Yu Hin Au,
Levent Tunçel
Abstract:
We consider lift-and-project methods for combinatorial optimization problems and focus mostly on those lift-and-project methods which generate polyhedral relaxations of the convex hull of integer solutions. We introduce many new variants of Sherali--Adams and Bienstock--Zuckerberg operators. These new operators fill the spectrum of polyhedral lift-and-project operators in a way which makes all of…
▽ More
We consider lift-and-project methods for combinatorial optimization problems and focus mostly on those lift-and-project methods which generate polyhedral relaxations of the convex hull of integer solutions. We introduce many new variants of Sherali--Adams and Bienstock--Zuckerberg operators. These new operators fill the spectrum of polyhedral lift-and-project operators in a way which makes all of them more transparent, easier to relate to each other, and easier to analyze. We provide new techniques to analyze the worst-case performances as well as relative strengths of these operators in a unified way. In particular, using the new techniques and a result of Mathieu and Sinclair from 2009, we prove that the polyhedral Bienstock--Zuckerberg operator requires at least $\sqrt{2n}- \frac{3}{2}$ iterations to compute the matching polytope of the $(2n+1)$-clique. We further prove that the operator requires approximately $\frac{n}{2}$ iterations to reach the stable set polytope of the $n$-clique, if we start with the fractional stable set polytope. Lastly, we show that some of the worst-case instances for the positive semidefinite Lovász--Schrijver lift-and-project operator are also bad instances for the strongest variants of the Sherali--Adams operator with positive semidefinite strengthenings, and discuss some consequences for integrality gaps of convex relaxations.
△ Less
Submitted 11 January, 2016; v1 submitted 20 December, 2013;
originally announced December 2013.
-
A Utility Theory Based Interactive Approach to Robustness in Linear Optimization
Authors:
Mehdi Karimi,
Somayeh Moazeni,
Levent Tuncel
Abstract:
We treat uncertain linear programming problems by utilizing the notion of weighted analytic centers and notions from the area of multi-criteria decision making. After introducing our approach, we develop interactive cutting-plane algorithms for robust optimization, based on concave and quasi-concave utility functions. In addition to practical advantages, due to the flexibility of our approach, we…
▽ More
We treat uncertain linear programming problems by utilizing the notion of weighted analytic centers and notions from the area of multi-criteria decision making. After introducing our approach, we develop interactive cutting-plane algorithms for robust optimization, based on concave and quasi-concave utility functions. In addition to practical advantages, due to the flexibility of our approach, we are able to prove that under a theoretical framework due to Bertsimas and Sim [14], which establishes the existence of certain convex formulation of robust optimization problems, the robust optimal solutions generated by our algorithms are at least as desirable to the decision maker as any solution generated by many other robust optimization algorithms in the theoretical framework. We present some probabilistic bounds for feasibility of robust solutions and evaluate our approach by means of computational experiments.
△ Less
Submitted 11 January, 2017; v1 submitted 16 December, 2013;
originally announced December 2013.
-
Worst-Case Performance Analysis of Some Approximation Algorithms for Minimizing Makespan and Flow-Time
Authors:
Peruvemba Sundaram Ravi,
Levent Tuncel,
Michael Huang
Abstract:
In 1976, Coffman and Sethi conjectured that a natural extension of LPT list scheduling to the bicriteria scheduling problem of minimizing makespan over flowtime optimal schedules, called LD algorithm, has a simple worst-case performance bound: (5m-2)/(4m-1), where m is the number of machines. We study structure of potential minimal counterexamples to this conjecture and prove that the conjecture h…
▽ More
In 1976, Coffman and Sethi conjectured that a natural extension of LPT list scheduling to the bicriteria scheduling problem of minimizing makespan over flowtime optimal schedules, called LD algorithm, has a simple worst-case performance bound: (5m-2)/(4m-1), where m is the number of machines. We study structure of potential minimal counterexamples to this conjecture and prove that the conjecture holds for the cases (i) n > 5m, (ii) m = 2, (iii) m = 3, and (iv) m greater than or equal to 4, n less than or equal to 3m, where n is the number of jobs. We further conclude that to verify the conjecture, it suffices to analyze the following case: for every m greater than or equal to 4, n is either equal to 4m or 5m.
△ Less
Submitted 11 December, 2013;
originally announced December 2013.
-
Vertices of Spectrahedra arising from the Elliptope, the Theta Body, and Their Relatives
Authors:
Marcel K. de Carli Silva,
Levent Tunçel
Abstract:
Utilizing dual descriptions of the normal cone of convex optimization problems in conic form, we characterize the vertices of semidefinite representations arising from Lovász theta body, generalizations of the elliptope, and related convex sets. Our results generalize vertex characterizations due to Laurent and Poljak from the 1990's. Our approach also leads us to nice characterizations of strict…
▽ More
Utilizing dual descriptions of the normal cone of convex optimization problems in conic form, we characterize the vertices of semidefinite representations arising from Lovász theta body, generalizations of the elliptope, and related convex sets. Our results generalize vertex characterizations due to Laurent and Poljak from the 1990's. Our approach also leads us to nice characterizations of strict complementarity and to connections with some of the related literature.
△ Less
Submitted 27 September, 2013;
originally announced September 2013.
-
A Perturbed Sums of Squares Theorem for Polynomial Optimization and its Applications
Authors:
Masakazu Muramatsu,
Hayato Waki,
Levent Tuncel
Abstract:
We consider a property of positive polynomials on a compact set with a small perturbation. When applied to a Polynomial Optimization Problem (POP), the property implies that the optimal value of the corresponding SemiDefinite Programming (SDP) relaxation with sufficiently large relaxation order is bounded from below by $(f^\ast - ε)$ and from above by $f^\ast + ε(n+1)$, where $f^\ast$ is the optim…
▽ More
We consider a property of positive polynomials on a compact set with a small perturbation. When applied to a Polynomial Optimization Problem (POP), the property implies that the optimal value of the corresponding SemiDefinite Programming (SDP) relaxation with sufficiently large relaxation order is bounded from below by $(f^\ast - ε)$ and from above by $f^\ast + ε(n+1)$, where $f^\ast$ is the optimal value of the POP. We propose new SDP relaxations for POP based on modifications of existing sums-of-squares representation theorems. An advantage of our SDP relaxations is that in many cases they are of considerably smaller dimension than those originally proposed by Lasserre. We present some applications and the results of our computational experiments.
△ Less
Submitted 4 March, 2014; v1 submitted 29 March, 2013;
originally announced April 2013.
-
Sufficient Conditions for Low-rank Matrix Recovery, Translated from Sparse Signal Recovery
Authors:
Lingchen Kong,
Levent Tunçel,
Naihua Xiu
Abstract:
The low-rank matrix recovery (LMR) is a rank minimization problem subject to linear equality constraints, and it arises in many fields such as signal and image processing, statistics, computer vision, system identification and control. This class of optimization problems is $\N¶$-hard and a popular approach replaces the rank function with the nuclear norm of the matrix variable. In this paper, we…
▽ More
The low-rank matrix recovery (LMR) is a rank minimization problem subject to linear equality constraints, and it arises in many fields such as signal and image processing, statistics, computer vision, system identification and control. This class of optimization problems is $\N¶$-hard and a popular approach replaces the rank function with the nuclear norm of the matrix variable. In this paper, we extend the concept of $s$-goodness for a sensing matrix in sparse signal recovery (proposed by Juditsky and Nemirovski [Math Program, 2011]) to linear transformations in LMR. Then, we give characterizations of $s$-goodness in the context of LMR. Using the two characteristic $s$-goodness constants, $γ_s$ and $\hatγ_s$, of a linear transformation, not only do we derive necessary and sufficient conditions for a linear transformation to be $s$-good, but also provide sufficient conditions for exact and stable $s$-rank matrix recovery via the nuclear norm minimization under mild assumptions. Moreover, we give computable upper bounds for one of the $s$-goodness characteristics which leads to verifiable sufficient conditions for exact low-rank matrix recovery.
△ Less
Submitted 16 June, 2011;
originally announced June 2011.
-
Optimization Problems over Unit-Distance Representations of Graphs
Authors:
Marcel K. de Carli Silva,
Levent Tunçel
Abstract:
We study the relationship between unit-distance representations and Lovasz theta number of graphs, originally established by Lovasz. We derive and prove min-max theorems. This framework allows us to derive a weighted version of the hypersphere number of a graph and a related min-max theorem. Then, we connect to sandwich theorems via graph homomorphisms. We present and study a generalization of the…
▽ More
We study the relationship between unit-distance representations and Lovasz theta number of graphs, originally established by Lovasz. We derive and prove min-max theorems. This framework allows us to derive a weighted version of the hypersphere number of a graph and a related min-max theorem. Then, we connect to sandwich theorems via graph homomorphisms. We present and study a generalization of the hypersphere number of a graph and the related optimization problems. The generalized problem involves finding the smallest ellipsoid of a given shape which contains a unit-distance representation of the graph. We prove that arbitrary positive semidefinite forms describing the ellipsoids yield NP-hard problems.
△ Less
Submitted 25 August, 2012; v1 submitted 28 October, 2010;
originally announced October 2010.
-
Homogeneous Cone Complementarity Problems and $P$ Properties
Authors:
Lingchen Kong,
Levent Tunçel,
Naihua Xiu
Abstract:
We consider existence and uniqueness properties of a solution to homogeneous cone complementarity problem (HCCP). Employing the $T$-algebraic characterization of homogeneous cones, we generalize the $P, P_0, R_0$ properties for a nonlinear function associated with the standard nonlinear complementarity problem to the setting of HCCP. We prove that if a continuous function has either the order-…
▽ More
We consider existence and uniqueness properties of a solution to homogeneous cone complementarity problem (HCCP). Employing the $T$-algebraic characterization of homogeneous cones, we generalize the $P, P_0, R_0$ properties for a nonlinear function associated with the standard nonlinear complementarity problem to the setting of HCCP. We prove that if a continuous function has either the order-$P_0$ and $R_0$, or the $P_0$ and $R_0$ properties then all the associated HCCPs have solutions. In particular, if a continuous function has the trace-$P$ property then the associated HCCP has a unique solution (if any); if it has the uniform-trace-$P$ property then the associated HCCP has the global uniqueness (of the solution) property (GUS). We present a necessary condition for a nonlinear transformation to have the GUS property. Moreover, we establish a global error bound for the HCCP with the uniform-trace-$P$ property. Finally, we study the HCCP with the relaxation transformation on a $T$-algebra and automorphism invariant properties for homogeneous cone linear complementarity problem.
△ Less
Submitted 11 November, 2010; v1 submitted 11 April, 2009;
originally announced April 2009.
-
When Does the Positive Semidefiniteness Constraint Help In Lifting Procedures
Authors:
Levent Tuncel,
Michel X. Goemans
Abstract:
We study the lift-and-project procedures of Lovász and Schrijver for 0-1 integer programming problems. We prove that the procedure using the positive semidefiniteness constraint is not better than the one without it, in the worst case. Various examples are considered. We also provide geometric conditions characterizing when the positive semidefiniteness constraint does not help.
We study the lift-and-project procedures of Lovász and Schrijver for 0-1 integer programming problems. We prove that the procedure using the positive semidefiniteness constraint is not better than the one without it, in the worst case. Various examples are considered. We also provide geometric conditions characterizing when the positive semidefiniteness constraint does not help.
△ Less
Submitted 5 June, 2000;
originally announced June 2000.
-
Some Fundamental Properties of Successive Convex Relaxation Methods on LCP and Related Problems
Authors:
Levent Tuncel,
Masakazu Kojima
Abstract:
General Successive Convex Relaxation Methods (SRCMs) can be used to compute the convex hull of any compact set, in an Euclidean space, described by a system of quadratic inequalities and a compact convex set which is not very complicated. Linear Complementarity Problems (LCPs) make an interesting and rich class of structured nonconvex optimization problems. In this paper, we study a few of the s…
▽ More
General Successive Convex Relaxation Methods (SRCMs) can be used to compute the convex hull of any compact set, in an Euclidean space, described by a system of quadratic inequalities and a compact convex set which is not very complicated. Linear Complementarity Problems (LCPs) make an interesting and rich class of structured nonconvex optimization problems. In this paper, we study a few of the specialized lift-and-project methods and some of the possible ways of applying the general SCRMs to LCPs and related problems.
△ Less
Submitted 23 May, 2000;
originally announced May 2000.
-
Some fundamental properties of successive convex relaxation methods on LCP and related problems
Authors:
Masakazu Kojima,
Levent Tuncel
Abstract:
General Successive Convex Relaxation Methods (SRCMs) can be used to compute the convex hull of any compact set, in an Euclidean space, described by a system of quadratic inequalities and a compact convex set which is not very complicated. Linear Complementarity Problems (LCPs) make an interesting and rich class of structured nonconvex optimization problems. In this paper, we study a few of the s…
▽ More
General Successive Convex Relaxation Methods (SRCMs) can be used to compute the convex hull of any compact set, in an Euclidean space, described by a system of quadratic inequalities and a compact convex set which is not very complicated. Linear Complementarity Problems (LCPs) make an interesting and rich class of structured nonconvex optimization problems. In this paper, we study a few of the specialized lift-and-project methods and some of the possible ways of applying the general SCRMs to LCPs and related problems.
△ Less
Submitted 30 April, 1999;
originally announced May 1999.
