-
Piecewise SOS-Convex Moment Optimization and Applications via Exact Semi-Definite Programs
Authors:
Queenie Yingkun Huang,
Vaithilingam Jeyakumar,
Guoyin Li
Abstract:
This paper presents exact Semi-Definite Program (SDP) reformulations for infinite-dimensional moment optimization problems involving a new class of piecewise Sum-of-Squares (SOS)-convex functions and projected spectrahedral support sets. These reformulations show that solving a single SDP finds the optimal value and an optimal probability measure of the original moment problem. This is done by est…
▽ More
This paper presents exact Semi-Definite Program (SDP) reformulations for infinite-dimensional moment optimization problems involving a new class of piecewise Sum-of-Squares (SOS)-convex functions and projected spectrahedral support sets. These reformulations show that solving a single SDP finds the optimal value and an optimal probability measure of the original moment problem. This is done by establishing an SOS representation for the non-negativity of a piecewise SOS-convex function over a projected spectrahedron. Finally, as an application and a proof-of-concept illustration, the paper presents numerical results for the Newsvendor and revenue maximization problems with higher-order moments by solving their equivalent SDP reformulations. These reformulations promise a flexible and efficient approach to solving these models. The main novelty of the present work in relation to the recent research lies in finding the solution to moment problems, for the first time, with piecewise SOS-convex functions from their numerically tractable exact SDP reformulations.
△ Less
Submitted 2 July, 2024; v1 submitted 10 February, 2024;
originally announced February 2024.
-
On the amplification of security and privacy risks by post-hoc explanations in machine learning models
Authors:
Pengrui Quan,
Supriyo Chakraborty,
Jeya Vikranth Jeyakumar,
Mani Srivastava
Abstract:
A variety of explanation methods have been proposed in recent years to help users gain insights into the results returned by neural networks, which are otherwise complex and opaque black-boxes. However, explanations give rise to potential side-channels that can be leveraged by an adversary for mounting attacks on the system. In particular, post-hoc explanation methods that highlight input dimensio…
▽ More
A variety of explanation methods have been proposed in recent years to help users gain insights into the results returned by neural networks, which are otherwise complex and opaque black-boxes. However, explanations give rise to potential side-channels that can be leveraged by an adversary for mounting attacks on the system. In particular, post-hoc explanation methods that highlight input dimensions according to their importance or relevance to the result also leak information that weakens security and privacy. In this work, we perform the first systematic characterization of the privacy and security risks arising from various popular explanation techniques. First, we propose novel explanation-guided black-box evasion attacks that lead to 10 times reduction in query count for the same success rate. We show that the adversarial advantage from explanations can be quantified as a reduction in the total variance of the estimated gradient. Second, we revisit the membership information leaked by common explanations. Contrary to observations in prior studies, via our modified attacks we show significant leakage of membership information (above 100% improvement over prior results), even in a much stricter black-box setting. Finally, we study explanation-guided model extraction attacks and demonstrate adversarial gains through a large reduction in query count.
△ Less
Submitted 28 June, 2022;
originally announced June 2022.
-
Automatic Concept Extraction for Concept Bottleneck-based Video Classification
Authors:
Jeya Vikranth Jeyakumar,
Luke Dickens,
Luis Garcia,
Yu-Hsi Cheng,
Diego Ramirez Echavarria,
Joseph Noor,
Alessandra Russo,
Lance Kaplan,
Erik Blasch,
Mani Srivastava
Abstract:
Recent efforts in interpretable deep learning models have shown that concept-based explanation methods achieve competitive accuracy with standard end-to-end models and enable reasoning and intervention about extracted high-level visual concepts from images, e.g., identifying the wing color and beak length for bird-species classification. However, these concept bottleneck models rely on a necessary…
▽ More
Recent efforts in interpretable deep learning models have shown that concept-based explanation methods achieve competitive accuracy with standard end-to-end models and enable reasoning and intervention about extracted high-level visual concepts from images, e.g., identifying the wing color and beak length for bird-species classification. However, these concept bottleneck models rely on a necessary and sufficient set of predefined concepts-which is intractable for complex tasks such as video classification. For complex tasks, the labels and the relationship between visual elements span many frames, e.g., identifying a bird flying or catching prey-necessitating concepts with various levels of abstraction. To this end, we present CoDEx, an automatic Concept Discovery and Extraction module that rigorously composes a necessary and sufficient set of concept abstractions for concept-based video classification. CoDEx identifies a rich set of complex concept abstractions from natural language explanations of videos-obviating the need to predefine the amorphous set of concepts. To demonstrate our method's viability, we construct two new public datasets that combine existing complex video classification datasets with short, crowd-sourced natural language explanations for their labels. Our method elicits inherent complex concept abstractions in natural language to generalize concept-bottleneck methods to complex tasks.
△ Less
Submitted 21 June, 2022;
originally announced June 2022.
-
Combining Individual and Joint Networking Behavior for Intelligent IoT Analytics
Authors:
Jeya Vikranth Jeyakumar,
Ludmila Cherkasova,
Saina Lajevardi,
Moray Allan,
Yue Zhao,
John Fry,
Mani Srivastava
Abstract:
The IoT vision of a trillion connected devices over the next decade requires reliable end-to-end connectivity and automated device management platforms. While we have seen successful efforts for maintaining small IoT testbeds, there are multiple challenges for the efficient management of large-scale device deployments. With Industrial IoT, incorporating millions of devices, traditional management…
▽ More
The IoT vision of a trillion connected devices over the next decade requires reliable end-to-end connectivity and automated device management platforms. While we have seen successful efforts for maintaining small IoT testbeds, there are multiple challenges for the efficient management of large-scale device deployments. With Industrial IoT, incorporating millions of devices, traditional management methods do not scale well. In this work, we address these challenges by designing a set of novel machine learning techniques, which form a foundation of a new tool, it IoTelligent, for IoT device management, using traffic characteristics obtained at the network level. The design of our tool is driven by the analysis of 1-year long networking data, collected from 350 companies with IoT deployments. The exploratory analysis of this data reveals that IoT environments follow the famous Pareto principle, such as: (i) 10% of the companies in the dataset contribute to 90% of the entire traffic; (ii) 7% of all the companies in the set own 90% of all the devices. We designed and evaluated CNN, LSTM, and Convolutional LSTM models for demand forecasting, with a conclusion of the Convolutional LSTM model being the best. However, maintaining and updating individual company models is expensive. In this work, we design a novel, scalable approach, where a general demand forecasting model is built using the combined data of all the companies with a normalization factor. Moreover, we introduce a novel technique for device management, based on autoencoders. They automatically extract relevant device features to identify device groups with similar behavior to flag anomalous devices.
△ Less
Submitted 6 March, 2022;
originally announced March 2022.
-
Calculating Radius of Robust Feasibility of Uncertain Linear Conic Programs via Semidefinite Programs
Authors:
Miguel A. Goberna,
Vaithilingam Jeyakumar,
Guoyin Li
Abstract:
The radius of robust feasibility provides a numerical value for the largest possible uncertainty set that guarantees robust feasibility of an uncertain linear conic program. This determines when the robust feasible set is non-empty. Otherwise the robust counterpart of an uncertain program is not well-defined as a robust optimization problem. In this paper, we address a key fundamental question of…
▽ More
The radius of robust feasibility provides a numerical value for the largest possible uncertainty set that guarantees robust feasibility of an uncertain linear conic program. This determines when the robust feasible set is non-empty. Otherwise the robust counterpart of an uncertain program is not well-defined as a robust optimization problem. In this paper, we address a key fundamental question of robust optimization: How to compute the radius of robust feasibility of uncertain linear conic programs, including linear programs? We first provide computable lower and upper bounds for the radius of robust feasibility for general uncertain linear conic programs under the commonly used ball uncertainty set. We then provide important classes of linear conic programs where the bounds are calculated by finding the optimal values of related semidefinite linear programs (SDPs), among them uncertain SDPs, uncertain second-order cone programs and uncertain support vector machine problems. In the case of an uncertain linear program, the exact formula allows us to calculate the radius by finding the optimal value of an associated second-order cone program.
△ Less
Submitted 15 July, 2020;
originally announced July 2020.
-
Exact Conic Programming Reformulations of Two-Stage Adjustable Robust Linear Programs with New Quadratic Decision Rules
Authors:
D. Woolnough,
V. Jeyakumar,
G. Li
Abstract:
In this paper we introduce a new parameterized Quadratic Decision Rule (QDR), a generalisation of the commonly employed Affine Decision Rule (ADR), for two-stage linear adjustable robust optimization problems with ellipsoidal uncertainty and show that (affinely parameterized) linear adjustable robust optimization problems with QDRs are numerically tractable by presenting exact semi-definite progra…
▽ More
In this paper we introduce a new parameterized Quadratic Decision Rule (QDR), a generalisation of the commonly employed Affine Decision Rule (ADR), for two-stage linear adjustable robust optimization problems with ellipsoidal uncertainty and show that (affinely parameterized) linear adjustable robust optimization problems with QDRs are numerically tractable by presenting exact semi-definite program (SDP) and second order cone program (SOCP) reformulations. Under these QDRs, we also establish that exact conic program reformulations also hold for two-stage linear ARO problems, containing also adjustable variables in their objective functions. We then show via numerical experiments on lot-sizing problems with uncertain demand that adjustable robust linear optimization problems with QDRs improve upon the ADRs in their performance both in the worst-case sense and after simulated realization of the uncertain demand relative to the true solution.
△ Less
Submitted 22 March, 2020; v1 submitted 12 February, 2020;
originally announced February 2020.
-
ExplainIt! -- A declarative root-cause analysis engine for time series data (extended version)
Authors:
Vimalkumar Jeyakumar,
Omid Madani,
Ali Parandeh,
Ashutosh Kulshreshtha,
Weifei Zeng,
Navindra Yadav
Abstract:
We present ExplainIt!, a declarative, unsupervised root-cause analysis engine that uses time series monitoring data from large complex systems such as data centres. ExplainIt! empowers operators to succinctly specify a large number of causal hypotheses to search for causes of interesting events. ExplainIt! then ranks these hypotheses, reducing the number of causal dependencies from hundreds of tho…
▽ More
We present ExplainIt!, a declarative, unsupervised root-cause analysis engine that uses time series monitoring data from large complex systems such as data centres. ExplainIt! empowers operators to succinctly specify a large number of causal hypotheses to search for causes of interesting events. ExplainIt! then ranks these hypotheses, reducing the number of causal dependencies from hundreds of thousands to a handful for human understanding. We show how a declarative language, such as SQL, can be effective in declaratively enumerating hypotheses that probe the structure of an unknown probabilistic graphical causal model of the underlying system. Our thesis is that databases are in a unique position to enable users to rapidly explore the possible causal mechanisms in data collected from diverse sources. We empirically demonstrate how ExplainIt! had helped us resolve over 30 performance issues in a commercial product since late 2014, of which we discuss a few cases in detail.
△ Less
Submitted 22 March, 2019; v1 submitted 19 March, 2019;
originally announced March 2019.
-
A Bounded Degree Lasserre Hierarchy with SOCP Relaxations for Global Polynomial Optimization and Applications
Authors:
T. D Chuong,
V. Jeyakumar,
G. Li
Abstract:
In this paper, we propose a new convergent conic programming hierarchy of relaxations involving both semi-definite cone and second-order cone constraints for solving nonconvex polynomial optimization problems to global optimality. The significance of this hierarchy is that the size and number of the semi-definite and second-order cone constraints of the relaxations are fixed and independent of the…
▽ More
In this paper, we propose a new convergent conic programming hierarchy of relaxations involving both semi-definite cone and second-order cone constraints for solving nonconvex polynomial optimization problems to global optimality. The significance of this hierarchy is that the size and number of the semi-definite and second-order cone constraints of the relaxations are fixed and independent of the step or level of the approximation in the hierarchy. Using the Krivine-Stengle's certificate of positivity in real algebraic geometry, we establish the convergence of the hierarchy of relaxations, extending the very recent so-called bounded degree Lasserre hierarchy. In particular, we also provide a convergent bounded degree second-order cone programming (SOCP) hierarchy for solving polynomial optimization problems. We then present finite convergence at step one of the SOCP hierarchy for two classes of polynomial optimization problems: a subclass of convex polynomial optimization problems where the objective and constraint functions are SOCP-convex polynomials, defined in terms of specially structured sum of squares polynomials, and a class of polynomial optimization problems, involving polynomials with essentially non-positive coefficients. In the case of one-step convergence for problems with SOCP-convex polynomials, we show how a global solution is recovered from the relaxation via Jensen's inequality of SOCP-convex polynomials. As an application, we derive a corresponding convergent conic linear programming hierarchy for conic-convex semi-algebraic programs. Whenever the semi-algebraic set of the conic-convex program is described by convex polynomial inequalities, we show further that the values of the relaxation problems converge to the common value of the convex program and its Lagrangian dual under a constraint qualification.
△ Less
Submitted 17 September, 2018; v1 submitted 18 October, 2017;
originally announced October 2017.
-
Convexifiability of Continuous and Discrete Nonnegative Quadratic Programs for Gap-Free Duality
Authors:
N. H. Chieu,
V. Jeyakumar,
G. Li
Abstract:
In this paper we show that a convexifiability property of nonconvex quadratic programs with nonnegative variables and quadratic constraints guarantees zero duality gap between the quadratic programs and their semi-Lagrangian duals. More importantly, we establish that this convexifiability is hidden in classes of nonnegative homogeneous quadratic programs and discrete quadratic programs, such as mi…
▽ More
In this paper we show that a convexifiability property of nonconvex quadratic programs with nonnegative variables and quadratic constraints guarantees zero duality gap between the quadratic programs and their semi-Lagrangian duals. More importantly, we establish that this convexifiability is hidden in classes of nonnegative homogeneous quadratic programs and discrete quadratic programs, such as mixed integer quadratic programs, revealing zero duality gaps. As an application, we prove that robust counterparts of uncertain mixed integer quadratic programs with objective data uncertainty enjoy zero duality gaps under suitable conditions. Various sufficient conditions for convexifiability are also given.
△ Less
Submitted 28 November, 2018; v1 submitted 29 July, 2017;
originally announced July 2017.
-
Extended Trust-Region Problems with One or Two Balls: Exact Copositive and Lagrangian Relaxations
Authors:
I. M. Bomze,
V. Jeyakumar,
G. Li
Abstract:
We establish a geometric condition guaranteeing exact copositive relaxation for the nonconvex quadratic optimization problem under two quadratic and several linear constraints, and present sufficient conditions for global optimality in terms of generalized Karush-Kuhn-Tucker multipliers. The copositive relaxation is tighter than the usual Lagrangian relaxation. We illustrate this by providing a wh…
▽ More
We establish a geometric condition guaranteeing exact copositive relaxation for the nonconvex quadratic optimization problem under two quadratic and several linear constraints, and present sufficient conditions for global optimality in terms of generalized Karush-Kuhn-Tucker multipliers. The copositive relaxation is tighter than the usual Lagrangian relaxation. We illustrate this by providing a whole class of quadratic optimization problems that enjoys exactness of copositive relaxation while the usual Lagrangian duality gap is infinite. Finally, we also provide verifiable conditions under which both the usual Lagrangian relaxation and the copositive relaxation are exact for an extended CDT (two-ball trust-region) problem. Importantly, the sufficient conditions can be verified by solving linear optimization problems.
△ Less
Submitted 2 October, 2017; v1 submitted 26 February, 2017;
originally announced February 2017.
-
Robust Global Solutions of Bilevel Polynomial Optimization Problems with Uncertain Linear Constraints
Authors:
T. D. Chuong,
V. Jeyakumar
Abstract:
This paper studies, for the first time, a bilevel polynomial program whose constraints involve uncertain linear constraints and another uncertain linear optimization problem. In the case of box data uncertainty, we present a sum of squares polynomial characterization of a global solution of its robust counterpart where the constraints are enforced for all realizations of the uncertainties within t…
▽ More
This paper studies, for the first time, a bilevel polynomial program whose constraints involve uncertain linear constraints and another uncertain linear optimization problem. In the case of box data uncertainty, we present a sum of squares polynomial characterization of a global solution of its robust counterpart where the constraints are enforced for all realizations of the uncertainties within the prescribed uncertainty sets. By characterizing a solution of the robust counterpart of the lower-level uncertain linear program under spectrahedral uncertainty using a new generalization of Farkas' lemma, we reformulate the robust bilevel program as a single level non-convex polynomial optimization problem. We then characterize a global solution of the single level polynomial program by employing Putinar's Positivstellensatz of algebraic geometry under coercivity of the polynomial objective function. Consequently, we show that the robust global optimal value of the bilevel program is the limit of a sequence of values of Lasserre-type hierarchy of semidefinite linear programming relaxations. Numerical examples are given to show how the robust optimal value of the bilevel program can be calculated by solving semidefinite programming problems using the Matlab toolbox YALMIP.
△ Less
Submitted 24 January, 2016;
originally announced January 2016.
-
Convergent Semidefinite Programming Relaxations for Global Bilevel Polynomial Optimization Problems
Authors:
V. Jeyakumar,
J. B. Lasserre,
G. Li,
T. S. Pham
Abstract:
In this paper, we consider a bilevel polynomial optimization problem where the objective and the constraint functions of both the upper and the lower level problems are polynomials. We present methods for finding its global minimizers and global minimum using a sequence of semidefinite programming (SDP) relaxations and provide convergence results for the methods. Our scheme for problems with a con…
▽ More
In this paper, we consider a bilevel polynomial optimization problem where the objective and the constraint functions of both the upper and the lower level problems are polynomials. We present methods for finding its global minimizers and global minimum using a sequence of semidefinite programming (SDP) relaxations and provide convergence results for the methods. Our scheme for problems with a convex lower-level problem involves solving a transformed equivalent single-level problem by a sequence of SDP relaxations; whereas our approach for general problems involving a non-convex polynomial lower-level problem solves a sequence of approximation problems via another sequence of SDP relaxations.
△ Less
Submitted 13 January, 2016; v1 submitted 5 June, 2015;
originally announced June 2015.
-
Millions of Little Minions: Using Packets for Low Latency Network Programming and Visibility (Extended Version)
Authors:
Vimalkumar Jeyakumar,
Mohammad Alizadeh,
Yilong Geng,
Changhoon Kim,
David Mazières
Abstract:
This paper presents a practical approach to rapidly introduce new dataplane functionality into networks: End-hosts embed tiny programs into packets to actively query and manipulate a network's internal state. We show how this "tiny packet program" (TPP) interface gives end-hosts unprecedented visibility into network behavior, enabling them to work with the network to achieve a common goal. Our des…
▽ More
This paper presents a practical approach to rapidly introduce new dataplane functionality into networks: End-hosts embed tiny programs into packets to actively query and manipulate a network's internal state. We show how this "tiny packet program" (TPP) interface gives end-hosts unprecedented visibility into network behavior, enabling them to work with the network to achieve a common goal. Our design leverages what each component does best: (a) switches forward and execute tiny packet programs (at most 5 instructions) at line rate, and (b) end-hosts perform arbitrary computation on network state, which are easy to evolve. Using a hardware prototype on a NetFPGA, we show our design is feasible, at a reasonable cost. By implementing three different research proposals, we show that TPPs are also useful. And finally, we present an architecture in which they can be made secure.
△ Less
Submitted 6 June, 2014; v1 submitted 28 May, 2014;
originally announced May 2014.
-
Flexible Network Bandwidth and Latency Provisioning in the Datacenter
Authors:
Vimalkumar Jeyakumar,
Abdul Kabbani,
Jeffrey C. Mogul,
Amin Vahdat
Abstract:
Predictably sharing the network is critical to achieving high utilization in the datacenter. Past work has focussed on providing bandwidth to endpoints, but often we want to allocate resources among multi-node services. In this paper, we present Parley, which provides service-centric minimum bandwidth guarantees, which can be composed hierarchically. Parley also supports service-centric weighted s…
▽ More
Predictably sharing the network is critical to achieving high utilization in the datacenter. Past work has focussed on providing bandwidth to endpoints, but often we want to allocate resources among multi-node services. In this paper, we present Parley, which provides service-centric minimum bandwidth guarantees, which can be composed hierarchically. Parley also supports service-centric weighted sharing of bandwidth in excess of these guarantees. Further, we show how to configure these policies so services can get low latencies even at high network load. We evaluate Parley on a multi-tiered oversubscribed network connecting 90 machines, each with a 10Gb/s network interface, and demonstrate that Parley is able to meet its goals.
△ Less
Submitted 5 May, 2014; v1 submitted 3 May, 2014;
originally announced May 2014.
-
Robust Solutions to Multi-Objective Linear Programs with Uncertain Data
Authors:
M. A. Goberna,
V. Jeyakumar,
G. Li,
J. Vicente-Pérez
Abstract:
In this paper we examine multi-objective linear programming problems in the face of data uncertainty both in the objective function and the constraints. First, we derive a formula for radius of robust feasibility guaranteeing constraint feasibility for all possible uncertainties within a specified uncertainty set under affine data parametrization. We then present a complete characterization of rob…
▽ More
In this paper we examine multi-objective linear programming problems in the face of data uncertainty both in the objective function and the constraints. First, we derive a formula for radius of robust feasibility guaranteeing constraint feasibility for all possible uncertainties within a specified uncertainty set under affine data parametrization. We then present a complete characterization of robust weakly effcient solutions that are immunized against rank one objective matrix data uncertainty. We also provide classes of commonly used constraint data uncertainty sets under which a robust feasible solution of an uncertain multi-objective linear program can be numerically checked whether or not it is a robust weakly efficient solution.
△ Less
Submitted 13 February, 2014;
originally announced February 2014.
-
Trust--Region Problems with Linear Inequality Constraints: Exact SDP Relaxation, Global Optimality and Robust Optimization
Authors:
V. Jeyakumar,
G. Li
Abstract:
The trust-region problem, which minimizes a nonconvex quadratic function over a ball, is a key subproblem in trust-region methods for solving nonlinear optimization problems. It enjoys many attractive properties such as an exact semi-definite linear programming relaxation (SDP relaxation) and strong duality. Unfortunately, such properties do not, in general, hold for an extended trust-region probl…
▽ More
The trust-region problem, which minimizes a nonconvex quadratic function over a ball, is a key subproblem in trust-region methods for solving nonlinear optimization problems. It enjoys many attractive properties such as an exact semi-definite linear programming relaxation (SDP relaxation) and strong duality. Unfortunately, such properties do not, in general, hold for an extended trust-region problem having extra linear constraints. This paper shows that two useful and powerful features of the classical trust-region problem continue to hold for an extended trust-region problem with linear inequality constraints under a new dimension condition. First, we establish that the class of extended trust-region problems has an exact SDP-relaxation, which holds without the Slater constraint qualification. This is achieved by proving that a system of quadratic and affine functions involved in the model satisfies a range-convexity whenever the dimension condition is fulfilled. Second, we show that the dimension condition together with the Slater condition ensures that a set of combined first and second-order Lagrange multiplier conditions is necessary and sufficient for global optimality of the extended trust-region problem and consequently for strong duality. Finally, we show that the dimension condition is easily satisfied for the extended trust-region model that arises from the reformulation of a robust least squares problem (LSP) as well as a robust second order cone programming model problem (SOCP) as an equivalent semi-definite linear programming problem. This leads us to conclude that, under mild assumptions, solving a robust (LSP) or (SOCP) under matrix-norm uncertainty or polyhedral uncertainty is equivalent to solving a SDP and so, their solutions can be validated in polynomial time.
△ Less
Submitted 11 September, 2013;
originally announced September 2013.
-
Robust SOS-Convex Polynomial Programs: Exact SDP Relaxations
Authors:
V. Jeyakumar,
G. Li,
J. Vicente-Perez
Abstract:
This paper studies robust solutions and semidefinite linear programming (SDP) relaxations of a class of convex polynomial programs in the face of data uncertainty. The class of convex programs, called robust SOS-convex programs, includes robust quadratically constrained convex programs and robust separable convex polynomial programs. It establishes sums of squares polynomial representations charac…
▽ More
This paper studies robust solutions and semidefinite linear programming (SDP) relaxations of a class of convex polynomial programs in the face of data uncertainty. The class of convex programs, called robust SOS-convex programs, includes robust quadratically constrained convex programs and robust separable convex polynomial programs. It establishes sums of squares polynomial representations characterizing robust solutions and exact SDP-relaxations of robust SOS-convex programs under various commonly used uncertainty sets. In particular, the results show that the polytopic and ellipsoidal uncertainty sets, that allow second-order cone re-formulations of robust quadratically constrained programs, continue to permit exact SDP-relaxations for a broad class of robust SOS-convex programs. They also yield exact second-order cone relaxation for robust quadratically constrained programs.
△ Less
Submitted 7 October, 2013; v1 submitted 20 July, 2013;
originally announced July 2013.
-
SDP Duals without Duality Gaps for a Class of Convex Minimax Programs
Authors:
V. Jeyakumar,
J. Vicente-Perez
Abstract:
In this paper we introduce a new dual program, which is representable as a semi-definite linear programming problem, for a primal convex minimax programming model problem and show that there is no duality gap between the primal and the dual whenever the functions involved are SOS-convex polynomials. Under a suitable constraint qualification, we derive strong duality results for this class of minim…
▽ More
In this paper we introduce a new dual program, which is representable as a semi-definite linear programming problem, for a primal convex minimax programming model problem and show that there is no duality gap between the primal and the dual whenever the functions involved are SOS-convex polynomials. Under a suitable constraint qualification, we derive strong duality results for this class of minimax problems. Consequently, we present applications of our results to robust SOS-convex programming problems under data uncertainty and to minimax fractional programming problems with SOS-convex polynomials. We obtain these results by first establishing sum of squares polynomial representations of non-negativity of a convex max function over a system of SOS-convex constraints. The new class of SOS-convex polynomials is an important subclass of convex polynomials and it includes convex quadratic functions and separable convex polynomials. The SOS-convexity of polynomials can numerically be checked by solving semi-definite programming problems whereas numerically verifying convexity of polynomials is generally very hard.
△ Less
Submitted 19 July, 2013;
originally announced July 2013.
-
Convergence of the Lasserre Hierarchy of SDP Relaxations for Convex Polynomial Programs without Compactness
Authors:
V. Jeyakumar,
T. S. Pham,
G. Li
Abstract:
The Lasserre hierarchy of semidefinite programming (SDP) relaxations is an effective scheme for finding computationally feasible SDP approximations of polynomial optimization over compact semi-algebraic sets. In this paper, we show that, for convex polynomial optimization, the Lasserre hierarchy with a slightly extended quadratic module always converges asymptotically even in the face of non-compa…
▽ More
The Lasserre hierarchy of semidefinite programming (SDP) relaxations is an effective scheme for finding computationally feasible SDP approximations of polynomial optimization over compact semi-algebraic sets. In this paper, we show that, for convex polynomial optimization, the Lasserre hierarchy with a slightly extended quadratic module always converges asymptotically even in the face of non-compact semi-algebraic feasible sets. We do this by exploiting a coercivity property of convex polynomials that are bounded below. We further establish that the positive definiteness of the Hessian of the associated Lagrangian at a saddle-point (rather than the objective function at each minimizer) guarantees finite convergence of the hierarchy. We obtain finite convergence by first establishing a new sum-of-squares polynomial representation of convex polynomials over convex semi-algebraic sets under a saddle-point condition. We finally prove that the existence of a saddle-point of the Lagrangian for a convex polynomial program is also necessary for the hierarchy to have finite convergence.
△ Less
Submitted 27 June, 2013;
originally announced June 2013.
-
On Polynomial Optimization over Non-compact Semi-algebraic Sets
Authors:
Vaithilingam Jeyakumar,
Jean-Bernard Lasserre,
G. Li
Abstract:
We consider the class of polynomial optimization problems $\inf \{f(x):x\in K\}$ for which the quadratic module generated by the polynomials that define $K$ and the polynomial $c-f$ (for some scalar $c$) is Archimedean. For such problems, the optimal value can be approximated as closely as desired by solving a hierarchy of semidefinite programs and the convergence is finite generically. Moreover,…
▽ More
We consider the class of polynomial optimization problems $\inf \{f(x):x\in K\}$ for which the quadratic module generated by the polynomials that define $K$ and the polynomial $c-f$ (for some scalar $c$) is Archimedean. For such problems, the optimal value can be approximated as closely as desired by solving a hierarchy of semidefinite programs and the convergence is finite generically. Moreover, the Archimedean condition (as well as a sufficient coercivity condition) can also be checked numerically by solving a similar hierarchy of semidefinite programs. In other words, under reasonable assumptions the now standard hierarchy of SDP-relaxations extends to the non-compact case via a suitable modification.
△ Less
Submitted 4 July, 2013; v1 submitted 16 April, 2013;
originally announced April 2013.
