Skip to main content

Showing 1–19 of 19 results for author: Huchette, J

.
  1. arXiv:2312.02016  [pdf, other

    math.OC

    Combinatorial Disjunctive Constraints for Obstacle Avoidance in Path Planning

    Authors: Raul Garcia, Illya V. Hicks, Joey Huchette

    Abstract: We present a new approach for modeling avoidance constraints in 2D environments, in which waypoints are assigned to obstacle-free polyhedral regions. Constraints of this form are often formulated as mixed-integer programming (MIP) problems employing big-M techniques -- however, these are generally not the strongest formulations possible with respect to the MIP's convex relaxation (so called ideal… ▽ More

    Submitted 4 December, 2023; originally announced December 2023.

  2. arXiv:2305.00241  [pdf, other

    math.OC cs.LG

    When Deep Learning Meets Polyhedral Theory: A Survey

    Authors: Joey Huchette, Gonzalo Muñoz, Thiago Serra, Calvin Tsay

    Abstract: In the past decade, deep learning became the prevalent methodology for predictive modeling thanks to the remarkable accuracy of deep neural networks in tasks such as computer vision and natural language processing. Meanwhile, the structure of neural networks converged back to simpler representations based on piecewise constant and piecewise linear functions such as the Rectified Linear Unit (ReLU)… ▽ More

    Submitted 31 August, 2023; v1 submitted 29 April, 2023; originally announced May 2023.

  3. arXiv:2304.14542  [pdf, other

    math.OC

    Building Formulations for Piecewise Linear Relaxations of Nonlinear Functions

    Authors: Bochuan Lyu, Illya V. Hicks, Joey Huchette

    Abstract: We study mixed-integer programming formulations for the piecewise linear lower and upper bounds (in other words, piecewise linear relaxations) of nonlinear functions that can be modeled by a new class of combinatorial disjunctive constraints (CDCs), generalized $n$D-ordered CDCs. We first introduce a general formulation technique to model piecewise linear lower and upper bounds of univariate nonli… ▽ More

    Submitted 27 April, 2023; originally announced April 2023.

  4. arXiv:2211.14706  [pdf, other

    cs.LG math.OC

    Neural Network Verification as Piecewise Linear Optimization: Formulations for the Composition of Staircase Functions

    Authors: Tu Anh-Nguyen, Joey Huchette

    Abstract: We present a technique for neural network verification using mixed-integer programming (MIP) formulations. We derive a \emph{strong formulation} for each neuron in a network using piecewise linear activation functions. Additionally, as in general, these formulations may require an exponential number of inequalities, we also derive a separation procedure that runs in super-linear time in the input… ▽ More

    Submitted 26 November, 2022; originally announced November 2022.

  5. arXiv:2206.03866  [pdf, ps, other

    cs.PL

    JuMP 1.0: Recent improvements to a modeling language for mathematical optimization

    Authors: Miles Lubin, Oscar Dowson, Joaquim Dias Garcia, Joey Huchette, Benoît Legat, Juan Pablo Vielma

    Abstract: JuMP is an algebraic modeling language embedded in the Julia programming language. JuMP allows users to model optimization problems of a variety of kinds, including linear programming, integer programming, conic optimization, semidefinite programming, and nonlinear programming, and handles the low-level details of communicating with solvers. After nearly 10 years in development, JuMP 1.0 was relea… ▽ More

    Submitted 19 March, 2023; v1 submitted 31 May, 2022; originally announced June 2022.

  6. arXiv:2205.06916  [pdf, ps, other

    math.OC

    Modeling Combinatorial Disjunctive Constraints via Junction Trees

    Authors: Bochuan Lyu, Illya V. Hicks, Joey Huchette

    Abstract: We introduce techniques to build small ideal mixed-integer programming (MIP) formulations of combinatorial disjunctive constraints (CDCs) via the independent branching scheme. We present a novel pairwise IB-representable class of CDCs, CDCs admitting junction trees, and provide a combinatorial procedure to build MIP formulations for those constraints. Generalized special ordered sets (… ▽ More

    Submitted 13 May, 2022; originally announced May 2022.

    MSC Class: 90C11

  7. arXiv:2011.08823  [pdf, other

    math.OC

    Compact mixed-integer programming relaxations in quadratic optimization

    Authors: Ben Beach, Robert Hildebrand, Joey Huchette

    Abstract: We present a technique for producing valid dual bounds for nonconvex quadratic optimization problems. The approach leverages an elegant piecewise linear approximation for univariate quadratic functions due to Yarotsky, formulating this (simple) approximation using mixed-integer programming (MIP). Notably, the number of constraints, binary variables, and auxiliary continuous variables used in this… ▽ More

    Submitted 27 March, 2021; v1 submitted 17 November, 2020; originally announced November 2020.

    Comments: 48 pages, 4 figures. Submitted to the Journal of Global Optimization, 3-27-2021. This replacement is an upgrade from a conference paper to a journal article, and is greatly revised and expanded in scope

    MSC Class: 90C20; 90C26; 90C11

  8. arXiv:2006.14076  [pdf, other

    cs.LG stat.ML

    The Convex Relaxation Barrier, Revisited: Tightened Single-Neuron Relaxations for Neural Network Verification

    Authors: Christian Tjandraatmadja, Ross Anderson, Joey Huchette, Will Ma, Krunal Patel, Juan Pablo Vielma

    Abstract: We improve the effectiveness of propagation- and linear-optimization-based neural network verification algorithms with a new tightened convex relaxation for ReLU neurons. Unlike previous single-neuron relaxations which focus only on the univariate input space of the ReLU, our method considers the multivariate input space of the affine pre-activation function preceding the ReLU. Using results from… ▽ More

    Submitted 22 October, 2020; v1 submitted 24 June, 2020; originally announced June 2020.

    MSC Class: 68T07

  9. arXiv:2002.08841  [pdf, other

    math.OC cs.LG

    Contextual Reserve Price Optimization in Auctions via Mixed-Integer Programming

    Authors: Joey Huchette, Haihao Lu, Hossein Esfandiari, Vahab Mirrokni

    Abstract: We study the problem of learning a linear model to set the reserve price in an auction, given contextual information, in order to maximize expected revenue from the seller side. First, we show that it is not possible to solve this problem in polynomial time unless the \emph{Exponential Time Hypothesis} fails. Second, we present a strong mixed-integer programming (MIP) formulation for this problem,… ▽ More

    Submitted 13 November, 2020; v1 submitted 20 February, 2020; originally announced February 2020.

  10. arXiv:1811.10409  [pdf, ps, other

    math.OC

    A geometric way to build strong mixed-integer programming formulations

    Authors: Joey Huchette, Juan Pablo Vielma

    Abstract: We give an explicit geometric way to build mixed-integer programming (MIP) formulations for unions of polyhedra. The construction is simply described in terms of spanning hyperplanes in an r-dimensional linear space. The resulting MIP formulation is ideal, and uses exactly r integer variables and 2 x (# of spanning hyperplanes) general inequality constraints. We use this result to derive novel log… ▽ More

    Submitted 9 October, 2019; v1 submitted 21 November, 2018; originally announced November 2018.

    Comments: arXiv admin note: text overlap with arXiv:1709.10132

  11. arXiv:1811.08359  [pdf, ps, other

    math.OC cs.LG

    Strong mixed-integer programming formulations for trained neural networks

    Authors: Ross Anderson, Joey Huchette, Christian Tjandraatmadja, Juan Pablo Vielma

    Abstract: We present an ideal mixed-integer programming (MIP) formulation for a rectified linear unit (ReLU) appearing in a trained neural network. Our formulation requires a single binary variable and no additional continuous variables beyond the input and output variables of the ReLU. We contrast it with an ideal "extended" formulation with a linear number of additional continuous variables, derived throu… ▽ More

    Submitted 28 February, 2019; v1 submitted 20 November, 2018; originally announced November 2018.

    Comments: Extended abstract of arXiv:1811.01988 [math.OC]

  12. arXiv:1811.01988  [pdf, ps, other

    math.OC

    Strong mixed-integer programming formulations for trained neural networks

    Authors: Ross Anderson, Joey Huchette, Will Ma, Christian Tjandraatmadja, Juan Pablo Vielma

    Abstract: We present strong mixed-integer programming (MIP) formulations for high-dimensional piecewise linear functions that correspond to trained neural networks. These formulations can be used for a number of important tasks, such as verifying that an image classification network is robust to adversarial inputs, or solving decision problems where the objective function is a machine learning model. We pre… ▽ More

    Submitted 21 January, 2020; v1 submitted 5 November, 2018; originally announced November 2018.

  13. arXiv:1709.10132  [pdf, ps, other

    math.OC

    A mixed-integer branching approach for very small formulations of disjunctive constraints

    Authors: Joey Huchette, Juan Pablo Vielma

    Abstract: An important problem in optimization is the construction of mixed-integer programming (MIP) formulations of disjunctive constraints that are both strong and small. Motivated by lower bounds on the number of integer variables that are required by traditional MIP formulations, we present a more general mixed-integer branching formulation framework. Our approach maintains favorable algorithmic proper… ▽ More

    Submitted 3 December, 2017; v1 submitted 28 September, 2017; originally announced September 2017.

    MSC Class: 90C11

  14. arXiv:1708.00050  [pdf, other

    math.OC

    Nonconvex piecewise linear functions: Advanced formulations and simple modeling tools

    Authors: Joey Huchette, Juan Pablo Vielma

    Abstract: We present novel mixed-integer programming (MIP) formulations for optimization over nonconvex piecewise linear functions. We exploit recent advances in the systematic construction of MIP formulations to derive new formulations for univariate functions using a geometric approach, and for bivariate functions using a combinatorial approach. All formulations are strong, small (so-called logarithmic fo… ▽ More

    Submitted 7 October, 2019; v1 submitted 31 July, 2017; originally announced August 2017.

  15. arXiv:1607.04803  [pdf, other

    math.OC

    A combinatorial approach for small and strong formulations of disjunctive constraints

    Authors: Joey Huchette, Juan Pablo Vielma

    Abstract: We present a framework for constructing strong mixed-integer programming formulations for logical disjunctive constraints. Our approach is a generalization of the logarithmically-sized formulations of Vielma and Nemhauser for SOS2 constraints, and we offer a complete characterization of its expressive power. We apply the framework to a variety of disjunctive constraints, producing novel small and… ▽ More

    Submitted 24 May, 2018; v1 submitted 16 July, 2016; originally announced July 2016.

  16. arXiv:1602.07802  [pdf, ps, other

    math.OC

    Beating the SDP bound for the floor layout problem: A simple combinatorial idea

    Authors: Joey Huchette, Santanu S. Dey, Juan Pablo Vielma

    Abstract: For many mixed-integer programming (MIP) problems, high-quality dual bounds can be obtained either through advanced formulation techniques coupled with a state-of-the-art MIP solver, or through semidefinite programming (SDP) relaxation hierarchies. In this paper, we introduce an alternative bounding approach that exploits the "combinatorial implosion" effect by solving portions of the original pro… ▽ More

    Submitted 11 April, 2017; v1 submitted 25 February, 2016; originally announced February 2016.

  17. arXiv:1602.07760  [pdf, other

    math.OC

    Strong mixed-integer formulations for the floor layout problem

    Authors: Joey Huchette, Santanu S. Dey, Juan Pablo Vielma

    Abstract: The floor layout problem (FLP) tasks a designer with positioning a collection of rectangular boxes on a fixed floor in such a way that minimizes total communication costs between the components. While several mixed integer programming (MIP) formulations for this problem have been developed, it remains extremely challenging from a computational perspective. This work takes a systematic approach to… ▽ More

    Submitted 11 April, 2017; v1 submitted 24 February, 2016; originally announced February 2016.

  18. arXiv:1508.01982  [pdf, ps, other

    math.OC cs.MS

    JuMP: A Modeling Language for Mathematical Optimization

    Authors: Iain Dunning, Joey Huchette, Miles Lubin

    Abstract: JuMP is an open-source modeling language that allows users to express a wide range of optimization problems (linear, mixed-integer, quadratic, conic-quadratic, semidefinite, and nonlinear) in a high-level, algebraic syntax. JuMP takes advantage of advanced features of the Julia programming language to offer unique functionality while achieving performance on par with commercial modeling tools for… ▽ More

    Submitted 15 August, 2016; v1 submitted 8 August, 2015; originally announced August 2015.

  19. Extended Formulations in Mixed Integer Conic Quadratic Programming

    Authors: Juan Pablo Vielma, Iain Dunning, Joey Huchette, Miles Lubin

    Abstract: In this paper we consider the use of extended formulations in LP-based algorithms for mixed integer conic quadratic programming (MICQP). Extended formulations have been used by Vielma, Ahmed and Nemhauser (2008) and Hijazi, Bonami and Ouorou (2013) to construct algorithms for MICQP that can provide a significant computational advantage. The first approach is based on an extended or lifted polyhedr… ▽ More

    Submitted 13 July, 2016; v1 submitted 28 May, 2015; originally announced May 2015.