-
Faster single-source shortest paths with negative real weights via proper hop distance
Authors:
Yufan Huang,
Peter **,
Kent Quanrud
Abstract:
The textbook algorithm for single-source shortest paths with real-valued edge weights runs in $O(m n)$ time on a graph with $m$ edges and $n$ vertices. A recent breakthrough algorithm by Fineman [Fin24] takes $\tilde O(m n^{8/9})$ randomized time. We present an $\tilde O(m n^{4/5})$ randomized time algorithm building on ideas from [Fin24].
The textbook algorithm for single-source shortest paths with real-valued edge weights runs in $O(m n)$ time on a graph with $m$ edges and $n$ vertices. A recent breakthrough algorithm by Fineman [Fin24] takes $\tilde O(m n^{8/9})$ randomized time. We present an $\tilde O(m n^{4/5})$ randomized time algorithm building on ideas from [Fin24].
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
-
Approximate Fully Dynamic Directed Densest Subgraph
Authors:
Richard Li,
Kent Quanrud
Abstract:
We give a fully dynamic algorithm maintaining a $(1-\varepsilon)$-approximate directed densest subgraph in $\tilde{O}(\log^3(n)/\varepsilon^6)$ amortized time or $\tilde{O}(\log^4(n)/\varepsilon^7)$ worst-case time per edge update (where $\tilde{O}$ hides $\log\log$ factors), based on earlier work by Chekuri and Quanrud [arXiv:2210.02611, arXiv:2310.18146]. This result improves on earlier work don…
▽ More
We give a fully dynamic algorithm maintaining a $(1-\varepsilon)$-approximate directed densest subgraph in $\tilde{O}(\log^3(n)/\varepsilon^6)$ amortized time or $\tilde{O}(\log^4(n)/\varepsilon^7)$ worst-case time per edge update (where $\tilde{O}$ hides $\log\log$ factors), based on earlier work by Chekuri and Quanrud [arXiv:2210.02611, arXiv:2310.18146]. This result improves on earlier work done by Sawlani and Wang [arXiv:1907.03037], which guarantees $O(\log^5(n)/\varepsilon^7)$ worst case time for edge insertions and deletions.
△ Less
Submitted 17 December, 2023; v1 submitted 12 December, 2023;
originally announced December 2023.
-
Adaptive Out-Orientations with Applications
Authors:
Chandra Chekuri,
Aleksander Bjørn Christiansen,
Jacob Holm,
Ivor van der Hoog,
Kent Quanrud,
Eva Rotenberg,
Chris Schwiegelshohn
Abstract:
We give improved algorithms for maintaining edge-orientations of a fully-dynamic graph, such that the out-degree of each vertex is bounded. On one hand, we show how to orient the edges such that the out-degree of each vertex is proportional to the arboricity $α$ of the graph, in, either, an amortised update time of $O(\log^2 n \log α)$, or a worst-case update time of $O(\log^3 n \log α)$. On the o…
▽ More
We give improved algorithms for maintaining edge-orientations of a fully-dynamic graph, such that the out-degree of each vertex is bounded. On one hand, we show how to orient the edges such that the out-degree of each vertex is proportional to the arboricity $α$ of the graph, in, either, an amortised update time of $O(\log^2 n \log α)$, or a worst-case update time of $O(\log^3 n \log α)$. On the other hand, motivated by applications including dynamic maximal matching, we obtain a different trade-off, namely either $O(\log n \log α)$, amortised, or $O(\log ^2 n \log α)$, worst-case time, for the problem of maintaining an edge-orientation with at most $O(α+ \log n)$ out-edges per vertex. Since our algorithms have update times with worst-case guarantees, the number of changes to the solution (i.e. the recourse) is naturally limited. Our algorithms adapt to the current arboricity of the graph, and yield improvements over previous work: Firstly, we obtain an $O(\varepsilon^{-6}\log^3 n \log ρ)$ worst-case update time algorithm for maintaining a $(1+\varepsilon)$ approximation of the maximum subgraph density, $ρ$.
Secondly, we obtain an $O(\varepsilon^{-6}\log^3 n \log α)$ worst-case update time algorithm for maintaining a $(1 + \varepsilon) \cdot OPT + 2$ approximation of the optimal out-orientation of a graph with adaptive arboricity $α$. This yields the first worst-case polylogarithmic dynamic algorithm for decomposing into $O(α)$ forests.Thirdly, we obtain arboricity-adaptive fully-dynamic deterministic algorithms for a variety, of problems including maximal matching, $Δ+1$ coloring, and matrix vector multiplication. All update times are worst-case $O(α+\log^2n \log α)$, where $α$ is the current arboricity of the graph.
△ Less
Submitted 4 November, 2023; v1 submitted 27 October, 2023;
originally announced October 2023.
-
Independent Sets in Elimination Graphs with a Submodular Objective
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
Maximum weight independent set (MWIS) admits a $\frac1k$-approximation in inductively $k$-independent graphs and a $\frac{1}{2k}$-approximation in $k$-perfectly orientable graphs. These are a a parameterized class of graphs that generalize $k$-degenerate graphs, chordal graphs, and intersection graphs of various geometric shapes such as intervals, pseudo-disks, and several others. We consider a ge…
▽ More
Maximum weight independent set (MWIS) admits a $\frac1k$-approximation in inductively $k$-independent graphs and a $\frac{1}{2k}$-approximation in $k$-perfectly orientable graphs. These are a a parameterized class of graphs that generalize $k$-degenerate graphs, chordal graphs, and intersection graphs of various geometric shapes such as intervals, pseudo-disks, and several others. We consider a generalization of MWIS to a submodular objective. Given a graph $G=(V,E)$ and a non-negative submodular function $f: 2^V \rightarrow \mathbb{R}_+$, the goal is to approximately solve $\max_{S \in \mathcal{I}_G} f(S)$ where $\mathcal{I}_G$ is the set of independent sets of $G$. We obtain an $Ω(\frac1k)$-approximation for this problem in the two mentioned graph classes. The first approach is via the multilinear relaxation framework and a simple contention resolution scheme, and this results in a randomized algorithm with approximation ratio at least $\frac{1}{e(k+1)}$. This approach also yields parallel (or low-adaptivity) approximations. Motivated by the goal of designing efficient and deterministic algorithms, we describe two other algorithms for inductively $k$-independent graphs that are inspired by work on streaming algorithms: a preemptive greedy algorithm and a primal-dual algorithm. In addition to being simpler and faster, these algorithms, in the monotone submodular case, yield the first deterministic constant factor approximations for various special cases that have been previously considered such as intersection graphs of intervals, disks and pseudo-disks.
△ Less
Submitted 7 July, 2023; v1 submitted 5 July, 2023;
originally announced July 2023.
-
Convergence to Lexicographically Optimal Base in a (Contra)Polymatroid and Applications to Densest Subgraph and Tree Packing
Authors:
Elfarouk Harb,
Kent Quanrud,
Chandra Chekuri
Abstract:
Boob et al. [1] described an iterative peeling algorithm called Greedy++ for the Densest Subgraph Problem (DSG) and conjectured that it converges to an optimum solution. Chekuri, Quanrud, and Torres [2] extended the algorithm to general supermodular density problems (of which DSG is a special case) and proved that the resulting algorithm Super-Greedy++ (and hence also Greedy++) converges. In this…
▽ More
Boob et al. [1] described an iterative peeling algorithm called Greedy++ for the Densest Subgraph Problem (DSG) and conjectured that it converges to an optimum solution. Chekuri, Quanrud, and Torres [2] extended the algorithm to general supermodular density problems (of which DSG is a special case) and proved that the resulting algorithm Super-Greedy++ (and hence also Greedy++) converges. In this paper, we revisit the convergence proof and provide a different perspective. This is done via a connection to Fujishige's quadratic program for finding a lexicographically optimal base in a (contra)polymatroid [3], and a noisy version of the Frank-Wolfe method from convex optimisation [4,5]. This gives us a simpler convergence proof, and also shows a stronger property that Super-Greedy++ converges to the optimal dense decomposition vector, answering a question raised in Harb et al. [6]. A second contribution of the paper is to understand Thorup's work on ideal tree packing and greedy tree packing [7,8] via the Frank-Wolfe algorithm applied to find a lexicographically optimum base in the graphic matroid. This yields a simpler and transparent proof. The two results appear disparate but are unified via Fujishige's result and convex optimisation.
△ Less
Submitted 4 May, 2023;
originally announced May 2023.
-
Faster exact and approximation algorithms for packing and covering matroids via push-relabel
Authors:
Kent Quanrud
Abstract:
Matroids are a fundamental object of study in combinatorial optimization. Three closely related and important problems involving matroids are maximizing the size of the union of $k$ independent sets (that is, $k$-fold matroid union), computing $k$ disjoint bases (a.k.a. matroid base packing), and covering the elements by $k$ bases (a.k.a. matroid base covering). These problems generalize naturally…
▽ More
Matroids are a fundamental object of study in combinatorial optimization. Three closely related and important problems involving matroids are maximizing the size of the union of $k$ independent sets (that is, $k$-fold matroid union), computing $k$ disjoint bases (a.k.a. matroid base packing), and covering the elements by $k$ bases (a.k.a. matroid base covering). These problems generalize naturally to integral and real-valued capacities on the elements. This work develops faster exact and/or approximation problems for these and some other closely related problems such as optimal reinforcement and matroid membership. We obtain improved running times both for general matroids in the independence oracle model and for the graphic matroid. The main thrust of our improvements comes from develo** a faster and unifying push-relabel algorithm for the integer-capacitated versions of these problems, building on previous work by Frank and Miklós [FM12]. We then build on this algorithm in two directions. First we develop a faster augmenting path subroutine for $k$-fold matroid union that, when appended to an approximation version of the push-relabel algorithm, gives a faster exact algorithm for some parameters of $k$. In particular we obtain a subquadratic-query running time in the uncapacitated setting for the three basic problems listed above. We also obtain faster approximation algorithms for these problems with real-valued capacities by reducing to small integral capacities via randomized rounding. To this end, we develop a new randomized rounding technique for base covering problems in matroids that may also be of independent interest.
△ Less
Submitted 2 March, 2023;
originally announced March 2023.
-
$(1-ε)$-approximate fully dynamic densest subgraph: linear space and faster update time
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
We consider the problem of maintaining a $(1-ε)$-approximation to the densest subgraph (DSG) in an undirected multigraph as it undergoes edge insertions and deletions (the fully dynamic setting). Sawlani and Wang [SW20] developed a data structure that, for any given $ε> 0$, maintains a $(1-ε)$-approximation with $O(\log^4 n/ε^6)$ worst-case update time for edge operations, and $O(1)$ query time fo…
▽ More
We consider the problem of maintaining a $(1-ε)$-approximation to the densest subgraph (DSG) in an undirected multigraph as it undergoes edge insertions and deletions (the fully dynamic setting). Sawlani and Wang [SW20] developed a data structure that, for any given $ε> 0$, maintains a $(1-ε)$-approximation with $O(\log^4 n/ε^6)$ worst-case update time for edge operations, and $O(1)$ query time for reporting the density value. Their data structure was the first to achieve near-optimal approximation, and improved previous work that maintained a $(1/4 - ε)$ approximation in amortized polylogarithmic update time [BHNT15]. In this paper we develop a data structure for $(1-ε)$-approximate DSG that improves the one from [SW20] in two aspects. First, the data structure uses linear space improving the space bound in [SW20] by a logarithmic factor. Second, the data structure maintains a $(1-ε)$-approximation in amortized $O(\log^2 n/ε^4)$ time per update while simultaneously guaranteeing that the worst case update time is $O(\log^3 n \log \log n/ε^6)$. We believe that the space and update time improvements are valuable for current large scale graph data sets. The data structure extends in a natural fashion to hypergraphs and yields improvements in space and update times over recent work [BBCG22] that builds upon [SW20].
△ Less
Submitted 5 October, 2022;
originally announced October 2022.
-
Minimum Cuts in Directed Graphs via Partial Sparsification
Authors:
Ruoxu Cen,
Jason Li,
Danupon Nanongkai,
Debmalya Panigrahi,
Kent Quanrud,
Thatchaphol Saranurak
Abstract:
We give an algorithm to find a minimum cut in an edge-weighted directed graph with $n$ vertices and $m$ edges in $\tilde O(n\cdot \max(m^{2/3}, n))$ time. This improves on the 30 year old bound of $\tilde O(nm)$ obtained by Hao and Orlin for this problem. Our main technique is to reduce the directed mincut problem to $\tilde O(\min(n/m^{1/3}, \sqrt{n}))$ calls of {\em any} maxflow subroutine. Usin…
▽ More
We give an algorithm to find a minimum cut in an edge-weighted directed graph with $n$ vertices and $m$ edges in $\tilde O(n\cdot \max(m^{2/3}, n))$ time. This improves on the 30 year old bound of $\tilde O(nm)$ obtained by Hao and Orlin for this problem. Our main technique is to reduce the directed mincut problem to $\tilde O(\min(n/m^{1/3}, \sqrt{n}))$ calls of {\em any} maxflow subroutine. Using state-of-the-art maxflow algorithms, this yields the above running time. Our techniques also yield fast {\em approximation} algorithms for finding minimum cuts in directed graphs. For both edge and vertex weighted graphs, we give $(1+ε)$-approximation algorithms that run in $\tilde O(n^2 / ε^2)$ time.
△ Less
Submitted 17 November, 2021;
originally announced November 2021.
-
Faster Algorithms for Rooted Connectivity in Directed Graphs
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
We consider the fundamental problems of determining the rooted and global edge and vertex connectivities (and computing the corresponding cuts) in directed graphs. For rooted (and hence also global) edge connectivity with small integer capacities we give a new randomized Monte Carlo algorithm that runs in time $\tilde{O}(n^2)$. For rooted edge connectivity this is the first algorithm to improve on…
▽ More
We consider the fundamental problems of determining the rooted and global edge and vertex connectivities (and computing the corresponding cuts) in directed graphs. For rooted (and hence also global) edge connectivity with small integer capacities we give a new randomized Monte Carlo algorithm that runs in time $\tilde{O}(n^2)$. For rooted edge connectivity this is the first algorithm to improve on the $Ω(n^3)$ time bound in the dense-graph high-connectivity regime. Our result relies on a simple combination of sampling coupled with sparsification that appears new, and could lead to further tradeoffs for directed graph connectivity problems.
We extend the edge connectivity ideas to rooted and global vertex connectivity in directed graphs. We obtain a $(1 + ε)$-approximation for rooted vertex connectivity in $\tilde{O}(nW/ε)$ time where $W$ is the total vertex weight (assuming integral vertex weights); in particular this yields an $\tilde{O}(n^2/ε)$ time randomized algorithm for unweighted graphs. This translates to a $\tilde{O}(κnW)$ time exact algorithm where $κ$ is the rooted connectivity. We build on this to obtain similar bounds for global vertex connectivity.
Our results complement the known results for these problems in the low connectivity regime due to work of Gabow [9] for edge connectivity from 1991, and the very recent work of Nanongkai et al. [24] and Forster et al. [7] for vertex connectivity.
△ Less
Submitted 14 April, 2021;
originally announced April 2021.
-
Fast Approximations for Rooted Connectivity in Weighted Directed Graphs
Authors:
Kent Quanrud
Abstract:
We consider approximations for computing minimum weighted cuts in directed graphs. We consider both rooted and global minimum cuts, and both edge-cuts and vertex-cuts. For these problems we give randomized Monte Carlo algorithms that compute a $(1+ε)$-approximate minimum cut in $\tilde{O}(n^2 / ε^2)$ time. These results extend and build on recent work [4] that obtained exact algorithms with simila…
▽ More
We consider approximations for computing minimum weighted cuts in directed graphs. We consider both rooted and global minimum cuts, and both edge-cuts and vertex-cuts. For these problems we give randomized Monte Carlo algorithms that compute a $(1+ε)$-approximate minimum cut in $\tilde{O}(n^2 / ε^2)$ time. These results extend and build on recent work [4] that obtained exact algorithms with similar running times in directed graphs with small integer capacities.
△ Less
Submitted 14 April, 2021;
originally announced April 2021.
-
Isolating Cuts, (Bi-)Submodularity, and Faster Algorithms for Global Connectivity Problems
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
Li and Panigrahi, in recent work, obtained the first deterministic algorithm for the global minimum cut of a weighted undirected graph that runs in time $o(mn)$. They introduced an elegant and powerful technique to find isolating cuts for a terminal set in a graph via a small number of $s$-$t$ minimum cut computations.
In this paper we generalize their isolating cut approach to the abstract sett…
▽ More
Li and Panigrahi, in recent work, obtained the first deterministic algorithm for the global minimum cut of a weighted undirected graph that runs in time $o(mn)$. They introduced an elegant and powerful technique to find isolating cuts for a terminal set in a graph via a small number of $s$-$t$ minimum cut computations.
In this paper we generalize their isolating cut approach to the abstract setting of symmetric bisubmodular functions (which also capture symmetric submodular functions). Our generalization to bisubmodularity is motivated by applications to element connectivity and vertex connectivity. Utilizing the general framework and other ideas we obtain significantly faster randomized algorithms for computing global (and subset) connectivity in a number of settings including hypergraphs, element connectivity and vertex connectivity in graphs, and for symmetric submodular functions.
△ Less
Submitted 23 March, 2021;
originally announced March 2021.
-
Online Directed Spanners and Steiner Forests
Authors:
Elena Grigorescu,
Young-San Lin,
Kent Quanrud
Abstract:
We present online algorithms for directed spanners and Steiner forests. These problems fall under the unifying framework of online covering linear programming formulations, developed by Buchbinder and Naor (MOR, 34, 2009), based on primal-dual techniques. Our results include the following:
For the pairwise spanner problem, in which the pairs of vertices to be spanned arrive online, we present an…
▽ More
We present online algorithms for directed spanners and Steiner forests. These problems fall under the unifying framework of online covering linear programming formulations, developed by Buchbinder and Naor (MOR, 34, 2009), based on primal-dual techniques. Our results include the following:
For the pairwise spanner problem, in which the pairs of vertices to be spanned arrive online, we present an efficient randomized $\tilde{O}(n^{4/5})$-competitive algorithm for graphs with general lengths, where $n$ is the number of vertices. With uniform lengths, we give an efficient randomized $\tilde{O}(n^{2/3+ε})$-competitive algorithm, and an efficient deterministic $\tilde{O}(k^{1/2+ε})$-competitive algorithm, where $k$ is the number of terminal pairs. These are the first online algorithms for directed spanners. In the offline setting, the current best approximation ratio with uniform lengths is $\tilde{O}(n^{3/5 + ε})$, due to Chlamtac, Dinitz, Kortsarz, and Laekhanukit (TALG 2020).
For the directed Steiner forest problem with uniform costs, in which the pairs of vertices to be connected arrive online, we present an efficient randomized $\tilde{O}(n^{2/3 + ε})$-competitive algorithm. The state-of-the-art online algorithm for general costs is due to Chakrabarty, Ene, Krishnaswamy, and Panigrahi (SICOMP 2018) and is $\tilde{O}(k^{1/2 + ε})$-competitive. In the offline version, the current best approximation ratio with uniform costs is $\tilde{O}(n^{4/7 + ε})$, due to Abboud and Bodwin (SODA 2018).
A small modification of the online covering framework by Buchbinder and Naor implies a polynomial-time primal-dual approach with separation oracles, which a priori might perform exponentially many calls. We convert the online spanner problem and the online Steiner forest problem into online covering problems and round in a problem-specific fashion.
△ Less
Submitted 3 July, 2023; v1 submitted 7 March, 2021;
originally announced March 2021.
-
Fast Approximation Algorithms for Bounded Degree and Crossing Spanning Tree Problems
Authors:
Chandra Chekuri,
Kent Quanrud,
Manuel R. Torres
Abstract:
We develop fast approximation algorithms for the minimum-cost version of the Bounded-Degree MST problem (BD-MST) and its generalization the Crossing Spanning Tree problem (Crossing-ST). We solve the underlying LP to within a $(1+ε)$ approximation factor in near-linear time via the multiplicative weight update (MWU) technique. This yields, in particular, a near-linear time algorithm that outputs an…
▽ More
We develop fast approximation algorithms for the minimum-cost version of the Bounded-Degree MST problem (BD-MST) and its generalization the Crossing Spanning Tree problem (Crossing-ST). We solve the underlying LP to within a $(1+ε)$ approximation factor in near-linear time via the multiplicative weight update (MWU) technique. This yields, in particular, a near-linear time algorithm that outputs an estimate $B$ such that $B \le B^* \le \lceil (1+ε)B \rceil +1$ where $B^*$ is the minimum-degree of a spanning tree of a given graph. To round the fractional solution, in our main technical contribution, we describe a fast near-linear time implementation of swap-rounding in the spanning tree polytope of a graph. The fractional solution can also be used to sparsify the input graph that can in turn be used to speed up existing combinatorial algorithms. Together, these ideas lead to significantly faster approximation algorithms than known before for the two problems of interest. In addition, a fast algorithm for swap rounding in the graphic matroid is a generic tool that has other applications, including to TSP and submodular function maximization.
△ Less
Submitted 17 May, 2021; v1 submitted 6 November, 2020;
originally announced November 2020.
-
Computing Circle Packing Representations of Planar Graphs
Authors:
Sally Dong,
Yin Tat Lee,
Kent Quanrud
Abstract:
The Circle Packing Theorem states that every planar graph can be represented as the tangency graph of a family of internally-disjoint circles. A well-known generalization is the Primal-Dual Circle Packing Theorem for 3-connected planar graphs. The existence of these representations has widespread applications in theoretical computer science and mathematics; however, the algorithmic aspect has rece…
▽ More
The Circle Packing Theorem states that every planar graph can be represented as the tangency graph of a family of internally-disjoint circles. A well-known generalization is the Primal-Dual Circle Packing Theorem for 3-connected planar graphs. The existence of these representations has widespread applications in theoretical computer science and mathematics; however, the algorithmic aspect has received relatively little attention. In this work, we present an algorithm based on convex optimization for computing a primal-dual circle packing representation of maximal planar graphs, i.e. triangulations. This in turn gives an algorithm for computing a circle packing representation of any planar graph. Both take $\widetilde{O}(n \log(R/\varepsilon))$ expected run-time to produce a solution that is $\varepsilon$ close to a true representation, where $R$ is the ratio between the maximum and minimum circle radius in the true representation.
△ Less
Submitted 1 November, 2019;
originally announced November 2019.
-
On Approximating Partial Set Cover and Generalizations
Authors:
Chandra Chekuri,
Kent Quanrud,
Zhao Zhang
Abstract:
Partial Set Cover (PSC) is a generalization of the well-studied Set Cover problem (SC). In PSC the input consists of an integer $k$ and a set system $(U,S)$ where $U$ is a finite set, and $S \subseteq 2^U$ is a collection of subsets of $U$. The goal is to find a subcollection $S' \subseteq S$ of smallest cardinality such that sets in $S'$ cover at least $k$ elements of $U$; that is…
▽ More
Partial Set Cover (PSC) is a generalization of the well-studied Set Cover problem (SC). In PSC the input consists of an integer $k$ and a set system $(U,S)$ where $U$ is a finite set, and $S \subseteq 2^U$ is a collection of subsets of $U$. The goal is to find a subcollection $S' \subseteq S$ of smallest cardinality such that sets in $S'$ cover at least $k$ elements of $U$; that is $|\cup_{A \in S'} A| \ge k$. SC is a special case of PSC when $k = |U|$. In the weighted version each set $X \in S$ has a non-negative weight $w(X)$ and the goal is to find a minimum weight subcollection to cover $k$ elements. Approximation algorithms for SC have been adapted to obtain comparable algorithms for PSC in various interesting cases. In recent work Inamdar and Varadarajan, motivated by geometric set systems, obtained a simple and elegant approach to reduce PSC to SC via the natural LP relaxation. They showed that if a deletion-closed family of SC admits a $β$-approximation via the natural LP relaxation, then one can obtain a $2(β+ 1)$-approximation for PSC on the same family. In a subsequent paper, they also considered a generalization of PSC that has multiple partial covering constraints which is partly inspired by and generalizes previous work of Bera et al on the Vertex Cover problem. Our main goal in this paper is to demonstrate some useful connections between the results in previous work and submodularity. This allows us to simplify, and in some cases improve their results. We improve the approximation for PSC to $(1-1/e)(β+ 1)$. We extend the previous work to the sparse setting.
△ Less
Submitted 9 July, 2019;
originally announced July 2019.
-
$\ell_1$-sparsity Approximation Bounds for Packing Integer Programs
Authors:
Chandra Chekuri,
Kent Quanrud,
Manuel R. Torres
Abstract:
We consider approximation algorithms for packing integer programs (PIPs) of the form $\max\{\langle c, x\rangle : Ax \le b, x \in \{0,1\}^n\}$ where $c$, $A$, and $b$ are nonnegative. We let $W = \min_{i,j} b_i / A_{i,j}$ denote the width of $A$ which is at least $1$. Previous work by Bansal et al. \cite{bansal-sparse} obtained an $Ω(\frac{1}{Δ_0^{1/\lfloor W \rfloor}})$-approximation ratio where…
▽ More
We consider approximation algorithms for packing integer programs (PIPs) of the form $\max\{\langle c, x\rangle : Ax \le b, x \in \{0,1\}^n\}$ where $c$, $A$, and $b$ are nonnegative. We let $W = \min_{i,j} b_i / A_{i,j}$ denote the width of $A$ which is at least $1$. Previous work by Bansal et al. \cite{bansal-sparse} obtained an $Ω(\frac{1}{Δ_0^{1/\lfloor W \rfloor}})$-approximation ratio where $Δ_0$ is the maximum number of nonzeroes in any column of $A$ (in other words the $\ell_0$-column sparsity of $A$). They raised the question of obtaining approximation ratios based on the $\ell_1$-column sparsity of $A$ (denoted by $Δ_1$) which can be much smaller than $Δ_0$. Motivated by recent work on covering integer programs (CIPs) \cite{cq,chs-16} we show that simple algorithms based on randomized rounding followed by alteration, similar to those of Bansal et al. \cite{bansal-sparse} (but with a twist), yield approximation ratios for PIPs based on $Δ_1$. First, following an integrality gap example from \cite{bansal-sparse}, we observe that the case of $W=1$ is as hard as maximum independent set even when $Δ_1 \le 2$. In sharp contrast to this negative result, as soon as width is strictly larger than one, we obtain positive results via the natural LP relaxation. For PIPs with width $W = 1 + ε$ where $ε\in (0,1]$, we obtain an $Ω(ε^2/Δ_1)$-approximation. In the large width regime, when $W \ge 2$, we obtain an $Ω((\frac{1}{1 + Δ_1/W})^{1/(W-1)})$-approximation. We also obtain a $(1-ε)$-approximation when $W = Ω(\frac{\log (Δ_1/ε)}{ε^2})$.
△ Less
Submitted 22 February, 2019;
originally announced February 2019.
-
Parallelizing greedy for submodular set function maximization in matroids and beyond
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
We consider parallel, or low adaptivity, algorithms for submodular function maximization. This line of work was recently initiated by Balkanski and Singer and has already led to several interesting results on the cardinality constraint and explicit packing constraints. An important open problem is the classical setting of matroid constraint, which has been instrumental for developments in submodul…
▽ More
We consider parallel, or low adaptivity, algorithms for submodular function maximization. This line of work was recently initiated by Balkanski and Singer and has already led to several interesting results on the cardinality constraint and explicit packing constraints. An important open problem is the classical setting of matroid constraint, which has been instrumental for developments in submodular function maximization. In this paper we develop a general strategy to parallelize the well-studied greedy algorithm and use it to obtain a randomized $\left(\frac{1}{2} - ε\right)$-approximation in $\operatorname{O}\left( \frac{\log^2 n}{ε^2} \right)$ rounds of adaptivity. We rely on this algorithm, and an elegant amplification approach due to Badanidiyuru and Vondrák to obtain a fractional solution that yields a near-optimal randomized $\left( 1 - 1/e - ε\right)$-approximation in $O\left( {\frac{\log^2 n}{ε^3}} \right) $ rounds of adaptivity. For non-negative functions we obtain a $\left( {3-2\sqrt{2}}\right)$-approximation and a fractional solution that yields a $\left( {\frac{1}{e} - ε}\right)$-approximation. Our approach for parallelizing greedy yields approximations for intersections of matroids and matchoids, and the approximation ratios are comparable to those known for sequential greedy.
△ Less
Submitted 29 November, 2018;
originally announced November 2018.
-
Approximating optimal transport with linear programs
Authors:
Kent Quanrud
Abstract:
In the regime of bounded transportation costs, additive approximations for the optimal transport problem are reduced (rather simply) to relative approximations for positive linear programs, resulting in faster additive approximation algorithms for optimal transport.
In the regime of bounded transportation costs, additive approximations for the optimal transport problem are reduced (rather simply) to relative approximations for positive linear programs, resulting in faster additive approximation algorithms for optimal transport.
△ Less
Submitted 21 October, 2018; v1 submitted 13 October, 2018;
originally announced October 2018.
-
LP Relaxation and Tree Packing for Minimum $k$-cuts
Authors:
Chandra Chekuri,
Kent Quanrud,
Chao Xu
Abstract:
Karger used spanning tree packings to derive a near linear-time randomized algorithm for the global minimum cut problem as well as a bound on the number of approximate minimum cuts. This is a different approach from his well-known random contraction algorithm. Thorup developed a fast deterministic algorithm for the minimum $k$-cut problem via greedy recursive tree packings.
In this paper we revi…
▽ More
Karger used spanning tree packings to derive a near linear-time randomized algorithm for the global minimum cut problem as well as a bound on the number of approximate minimum cuts. This is a different approach from his well-known random contraction algorithm. Thorup developed a fast deterministic algorithm for the minimum $k$-cut problem via greedy recursive tree packings.
In this paper we revisit properties of an LP relaxation for $k$-cut proposed by Naor and Rabani, and analyzed by Chekuri, Guha and Naor. We show that the dual of the LP yields a tree packing, that when combined with an upper bound on the integrality gap for the LP, easily and transparently extends Karger's analysis for mincut to the $k$-cut problem. In addition to the simplicity of the algorithm and its analysis, this allows us to improve the running time of Thorup's algorithm by a factor of $n$. We also improve the bound on the number of $α$-approximate $k$-cuts. Second, we give a simple proof that the integrality gap of the LP is $2(1-1/n)$. Third, we show that an optimum solution to the LP relaxation, for all values of $k$, is fully determined by the principal sequence of partitions of the input graph. This allows us to relate the LP relaxation to the Lagrangian relaxation approach of Barahona and Ravi and Sinha; it also shows that the idealized recursive tree packing considered by Thorup gives an optimum dual solution to the LP. This work arose from an effort to understand and simplify the results of Thorup.
△ Less
Submitted 17 August, 2018;
originally announced August 2018.
-
On Approximating (Sparse) Covering Integer Programs
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
We consider approximation algorithms for covering integer programs of the form min $\langle c, x \rangle $ over $x \in \mathbb{N}^n $ subject to $A x \geq b $ and $x \leq d$; where $A \in \mathbb{R}_{\geq 0}^{m \times n}$, $b \in \mathbb{R}_{\geq 0}^m$, and $c, d \in \mathbb{R}_{\geq 0}^n$ all have nonnegative entries. We refer to this problem as $\operatorname{CIP}$, and the special case without…
▽ More
We consider approximation algorithms for covering integer programs of the form min $\langle c, x \rangle $ over $x \in \mathbb{N}^n $ subject to $A x \geq b $ and $x \leq d$; where $A \in \mathbb{R}_{\geq 0}^{m \times n}$, $b \in \mathbb{R}_{\geq 0}^m$, and $c, d \in \mathbb{R}_{\geq 0}^n$ all have nonnegative entries. We refer to this problem as $\operatorname{CIP}$, and the special case without the multiplicity constraints $x \le d$ as $\operatorname{CIP}_{\infty}$. These problems generalize the well-studied Set Cover problem. We make two algorithmic contributions.
First, we show that a simple algorithm based on randomized rounding with alteration improves or matches the best known approximation algorithms for $\operatorname{CIP}$ and $\operatorname{CIP}_{\infty}$ in a wide range of parameter settings, and these bounds are essentially optimal. As a byproduct of the simplicity of the alteration algorithm and analysis, we can derandomize the algorithm without any loss in the approximation guarantee or efficiency. Previous work by Chen, Harris and Srinivasan [12] which obtained near-tight bounds is based on a resampling-based randomized algorithm whose analysis is complex.
Non-trivial approximation algorithms for $\operatorname{CIP}$ are based on solving the natural LP relaxation strengthened with knapsack cover (KC) inequalities [5,24,12]. Our second contribution is a fast (essentially near-linear time) approximation scheme for solving the strengthened LP with a factor of $n$ speed up over the previous best running time [5].
Together, our contributions lead to near-optimal (deterministic) approximation bounds with near-linear running times for $\operatorname{CIP}$ and $\operatorname{CIP}_{\infty}$.
△ Less
Submitted 18 November, 2018; v1 submitted 30 July, 2018;
originally announced July 2018.
-
Submodular Function Maximization in Parallel via the Multilinear Relaxation
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
Balkanski and Singer [5] recently initiated the study of adaptivity (or parallelism) for constrained submodular function maximization, and studied the setting of a cardinality constraint. Very recent improvements for this problem by Balkanski, Rubinstein, and Singer [6] and Ene and Nguyen [21] resulted in a near-optimal $(1-1/e-ε)$-approximation in $O(\log n/ε^2)$ rounds of adaptivity. Partly moti…
▽ More
Balkanski and Singer [5] recently initiated the study of adaptivity (or parallelism) for constrained submodular function maximization, and studied the setting of a cardinality constraint. Very recent improvements for this problem by Balkanski, Rubinstein, and Singer [6] and Ene and Nguyen [21] resulted in a near-optimal $(1-1/e-ε)$-approximation in $O(\log n/ε^2)$ rounds of adaptivity. Partly motivated by the goal of extending these results to more general constraints, we describe parallel algorithms for approximately maximizing the multilinear relaxation of a monotone submodular function subject to packing constraints. Formally our problem is to maximize $F(x)$ over $x \in [0,1]^{n}$ subject to $Ax \le 1$ where $F$ is the multilinear relaxation of a monotone submodular function. Our algorithm achieves a near-optimal $(1-1/e-ε)$-approximation in $O(\log^2 m \log n/ε^4)$ rounds where $n$ is the cardinality of the ground set and $m$ is the number of packing constraints. For many constraints of interest, the resulting fractional solution can be rounded via known randomized rounding schemes that are oblivious to the specific submodular function. We thus derive randomized algorithms with poly-logarithmic adaptivity for a number of constraints including partition and laminar matroids, matchings, knapsack constraints, and their intersections.
△ Less
Submitted 18 November, 2018; v1 submitted 23 July, 2018;
originally announced July 2018.
-
Fast and Deterministic Approximations for $k$-Cut
Authors:
Kent Quanrud
Abstract:
In an undirected graph, a $k$-cut is a set of edges whose removal breaks the graph into at least $k$ connected components. The minimum weight $k$-cut can be computed in $O(n^{O(k)})$ time, but when $k$ is treated as part of the input, computing the minimum weight $k$-cut is NP-Hard [Holdschmidt and Hochbaum 1994]. For $\operatorname{poly}(m,n,k)$-time algorithms, the best possible approximation fa…
▽ More
In an undirected graph, a $k$-cut is a set of edges whose removal breaks the graph into at least $k$ connected components. The minimum weight $k$-cut can be computed in $O(n^{O(k)})$ time, but when $k$ is treated as part of the input, computing the minimum weight $k$-cut is NP-Hard [Holdschmidt and Hochbaum 1994]. For $\operatorname{poly}(m,n,k)$-time algorithms, the best possible approximation factor is essentially 2 under the small set expansion hypothesis [Manurangsi 2017]. Saran and Vazirani [1995] showed that a $(2 - 2/k)$-approximately minimum weight $k$-cut can be computed by $O(k)$ minimum cuts, which implies an $\tilde{O}(mk)$ randomized running time via the nearly linear time randomized min-cut algorithm of Karger [2000]. Nagamochi and Kamidoi [2007] showed that the minimum weight $k$-cut can be computed deterministically in $O(mn + n^2 \log n)$ time. These results prompt two basic questions. The first concerns the role of randomization. Is there a deterministic algorithm for 2-approximate $k$-cuts matching the randomized running time of $\tilde{O}(mk)$? The second question qualitatively compares minimum cut to 2-approximate minimum $k$-cut. Can 2-approximate $k$-cuts be computed as fast as the (exact) minimum cut - in $\tilde{O}(m)$ randomized time?
We make progress on these questions with a deterministic approximation algorithm that computes $(2 + ε)$-minimum $k$-cuts in $O(m \log^3(n) / ε^2)$ time, via a $(1 + ε)$-approximate for an LP relaxation of $k$-cut.
△ Less
Submitted 18 November, 2018; v1 submitted 18 July, 2018;
originally announced July 2018.
-
Fast Approximations for Metric-TSP via Linear Programming
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
We develop faster approximation algorithms for Metric-TSP building on recent, nearly linear time approximation schemes for the LP relaxation [Chekuri and Quanrud, 2017]. We show that the LP solution can be sparsified via cut-sparsification techniques such as those of Benczur and Karger [2015]. Given a weighted graph $G$ with $m$ edges and $n$ vertices, and $ε> 0$, our randomized algorithm outputs…
▽ More
We develop faster approximation algorithms for Metric-TSP building on recent, nearly linear time approximation schemes for the LP relaxation [Chekuri and Quanrud, 2017]. We show that the LP solution can be sparsified via cut-sparsification techniques such as those of Benczur and Karger [2015]. Given a weighted graph $G$ with $m$ edges and $n$ vertices, and $ε> 0$, our randomized algorithm outputs with high probability a $(1+ε)$-approximate solution to the LP relaxation whose support has $\operatorname{O}(n \log n /ε^2)$ edges. The running time of the algorithm is $\operatorname{Õ}(m/ε^2)$. This can be generically used to speed up algorithms that rely on the LP.
For Metric-TSP, we obtain the following concrete result. For a weighted graph $G$ with $m$ edges and $n$ vertices, and $ε> 0$, we describe an algorithm that outputs with high probability a tour of $G$ with cost at most $(1 + ε) \frac{3}{2}$ times the minimum cost tour of $G$ in time $\operatorname{Õ}(m/ε^2 + n^{1.5}/ε^3)$. Previous implementations of Christofides' algorithm [Christofides, 1976] require, for a $\frac{3}{2}$-optimal tour, $\operatorname{Õ}(n^{2.5})$ time when the metric is explicitly given, or $\operatorname{Õ}(\min\{m^{1.5}, mn+n^{2.5}\})$ time when the metric is given implicitly as the shortest path metric of a weighted graph.
△ Less
Submitted 4 February, 2018;
originally announced February 2018.
-
Approximating the Held-Karp Bound for Metric TSP in Nearly Linear Time
Authors:
Chandra Chekuri,
Kent Quanrud
Abstract:
We give a nearly linear time randomized approximation scheme for the Held-Karp bound [Held and Karp, 1970] for metric TSP. Formally, given an undirected edge-weighted graph $G$ on $m$ edges and $ε> 0$, the algorithm outputs in $O(m \log^4n /ε^2)$ time, with high probability, a $(1+ε)$-approximation to the Held-Karp bound on the metric TSP instance induced by the shortest path metric on $G$. The al…
▽ More
We give a nearly linear time randomized approximation scheme for the Held-Karp bound [Held and Karp, 1970] for metric TSP. Formally, given an undirected edge-weighted graph $G$ on $m$ edges and $ε> 0$, the algorithm outputs in $O(m \log^4n /ε^2)$ time, with high probability, a $(1+ε)$-approximation to the Held-Karp bound on the metric TSP instance induced by the shortest path metric on $G$. The algorithm can also be used to output a corresponding solution to the Subtour Elimination LP. We substantially improve upon the $O(m^2 \log^2(m)/ε^2)$ running time achieved previously by Garg and Khandekar. The LP solution can be used to obtain a fast randomized $\big(\frac{3}{2} + ε\big)$-approximation for metric TSP which improves upon the running time of previous implementations of Christofides' algorithm.
△ Less
Submitted 13 October, 2017; v1 submitted 14 February, 2017;
originally announced February 2017.
-
Adversarial Delays in Online Strongly-Convex Optimization
Authors:
Daniel Khashabi,
Kent Quanrud,
Amirhossein Taghvaei
Abstract:
We consider the problem of strongly-convex online optimization in presence of adversarial delays; in a T-iteration online game, the feedback of the player's query at time t is arbitrarily delayed by an adversary for d_t rounds and delivered before the game ends, at iteration t+d_t-1. Specifically for \algo{online-gradient-descent} algorithm we show it has a simple regret bound of \Oh{\sum_{t=1}^T…
▽ More
We consider the problem of strongly-convex online optimization in presence of adversarial delays; in a T-iteration online game, the feedback of the player's query at time t is arbitrarily delayed by an adversary for d_t rounds and delivered before the game ends, at iteration t+d_t-1. Specifically for \algo{online-gradient-descent} algorithm we show it has a simple regret bound of \Oh{\sum_{t=1}^T \log (1+ \frac{d_t}{t})}. This gives a clear and simple bound without resorting any distributional and limiting assumptions on the delays. We further show how this result encompasses and generalizes several of the existing known results in the literature. Specifically it matches the celebrated logarithmic regret \Oh{\log T} when there are no delays (i.e. d_t = 1) and regret bound of \Oh{τ\log T} for constant delays d_t = τ.
△ Less
Submitted 11 September, 2019; v1 submitted 19 May, 2016;
originally announced May 2016.
-
Notes on Approximation Algorithms for Polynomial-Expansion and Low-Density Graphs
Authors:
Sariel Har-Peled,
Kent Quanrud
Abstract:
This write-up contains some minor results and notes related to our work [HQ15] (some of them already known in the literature). In particular, it shows the following:
- We show that a graph with polynomial expansion have sublinear separators.
- We show that hereditary sublinear separators imply that a graph have small divisions.
- We show a natural condition on a set of segments, such that th…
▽ More
This write-up contains some minor results and notes related to our work [HQ15] (some of them already known in the literature). In particular, it shows the following:
- We show that a graph with polynomial expansion have sublinear separators.
- We show that hereditary sublinear separators imply that a graph have small divisions.
- We show a natural condition on a set of segments, such that they have low density. This might be of independent interest in trying to define a realistic input model for a set of segments. Unlike the previous two results, this is new.
For context and more details, see the main paper.
△ Less
Submitted 9 March, 2016;
originally announced March 2016.
-
Streaming Algorithms for Submodular Function Maximization
Authors:
Chandra Chekuri,
Shalmoli Gupta,
Kent Quanrud
Abstract:
We consider the problem of maximizing a nonnegative submodular set function $f:2^{\mathcal{N}} \rightarrow \mathbb{R}^+$ subject to a $p$-matchoid constraint in the single-pass streaming setting. Previous work in this context has considered streaming algorithms for modular functions and monotone submodular functions. The main result is for submodular functions that are {\em non-monotone}. We descr…
▽ More
We consider the problem of maximizing a nonnegative submodular set function $f:2^{\mathcal{N}} \rightarrow \mathbb{R}^+$ subject to a $p$-matchoid constraint in the single-pass streaming setting. Previous work in this context has considered streaming algorithms for modular functions and monotone submodular functions. The main result is for submodular functions that are {\em non-monotone}. We describe deterministic and randomized algorithms that obtain a $Ω(\frac{1}{p})$-approximation using $O(k \log k)$-space, where $k$ is an upper bound on the cardinality of the desired set. The model assumes value oracle access to $f$ and membership oracles for the matroids defining the $p$-matchoid constraint.
△ Less
Submitted 29 April, 2015;
originally announced April 2015.
-
Approximation Algorithms for Polynomial-Expansion and Low-Density Graphs
Authors:
Sariel Har-Peled,
Kent Quanrud
Abstract:
We study the family of intersection graphs of low density objects in low dimensional Euclidean space. This family is quite general, and includes planar graphs. We prove that such graphs have small separators. Next, we present efficient $(1+\varepsilon)$-approximation algorithms for these graphs, for Independent Set, Set Cover, and Dominating Set problems, among others. We also prove corresponding…
▽ More
We study the family of intersection graphs of low density objects in low dimensional Euclidean space. This family is quite general, and includes planar graphs. We prove that such graphs have small separators. Next, we present efficient $(1+\varepsilon)$-approximation algorithms for these graphs, for Independent Set, Set Cover, and Dominating Set problems, among others. We also prove corresponding hardness of approximation for some of these optimization problems, providing a characterization of their intractability in terms of density.
△ Less
Submitted 31 May, 2016; v1 submitted 4 January, 2015;
originally announced January 2015.