-
On further questions regarding unit fractions
Authors:
Yang P. Liu,
Mehtaab Sawhney
Abstract:
We prove that a subset $A\subseteq [1, N]$ with \[\sum_{n\in A}\frac{1}{n} \ge (\log N)^{4/5 + o(1)}\] contains a subset $B$ such that \[\sum_{n\in B} \frac{1}{n} = 1.\] Our techniques refine those of Croot and of Bloom. Using our refinements, we additionally consider a number of questions regarding unit fractions due to Erdős and Graham.
We prove that a subset $A\subseteq [1, N]$ with \[\sum_{n\in A}\frac{1}{n} \ge (\log N)^{4/5 + o(1)}\] contains a subset $B$ such that \[\sum_{n\in B} \frac{1}{n} = 1.\] Our techniques refine those of Croot and of Bloom. Using our refinements, we additionally consider a number of questions regarding unit fractions due to Erdős and Graham.
△ Less
Submitted 10 April, 2024;
originally announced April 2024.
-
On Approximate Fully-Dynamic Matching and Online Matrix-Vector Multiplication
Authors:
Yang P. Liu
Abstract:
We study connections between the problem of fully dynamic $(1-ε)$-approximate maximum bipartite matching, and the dual $(1+ε)$-approximate vertex cover problem, with the online matrix-vector ($\mathsf{OMv}$) conjecture which has recently been used in several fine-grained hardness reductions. We prove that there is an online algorithm that maintains a $(1+ε)$-approximate vertex cover in amortized…
▽ More
We study connections between the problem of fully dynamic $(1-ε)$-approximate maximum bipartite matching, and the dual $(1+ε)$-approximate vertex cover problem, with the online matrix-vector ($\mathsf{OMv}$) conjecture which has recently been used in several fine-grained hardness reductions. We prove that there is an online algorithm that maintains a $(1+ε)$-approximate vertex cover in amortized $n^{1-c}ε^{-C}$ time for constants $c, C > 0$ for fully dynamic updates if and only if the $\mathsf{OMv}$ conjecture is false. Similarly, we prove that there is an online algorithm that maintains a $(1-ε)$-approximate maximum matching in amortized $n^{1-c}ε^{-C}$ time if and only if there is a nontrivial algorithm for another dynamic problem, which we call dynamic approximate $\mathsf{OMv}$, that has seemingly no matching structure. This provides some evidence against achieving amortized sublinear update times for approximate fully dynamic matching and vertex cover.
Leveraging these connections, we obtain faster algorithms for approximate fully dynamic matching in both the online and offline settings.
1. We give a randomized algorithm that with high probability maintains a $(1-ε)$-approximate bipartite matching and $(1+ε)$-approximate vertex cover in fully dynamic graphs, in amortized $O(ε^{-O(1)} \frac{n}{2^{Ω(\sqrt{\log n})}})$ update time. Our algorithm leverages fast algorithms for $\mathsf{OMv}$ due to Larsen-Williams [SODA 2017].
2. We give a randomized offline algorithm for $(1-ε)$-approximate maximum matching with amortized runtime $O(n^{.58}ε^{-O(1)})$ by using fast matrix multiplication, significantly improving over the runtimes achieved via online algorithms. We also give an offline algorithm that maintains a $(1+ε)$-approximate vertex cover in amortized $O(n^{.723}ε^{-O(1)})$ time.
△ Less
Submitted 4 March, 2024;
originally announced March 2024.
-
Parallel Repetition of k-Player Projection Games
Authors:
Amey Bhangale,
Mark Braverman,
Subhash Khot,
Yang P. Liu,
Dor Minzer
Abstract:
We study parallel repetition of k-player games where the constraints satisfy the projection property. We prove exponential decay in the value of a parallel repetition of projection games with value less than 1.
We study parallel repetition of k-player games where the constraints satisfy the projection property. We prove exponential decay in the value of a parallel repetition of projection games with value less than 1.
△ Less
Submitted 7 December, 2023;
originally announced December 2023.
-
Almost-Linear Time Algorithms for Incremental Graphs: Cycle Detection, SCCs, $s$-$t$ Shortest Path, and Minimum-Cost Flow
Authors:
Li Chen,
Rasmus Kyng,
Yang P. Liu,
Simon Meierhans,
Maximilian Probst Gutenberg
Abstract:
We give the first almost-linear time algorithms for several problems in incremental graphs including cycle detection, strongly connected component maintenance, $s$-$t$ shortest path, maximum flow, and minimum-cost flow. To solve these problems, we give a deterministic data structure that returns a $m^{o(1)}$-approximate minimum-ratio cycle in fully dynamic graphs in amortized $m^{o(1)}$ time per u…
▽ More
We give the first almost-linear time algorithms for several problems in incremental graphs including cycle detection, strongly connected component maintenance, $s$-$t$ shortest path, maximum flow, and minimum-cost flow. To solve these problems, we give a deterministic data structure that returns a $m^{o(1)}$-approximate minimum-ratio cycle in fully dynamic graphs in amortized $m^{o(1)}$ time per update. Combining this with the interior point method framework of Brand-Liu-Sidford (STOC 2023) gives the first almost-linear time algorithm for deciding the first update in an incremental graph after which the cost of the minimum-cost flow attains value at most some given threshold $F$. By rather direct reductions to minimum-cost flow, we are then able to solve the problems in incremental graphs mentioned above.
At a high level, our algorithm dynamizes the $\ell_1$ oblivious routing of Rozhoň-Grunau-Haeupler-Zuzic-Li (STOC 2022), and develops a method to extract an approximate minimum ratio cycle from the structure of the oblivious routing. To maintain the oblivious routing, we use tools from concurrent work of Kyng-Meierhans-Probst Gutenberg which designed vertex sparsifiers for shortest paths, in order to maintain a sparse neighborhood cover in fully dynamic graphs.
To find a cycle, we first show that an approximate minimum ratio cycle can be represented as a fundamental cycle on a small set of trees resulting from the oblivious routing. Then, we find a cycle whose quality is comparable to the best tree cycle. This final cycle query step involves vertex and edge sparsification procedures reminiscent of previous works, but crucially requires a more powerful dynamic spanner which can handle far more edge insertions. We build such a spanner via a construction that hearkens back to the classic greedy spanner algorithm.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Sparsifying generalized linear models
Authors:
Arun Jambulapati,
James R. Lee,
Yang P. Liu,
Aaron Sidford
Abstract:
We consider the sparsification of sums $F : \mathbb{R}^n \to \mathbb{R}$ where $F(x) = f_1(\langle a_1,x\rangle) + \cdots + f_m(\langle a_m,x\rangle)$ for vectors $a_1,\ldots,a_m \in \mathbb{R}^n$ and functions $f_1,\ldots,f_m : \mathbb{R} \to \mathbb{R}_+$. We show that $(1+\varepsilon)$-approximate sparsifiers of $F$ with support size…
▽ More
We consider the sparsification of sums $F : \mathbb{R}^n \to \mathbb{R}$ where $F(x) = f_1(\langle a_1,x\rangle) + \cdots + f_m(\langle a_m,x\rangle)$ for vectors $a_1,\ldots,a_m \in \mathbb{R}^n$ and functions $f_1,\ldots,f_m : \mathbb{R} \to \mathbb{R}_+$. We show that $(1+\varepsilon)$-approximate sparsifiers of $F$ with support size $\frac{n}{\varepsilon^2} (\log \frac{n}{\varepsilon})^{O(1)}$ exist whenever the functions $f_1,\ldots,f_m$ are symmetric, monotone, and satisfy natural growth bounds. Additionally, we give efficient algorithms to compute such a sparsifier assuming each $f_i$ can be evaluated efficiently.
Our results generalize the classic case of $\ell_p$ sparsification, where $f_i(z) = |z|^p$, for $p \in (0, 2]$, and give the first near-linear size sparsifiers in the well-studied setting of the Huber loss function and its generalizations, e.g., $f_i(z) = \min\{|z|^p, |z|^2\}$ for $0 < p \leq 2$. Our sparsification algorithm can be applied to give near-optimal reductions for optimizing a variety of generalized linear models including $\ell_p$ regression for $p \in (1, 2]$ to high accuracy, via solving $(\log n)^{O(1)}$ sparse regression instances with $m \le n(\log n)^{O(1)}$, plus runtime proportional to the number of nonzero entries in the vectors $a_1, \dots, a_m$.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
Incremental Approximate Maximum Flow on Undirected Graphs in Subpolynomial Update Time
Authors:
Jan van den Brand,
Li Chen,
Rasmus Kyng,
Yang P. Liu,
Richard Peng,
Maximilian Probst Gutenberg,
Sushant Sachdeva,
Aaron Sidford
Abstract:
We provide an algorithm which, with high probability, maintains a $(1-ε)$-approximate maximum flow on an undirected graph undergoing $m$-edge additions in amortized $m^{o(1)} ε^{-3}$ time per update. To obtain this result, we provide a more general algorithm that solves what we call the incremental, thresholded $p$-norm flow problem that asks to determine the first edge-insertion in an undirected…
▽ More
We provide an algorithm which, with high probability, maintains a $(1-ε)$-approximate maximum flow on an undirected graph undergoing $m$-edge additions in amortized $m^{o(1)} ε^{-3}$ time per update. To obtain this result, we provide a more general algorithm that solves what we call the incremental, thresholded $p$-norm flow problem that asks to determine the first edge-insertion in an undirected graph that causes the minimum $\ell_p$-norm flow to decrease below a given threshold in value. Since we solve this thresholded problem, our data structure succeeds against an adaptive adversary that can only see the data structure's output. Furthermore, since our algorithm holds for $p = 2$, we obtain improved algorithms for dynamically maintaining the effective resistance between a pair of vertices in an undirected graph undergoing edge insertions.
Our algorithm builds upon previous dynamic algorithms for approximately solving the minimum-ratio cycle problem that underlie previous advances on the maximum flow problem [Chen-Kyng-Liu-Peng-Probst Gutenberg-Sachdeva, FOCS '22] as well as recent dynamic maximum flow algorithms [v.d.Brand-Liu-Sidford, STOC '23]. Instead of using interior point methods, which were a key component of these recent advances, our algorithm uses an optimization method based on $\ell_p$-norm iterative refinement and the multiplicative weight update method. This ensures a monotonicity property in the minimum-ratio cycle subproblems that allows us to apply known data structures and bypass issues arising from adaptive queries.
△ Less
Submitted 6 November, 2023;
originally announced November 2023.
-
A Deterministic Almost-Linear Time Algorithm for Minimum-Cost Flow
Authors:
Jan van den Brand,
Li Chen,
Rasmus Kyng,
Yang P. Liu,
Richard Peng,
Maximilian Probst Gutenberg,
Sushant Sachdeva,
Aaron Sidford
Abstract:
We give a deterministic $m^{1+o(1)}$ time algorithm that computes exact maximum flows and minimum-cost flows on directed graphs with $m$ edges and polynomially bounded integral demands, costs, and capacities. As a consequence, we obtain the first running time improvement for deterministic algorithms that compute maximum-flow in graphs with polynomial bounded capacities since the work of Goldberg-R…
▽ More
We give a deterministic $m^{1+o(1)}$ time algorithm that computes exact maximum flows and minimum-cost flows on directed graphs with $m$ edges and polynomially bounded integral demands, costs, and capacities. As a consequence, we obtain the first running time improvement for deterministic algorithms that compute maximum-flow in graphs with polynomial bounded capacities since the work of Goldberg-Rao [J.ACM '98].
Our algorithm builds on the framework of Chen-Kyng-Liu-Peng-Gutenberg-Sachdeva [FOCS '22] that computes an optimal flow by computing a sequence of $m^{1+o(1)}$-approximate undirected minimum-ratio cycles. We develop a deterministic dynamic graph data-structure to compute such a sequence of minimum-ratio cycles in an amortized $m^{o(1)}$ time per edge update. Our key technical contributions are deterministic analogues of the vertex sparsification and edge sparsification components of the data-structure from Chen et al. For the vertex sparsification component, we give a method to avoid the randomness in Chen et al. which involved sampling random trees to recurse on. For the edge sparsification component, we design a deterministic algorithm that maintains an embedding of a dynamic graph into a sparse spanner. We also show how our dynamic spanner can be applied to give a deterministic data structure that maintains a fully dynamic low-stretch spanning tree on graphs with polynomially bounded edge lengths, with subpolynomial average stretch and subpolynomial amortized time per edge update.
△ Less
Submitted 28 September, 2023;
originally announced September 2023.
-
Sparsifying sums of norms
Authors:
Arun Jambulapati,
James R. Lee,
Yang P. Liu,
Aaron Sidford
Abstract:
For any norms $N_1,\ldots,N_m$ on $\mathbb{R}^n$ and $N(x) := N_1(x)+\cdots+N_m(x)$, we show there is a sparsified norm $\tilde{N}(x) = w_1 N_1(x) + \cdots + w_m N_m(x)$ such that $|N(x) - \tilde{N}(x)| \leq εN(x)$ for all $x \in \mathbb{R}^n$, where $w_1,\ldots,w_m$ are non-negative weights, of which only $O(ε^{-2} n \log(n/ε) (\log n)^{2.5} )$ are non-zero.
Additionally, if $N$ is…
▽ More
For any norms $N_1,\ldots,N_m$ on $\mathbb{R}^n$ and $N(x) := N_1(x)+\cdots+N_m(x)$, we show there is a sparsified norm $\tilde{N}(x) = w_1 N_1(x) + \cdots + w_m N_m(x)$ such that $|N(x) - \tilde{N}(x)| \leq εN(x)$ for all $x \in \mathbb{R}^n$, where $w_1,\ldots,w_m$ are non-negative weights, of which only $O(ε^{-2} n \log(n/ε) (\log n)^{2.5} )$ are non-zero.
Additionally, if $N$ is $\mathrm{poly}(n)$-equivalent to the Euclidean norm on $\mathbb{R}^n$, then such weights can be found with high probability in time $O(m (\log n)^{O(1)} + \mathrm{poly}(n)) T$, where $T$ is the time required to evaluate a norm $N_i$. This immediately yields analogous statements for sparsifying sums of symmetric submodular functions. More generally, we show how to sparsify sums of $p$th powers of norms when the sum is $p$-uniformly smooth.
△ Less
Submitted 30 November, 2023; v1 submitted 15 May, 2023;
originally announced May 2023.
-
Dynamic Maxflow via Dynamic Interior Point Methods
Authors:
Jan van den Brand,
Yang P. Liu,
Aaron Sidford
Abstract:
In this paper we provide an algorithm for maintaining a $(1-ε)$-approximate maximum flow in a dynamic, capacitated graph undergoing edge additions. Over a sequence of $m$-additions to an $n$-node graph where every edge has capacity $O(\mathrm{poly}(m))$ our algorithm runs in time $\widehat{O}(m \sqrt{n} \cdot ε^{-1})$. To obtain this result we design dynamic data structures for the more general pr…
▽ More
In this paper we provide an algorithm for maintaining a $(1-ε)$-approximate maximum flow in a dynamic, capacitated graph undergoing edge additions. Over a sequence of $m$-additions to an $n$-node graph where every edge has capacity $O(\mathrm{poly}(m))$ our algorithm runs in time $\widehat{O}(m \sqrt{n} \cdot ε^{-1})$. To obtain this result we design dynamic data structures for the more general problem of detecting when the value of the minimum cost circulation in a dynamic graph undergoing edge additions obtains value at most $F$ (exactly) for a given threshold $F$. Over a sequence $m$-additions to an $n$-node graph where every edge has capacity $O(\mathrm{poly}(m))$ and cost $O(\mathrm{poly}(m))$ we solve this thresholded minimum cost flow problem in $\widehat{O}(m \sqrt{n})$. Both of our algorithms succeed with high probability against an adaptive adversary. We obtain these results by dynamizing the recent interior point method used to obtain an almost linear time algorithm for minimum cost flow (Chen, Kyng, Liu, Peng, Probst Gutenberg, Sachdeva 2022), and introducing a new dynamic data structure for maintaining minimum ratio cycles in an undirected graph that succeeds with high probability against adaptive adversaries.
△ Less
Submitted 12 December, 2022;
originally announced December 2022.
-
Chaining, Group Leverage Score Overestimates, and Fast Spectral Hypergraph Sparsification
Authors:
Arun Jambulapati,
Yang P. Liu,
Aaron Sidford
Abstract:
We present an algorithm that given any $n$-vertex, $m$-edge, rank $r$ hypergraph constructs a spectral sparsifier with $O(n \varepsilon^{-2} \log n \log r)$ hyperedges in nearly-linear $\widetilde{O}(mr)$ time. This improves in both size and efficiency over a line of work (Bansal-Svensson-Trevisan 2019, Kapralov-Krauthgamer-Tardos-Yoshida 2021) for which the previous best size was…
▽ More
We present an algorithm that given any $n$-vertex, $m$-edge, rank $r$ hypergraph constructs a spectral sparsifier with $O(n \varepsilon^{-2} \log n \log r)$ hyperedges in nearly-linear $\widetilde{O}(mr)$ time. This improves in both size and efficiency over a line of work (Bansal-Svensson-Trevisan 2019, Kapralov-Krauthgamer-Tardos-Yoshida 2021) for which the previous best size was $O(\min\{n \varepsilon^{-4} \log^3 n,nr^3 \varepsilon^{-2} \log n\})$ and runtime was $\widetilde{O}(mr + n^{O(1)})$.
Independent Result: In an independent work, Lee (Lee 2022) also shows how to compute a spectral hypergraph sparsifier with $O(n \varepsilon^{-2} \log n \log r)$ hyperedges.
△ Less
Submitted 21 September, 2022;
originally announced September 2022.
-
Exponential Convergence of Sinkhorn Under Regularization Scheduling
Authors:
**gbang Chen,
Li Chen,
Yang P. Liu,
Richard Peng,
Arvind Ramaswami
Abstract:
In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we work on understanding the Sinkhorn algorithm under regularization scheduling, and thus modify it with a mechanism that adaptively doubles the regularization parame…
▽ More
In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we work on understanding the Sinkhorn algorithm under regularization scheduling, and thus modify it with a mechanism that adaptively doubles the regularization parameter $η$ periodically. We prove that such modified version of Sinkhorn has an exponential convergence rate as iteration complexity depending on $\log(1/\varepsilon)$ instead of $\varepsilon^{-O(1)}$ from previous analyses [Cut13][ANWR17] in the optimal transport problems with integral supply and demand. Furthermore, with cost and capacity scaling procedures, the general optimal transport problem can be solved with a logarithmic dependence on $1/\varepsilon$ as well.
△ Less
Submitted 4 April, 2023; v1 submitted 2 July, 2022;
originally announced July 2022.
-
Optimal Sublinear Sampling of Spanning Trees and Determinantal Point Processes via Average-Case Entropic Independence
Authors:
Nima Anari,
Yang P. Liu,
Thuy-Duong Vuong
Abstract:
We design fast algorithms for repeatedly sampling from strongly Rayleigh distributions, which include random spanning tree distributions and determinantal point processes. For a graph $G=(V, E)$, we show how to approximately sample uniformly random spanning trees from $G$ in $\widetilde{O}(\lvert V\rvert)$ time per sample after an initial $\widetilde{O}(\lvert E\rvert)$ time preprocessing. For a d…
▽ More
We design fast algorithms for repeatedly sampling from strongly Rayleigh distributions, which include random spanning tree distributions and determinantal point processes. For a graph $G=(V, E)$, we show how to approximately sample uniformly random spanning trees from $G$ in $\widetilde{O}(\lvert V\rvert)$ time per sample after an initial $\widetilde{O}(\lvert E\rvert)$ time preprocessing. For a determinantal point process on subsets of size $k$ of a ground set of $n$ elements, we show how to approximately sample in $\widetilde{O}(k^ω)$ time after an initial $\widetilde{O}(nk^{ω-1})$ time preprocessing, where $ω<2.372864$ is the matrix multiplication exponent. We even improve the state of the art for obtaining a single sample from determinantal point processes, from the prior runtime of $\widetilde{O}(\min\{nk^2, n^ω\})$ to $\widetilde{O}(nk^{ω-1})$.
In our main technical result, we achieve the optimal limit on domain sparsification for strongly Rayleigh distributions. In domain sparsification, sampling from a distribution $μ$ on $\binom{[n]}{k}$ is reduced to sampling from related distributions on $\binom{[t]}{k}$ for $t\ll n$. We show that for strongly Rayleigh distributions, we can can achieve the optimal $t=\widetilde{O}(k)$. Our reduction involves sampling from $\widetilde{O}(1)$ domain-sparsified distributions, all of which can be produced efficiently assuming convenient access to approximate overestimates for marginals of $μ$. Having access to marginals is analogous to having access to the mean and covariance of a continuous distribution, or knowing "isotropy" for the distribution, the key assumption behind the Kannan-Lovász-Simonovits (KLS) conjecture and optimal samplers based on it. We view our result as a moral analog of the KLS conjecture and its consequences for sampling, for discrete strongly Rayleigh measures.
△ Less
Submitted 18 September, 2022; v1 submitted 6 April, 2022;
originally announced April 2022.
-
Maximum Flow and Minimum-Cost Flow in Almost-Linear Time
Authors:
Li Chen,
Rasmus Kyng,
Yang P. Liu,
Richard Peng,
Maximilian Probst Gutenberg,
Sushant Sachdeva
Abstract:
We give an algorithm that computes exact maximum flows and minimum-cost flows on directed graphs with $m$ edges and polynomially bounded integral demands, costs, and capacities in $m^{1+o(1)}$ time. Our algorithm builds the flow through a sequence of $m^{1+o(1)}$ approximate undirected minimum-ratio cycles, each of which is computed and processed in amortized $m^{o(1)}$ time using a new dynamic gr…
▽ More
We give an algorithm that computes exact maximum flows and minimum-cost flows on directed graphs with $m$ edges and polynomially bounded integral demands, costs, and capacities in $m^{1+o(1)}$ time. Our algorithm builds the flow through a sequence of $m^{1+o(1)}$ approximate undirected minimum-ratio cycles, each of which is computed and processed in amortized $m^{o(1)}$ time using a new dynamic graph data structure.
Our framework extends to algorithms running in $m^{1+o(1)}$ time for computing flows that minimize general edge-separable convex functions to high accuracy. This gives almost-linear time algorithms for several problems including entropy-regularized optimal transport, matrix scaling, $p$-norm flows, and $p$-norm isotonic regression on arbitrary directed acyclic graphs.
△ Less
Submitted 22 April, 2022; v1 submitted 1 March, 2022;
originally announced March 2022.
-
Faster Maxflow via Improved Dynamic Spectral Vertex Sparsifiers
Authors:
Jan van den Brand,
Yu Gao,
Arun Jambulapati,
Yin Tat Lee,
Yang P. Liu,
Richard Peng,
Aaron Sidford
Abstract:
We make several advances broadly related to the maintenance of electrical flows in weighted graphs undergoing dynamic resistance updates, including:
1. More efficient dynamic spectral vertex sparsification, achieved by faster length estimation of random walks in weighted graphs using Morris counters [Morris 1978, Nelson-Yu 2020].
2. A direct reduction from detecting edges with large energy in…
▽ More
We make several advances broadly related to the maintenance of electrical flows in weighted graphs undergoing dynamic resistance updates, including:
1. More efficient dynamic spectral vertex sparsification, achieved by faster length estimation of random walks in weighted graphs using Morris counters [Morris 1978, Nelson-Yu 2020].
2. A direct reduction from detecting edges with large energy in dynamic electric flows to dynamic spectral vertex sparsifiers.
3. A procedure for turning algorithms for estimating a sequence of vectors under updates from an oblivious adversary to one that tolerates adaptive adversaries via the Gaussian-mechanism from differential privacy.
Combining these pieces with modifications to prior robust interior point frameworks gives an algorithm that on graphs with $m$ edges computes a mincost flow with edge costs and capacities in $[1, U]$ in time $\widetilde{O}(m^{3/2-1/58} \log^2 U)$. In prior and independent work, [Axiotis-Mądry-Vladu FOCS 2021] also obtained an improved algorithm for sparse mincost flows on capacitated graphs. Our algorithm implies a $\widetilde{O}(m^{3/2-1/58} \log U)$ time maxflow algorithm, improving over the $\widetilde{O}(m^{3/2-1/328}\log U)$ time maxflow algorithm of [Gao-Liu-Peng FOCS 2021].
△ Less
Submitted 1 December, 2021;
originally announced December 2021.
-
Improved Iteration Complexities for Overconstrained $p$-Norm Regression
Authors:
Arun Jambulapati,
Yang P. Liu,
Aaron Sidford
Abstract:
In this paper we obtain improved iteration complexities for solving $\ell_p$ regression. We provide methods which given any full-rank $\mathbf{A} \in \mathbb{R}^{n \times d}$ with $n \geq d$, $b \in \mathbb{R}^n$, and $p \geq 2$ solve $\min_{x \in \mathbb{R}^d} \left\|\mathbf{A} x - b\right\|_p$ to high precision in time dominated by that of solving $\widetilde{O}_p(d^{\frac{p-2}{3p-2}})$ linear s…
▽ More
In this paper we obtain improved iteration complexities for solving $\ell_p$ regression. We provide methods which given any full-rank $\mathbf{A} \in \mathbb{R}^{n \times d}$ with $n \geq d$, $b \in \mathbb{R}^n$, and $p \geq 2$ solve $\min_{x \in \mathbb{R}^d} \left\|\mathbf{A} x - b\right\|_p$ to high precision in time dominated by that of solving $\widetilde{O}_p(d^{\frac{p-2}{3p-2}})$ linear systems in $\mathbf{A}^\top \mathbf{D} \mathbf{A}$ for positive diagonal matrices $\mathbf{D}$. This improves upon the previous best iteration complexity of $\widetilde{O}_p(n^{\frac{p-2}{3p-2}})$ (Adil, Kyng, Peng, Sachdeva 2019). As a corollary, we obtain an $\widetilde{O}(d^{1/3}ε^{-2/3})$ iteration complexity for approximate $\ell_\infty$ regression. Further, for $q \in (1, 2]$ and dual norm $q = p/(p-1)$ we provide an algorithm that solves $\ell_q$ regression in $\widetilde{O}(d^{\frac{p-2}{2p-2}})$ iterations.
To obtain this result we analyze row reweightings (closely inspired by $\ell_p$-norm Lewis weights) which allow a closer connection between $\ell_2$ and $\ell_p$ regression. We provide adaptations of two different iterative optimization frameworks which leverage this connection and yield our results. The first framework is based on iterative refinement and multiplicative weights based width reduction and the second framework is based on highly smooth acceleration. Both approaches yield $\widetilde{O}_p(d^{\frac{p-2}{3p-2}})$ iteration methods but the second has a polynomial dependence on $p$ (as opposed to the exponential dependence of the first algorithm) and provides a new alternative to the previous state-of-the-art methods for $\ell_p$ regression for large $p$.
△ Less
Submitted 10 November, 2021; v1 submitted 2 November, 2021;
originally announced November 2021.
-
Online Edge Coloring via Tree Recurrences and Correlation Decay
Authors:
Janardhan Kulkarni,
Yang P. Liu,
Ashwin Sah,
Mehtaab Sawhney,
Jakub Tarnawski
Abstract:
We give an online algorithm that with high probability computes a $\left(\frac{e}{e-1} + o(1)\right)Δ$ edge coloring on a graph $G$ with maximum degree $Δ= ω(\log n)$ under online edge arrivals against oblivious adversaries, making first progress on the conjecture of Bar-Noy, Motwani, and Naor in this general setting. Our algorithm is based on reducing to a matching problem on locally treelike gra…
▽ More
We give an online algorithm that with high probability computes a $\left(\frac{e}{e-1} + o(1)\right)Δ$ edge coloring on a graph $G$ with maximum degree $Δ= ω(\log n)$ under online edge arrivals against oblivious adversaries, making first progress on the conjecture of Bar-Noy, Motwani, and Naor in this general setting. Our algorithm is based on reducing to a matching problem on locally treelike graphs, and then applying a tree recurrences based approach for arguing correlation decay.
△ Less
Submitted 1 November, 2021;
originally announced November 2021.
-
A Gaussian fixed point random walk
Authors:
Yang P. Liu,
Ashwin Sah,
Mehtaab Sawhney
Abstract:
In this note, we design a discrete random walk on the real line which takes steps $0, \pm 1$ (and one with steps in $\{\pm 1, 2\}$) where at least $96\%$ of the signs are $\pm 1$ in expectation, and which has $\mathcal{N}(0,1)$ as a stationary distribution. As an immediate corollary, we obtain an online version of Banaszczyk's discrepancy result for partial colorings and $\pm 1, 2$ signings. Addit…
▽ More
In this note, we design a discrete random walk on the real line which takes steps $0, \pm 1$ (and one with steps in $\{\pm 1, 2\}$) where at least $96\%$ of the signs are $\pm 1$ in expectation, and which has $\mathcal{N}(0,1)$ as a stationary distribution. As an immediate corollary, we obtain an online version of Banaszczyk's discrepancy result for partial colorings and $\pm 1, 2$ signings. Additionally, we recover linear time algorithms for logarithmic bounds for the Komlós conjecture in an oblivious online setting.
△ Less
Submitted 14 April, 2021;
originally announced April 2021.
-
Arithmetic Progressions in Sumsets of Sparse Sets
Authors:
Noga Alon,
Ryan Alweiss,
Yang P. Liu,
Anders Martinsson,
Shyam Narayanan
Abstract:
A set of positive integers $A \subset \mathbb{Z}_{> 0}$ is \emph{log-sparse} if there is an absolute constant $C$ so that for any positive integer $x$ the sequence contains at most $C$ elements in the interval $[x,2x)$. In this note we study arithmetic progressions in sums of log-sparse subsets of $\mathbb{Z}_{> 0}$. We prove that for any log-sparse subsets $S_1, \dots, S_n$ of…
▽ More
A set of positive integers $A \subset \mathbb{Z}_{> 0}$ is \emph{log-sparse} if there is an absolute constant $C$ so that for any positive integer $x$ the sequence contains at most $C$ elements in the interval $[x,2x)$. In this note we study arithmetic progressions in sums of log-sparse subsets of $\mathbb{Z}_{> 0}$. We prove that for any log-sparse subsets $S_1, \dots, S_n$ of $\mathbb{Z}_{> 0},$ the sumset $S = S_1 + \cdots + S_n$ cannot contain an arithmetic progression of size greater than $n^{(1+o(1))n}.$ We also show that this is nearly tight by proving that there exist log-sparse sets $S_1, \dots, S_n$ such that $S_1 + \cdots + S_n$ contains an arithmetic progression of size $n^{(1-o(1)) n}.$
△ Less
Submitted 18 April, 2021; v1 submitted 4 April, 2021;
originally announced April 2021.
-
Room-temperature colossal magnetoresistance in terraced single-layer graphene
Authors:
J. X. Hu,
J. Gou,
M. Yang,
G. J. Omar,
J. Y. Tan,
S. W. Zeng,
Y. P. Liu,
K. Han,
Z. S. Lim,
Z. Huang,
A. T. S. Wee,
A. Ariando
Abstract:
Disorder-induced magnetoresistance (MR) effect is quadratic at low perpendicular magnetic fields and linear at high fields. This effect is technologically appealing, especially in the two-dimensional (2D) materials such as graphene, since it offers potential applications in magnetic sensors with nanoscale spatial resolution. However, it is a great challenge to realize a graphene magnetic sensor ba…
▽ More
Disorder-induced magnetoresistance (MR) effect is quadratic at low perpendicular magnetic fields and linear at high fields. This effect is technologically appealing, especially in the two-dimensional (2D) materials such as graphene, since it offers potential applications in magnetic sensors with nanoscale spatial resolution. However, it is a great challenge to realize a graphene magnetic sensor based on this effect because of the difficulty in controlling the spatial distribution of disorder and enhancing the MR sensitivity in the single-layer regime. Here, we report a room-temperature colossal MR of up to 5,000% at 9 T in terraced single-layer graphene. By laminating single-layer graphene on a terraced substrate, such as TiO2 terminated SrTiO3, we demonstrate a universal one order of magnitude enhancement in the MR compared to conventional single-layer graphene devices. Strikingly, a colossal MR of >1,000% was also achieved in the terraced graphene even at a high carrier density of ~1012 cm-2. Systematic studies of the MR of single-layer graphene on various oxide- and non-oxide-based terraced surfaces demonstrate that the terraced structure is the dominant factor driving the MR enhancement. Our results open a new route for tailoring the physical property of 2D materials by engineering the strain through a terraced substrate.
△ Less
Submitted 19 January, 2021;
originally announced January 2021.
-
Fully Dynamic Electrical Flows: Sparse Maxflow Faster Than Goldberg-Rao
Authors:
Yu Gao,
Yang P. Liu,
Richard Peng
Abstract:
We give an algorithm for computing exact maximum flows on graphs with $m$ edges and integer capacities in the range $[1, U]$ in $\widetilde{O}(m^{\frac{3}{2} - \frac{1}{328}} \log U)$ time. For sparse graphs with polynomially bounded integer capacities, this is the first improvement over the $\widetilde{O}(m^{1.5} \log U)$ time bound from [Goldberg-Rao JACM `98].
Our algorithm revolves around dy…
▽ More
We give an algorithm for computing exact maximum flows on graphs with $m$ edges and integer capacities in the range $[1, U]$ in $\widetilde{O}(m^{\frac{3}{2} - \frac{1}{328}} \log U)$ time. For sparse graphs with polynomially bounded integer capacities, this is the first improvement over the $\widetilde{O}(m^{1.5} \log U)$ time bound from [Goldberg-Rao JACM `98].
Our algorithm revolves around dynamically maintaining the augmenting electrical flows at the core of the interior point method based algorithm from [Mądry JACM `16]. This entails designing data structures that, in limited settings, return edges with large electric energy in a graph undergoing resistance updates.
△ Less
Submitted 9 June, 2021; v1 submitted 18 January, 2021;
originally announced January 2021.
-
Minimum Cost Flows, MDPs, and $\ell_1$-Regression in Nearly Linear Time for Dense Instances
Authors:
Jan van den Brand,
Yin Tat Lee,
Yang P. Liu,
Thatchaphol Saranurak,
Aaron Sidford,
Zhao Song,
Di Wang
Abstract:
In this paper we provide new randomized algorithms with improved runtimes for solving linear programs with two-sided constraints. In the special case of the minimum cost flow problem on $n$-vertex $m$-edge graphs with integer polynomially-bounded costs and capacities we obtain a randomized method which solves the problem in $\tilde{O}(m+n^{1.5})$ time. This improves upon the previous best runtime…
▽ More
In this paper we provide new randomized algorithms with improved runtimes for solving linear programs with two-sided constraints. In the special case of the minimum cost flow problem on $n$-vertex $m$-edge graphs with integer polynomially-bounded costs and capacities we obtain a randomized method which solves the problem in $\tilde{O}(m+n^{1.5})$ time. This improves upon the previous best runtime of $\tilde{O}(m\sqrt{n})$ (Lee-Sidford 2014) and, in the special case of unit-capacity maximum flow, improves upon the previous best runtimes of $m^{4/3+o(1)}$ (Liu-Sidford 2020, Kathuria 2020) and $\tilde{O}(m\sqrt{n})$ (Lee-Sidford 2014) for sufficiently dense graphs.
For $\ell_1$-regression in a matrix with $n$-columns and $m$-rows we obtain a randomized method which computes an $ε$-approximate solution in $\tilde{O}(mn+n^{2.5})$ time. This yields a randomized method which computes an $ε$-optimal policy of a discounted Markov Decision Process with $S$ states and $A$ actions per state in time $\tilde{O}(S^2A+S^{2.5})$. These methods improve upon the previous best runtimes of methods which depend polylogarithmically on problem parameters, which were $\tilde{O}(mn^{1.5})$ (Lee-Sidford 2015) and $\tilde{O}(S^{2.5}A)$ (Lee-Sidford 2014, Sidford-Wang-Wu-Ye 2018).
To obtain this result we introduce two new algorithmic tools of independent interest. First, we design a new general interior point method for solving linear programs with two sided constraints which combines techniques from (Lee-Song-Zhang 2019, Brand et al. 2020) to obtain a robust stochastic method with iteration count nearly the square root of the smaller dimension. Second, to implement this method we provide dynamic data structures for efficiently maintaining approximations to variants of Lewis-weights, a fundamental importance measure for matrices which generalize leverage scores and effective resistances.
△ Less
Submitted 21 August, 2021; v1 submitted 14 January, 2021;
originally announced January 2021.
-
Minor Sparsifiers and the Distributed Laplacian Paradigm
Authors:
Sebastian Forster,
Gramoz Goranci,
Yang P. Liu,
Richard Peng,
Xiaorui Sun,
Mingquan Ye
Abstract:
We study distributed algorithms built around minor-based vertex sparsifiers, and give the first algorithm in the CONGEST model for solving linear systems in graph Laplacian matrices to high accuracy. Our Laplacian solver has a round complexity of $O(n^{o(1)}(\sqrt{n}+D))$, and thus almost matches the lower bound of $\widetildeΩ(\sqrt{n}+D)$, where $n$ is the number of nodes in the network and $D$…
▽ More
We study distributed algorithms built around minor-based vertex sparsifiers, and give the first algorithm in the CONGEST model for solving linear systems in graph Laplacian matrices to high accuracy. Our Laplacian solver has a round complexity of $O(n^{o(1)}(\sqrt{n}+D))$, and thus almost matches the lower bound of $\widetildeΩ(\sqrt{n}+D)$, where $n$ is the number of nodes in the network and $D$ is its diameter.
We show that our distributed solver yields new sublinear round algorithms for several cornerstone problems in combinatorial optimization. This is achieved by leveraging the powerful algorithmic framework of Interior Point Methods (IPMs) and the Laplacian paradigm in the context of distributed graph algorithms, which entails numerically solving optimization problems on graphs via a series of Laplacian systems. Problems that benefit from our distributed algorithmic paradigm include exact mincost flow, negative weight shortest paths, maxflow, and bipartite matching on sparse directed graphs. For the maxflow problem, this is the first exact distributed algorithm that applies to directed graphs, while the previous work by [Ghaffari et al. SICOMP'18] considered the approximate setting and works only for undirected graphs. For the mincost flow and the negative weight shortest path problems, our results constitute the first exact distributed algorithms running in a sublinear number of rounds. Given that the hybrid between IPMs and the Laplacian paradigm has proven useful for tackling numerous optimization problems in the centralized setting, we believe that our distributed solver will find future applications.
△ Less
Submitted 5 February, 2022; v1 submitted 31 December, 2020;
originally announced December 2020.
-
Vertex Sparsification for Edge Connectivity in Polynomial Time
Authors:
Yang P. Liu
Abstract:
An important open question in the area of vertex sparsification is whether $(1+ε)$-approximate cut-preserving vertex sparsifiers with size close to the number of terminals exist. The work Chalermsook et al. (SODA 2021) introduced a relaxation called connectivity-$c$ mimicking networks, which asks to construct a vertex sparsifier which preserves connectivity among $k$ terminals exactly up to the va…
▽ More
An important open question in the area of vertex sparsification is whether $(1+ε)$-approximate cut-preserving vertex sparsifiers with size close to the number of terminals exist. The work Chalermsook et al. (SODA 2021) introduced a relaxation called connectivity-$c$ mimicking networks, which asks to construct a vertex sparsifier which preserves connectivity among $k$ terminals exactly up to the value of $c$, and showed applications to dynamic connectivity data structures and survivable network design. We show that connectivity-$c$ mimicking networks with $\widetilde{O}(kc^3)$ edges exist and can be constructed in polynomial time in $n$ and $c$, improving over the results of Chalermsook et al. (SODA 2021) for any $c \ge \log n$, whose runtimes depended exponentially on $c$.
△ Less
Submitted 14 January, 2021; v1 submitted 30 November, 2020;
originally announced November 2020.
-
Vertex Sparsification for Edge Connectivity
Authors:
Parinya Chalermsook,
Syamantak Das,
Bundit Laekhanukit,
Yunbum Kook,
Yang P. Liu,
Richard Peng,
Mark Sellke,
Daniel Vaz
Abstract:
Graph compression or sparsification is a basic information-theoretic and computational question. A major open problem in this research area is whether $(1+ε)$-approximate cut-preserving vertex sparsifiers with size close to the number of terminals exist. As a step towards this goal, we study a thresholded version of the problem: for a given parameter $c$, find a smaller graph, which we call connec…
▽ More
Graph compression or sparsification is a basic information-theoretic and computational question. A major open problem in this research area is whether $(1+ε)$-approximate cut-preserving vertex sparsifiers with size close to the number of terminals exist. As a step towards this goal, we study a thresholded version of the problem: for a given parameter $c$, find a smaller graph, which we call connectivity-$c$ mimicking network, which preserves connectivity among $k$ terminals exactly up to the value of $c$. We show that connectivity-$c$ mimicking networks with $O(kc^4)$ edges exist and can be found in time $m(c\log n)^{O(c)}$. We also give a separate algorithm that constructs such graphs with $k \cdot O(c)^{2c}$ edges in time $mc^{O(c)}\log^{O(1)}n$. These results lead to the first data structures for answering fully dynamic offline $c$-edge-connectivity queries for $c \ge 4$ in polylogarithmic time per query, as well as more efficient algorithms for survivable network design on bounded treewidth graphs.
△ Less
Submitted 15 July, 2020;
originally announced July 2020.
-
Discrepancy Minimization via a Self-Balancing Walk
Authors:
Ryan Alweiss,
Yang P. Liu,
Mehtaab Sawhney
Abstract:
We study discrepancy minimization for vectors in $\mathbb{R}^n$ under various settings. The main result is the analysis of a new simple random process in multiple dimensions through a comparison argument. As corollaries, we obtain bounds which are tight up to logarithmic factors for several problems in online vector balancing posed by Bansal, Jiang, Singla, and Sinha (STOC 2020), as well as linear…
▽ More
We study discrepancy minimization for vectors in $\mathbb{R}^n$ under various settings. The main result is the analysis of a new simple random process in multiple dimensions through a comparison argument. As corollaries, we obtain bounds which are tight up to logarithmic factors for several problems in online vector balancing posed by Bansal, Jiang, Singla, and Sinha (STOC 2020), as well as linear time algorithms for logarithmic bounds for the Komlós conjecture.
△ Less
Submitted 6 August, 2020; v1 submitted 24 June, 2020;
originally announced June 2020.
-
Faster Divergence Maximization for Faster Maximum Flow
Authors:
Yang P. Liu,
Aaron Sidford
Abstract:
In this paper we provide an algorithm which given any $m$-edge $n$-vertex directed graph with integer capacities at most $U$ computes a maximum $s$-$t$ flow for any vertices $s$ and $t$ in $m^{4/3+o(1)}U^{1/3}$ time. This improves upon the previous best running times of $m^{11/8+o(1)}U^{1/4}$ (Liu Sidford 2019), $\tilde{O}(m \sqrt{n} \log U)$ (Lee Sidford 2014), and $O(mn)$ (Orlin 2013) when the g…
▽ More
In this paper we provide an algorithm which given any $m$-edge $n$-vertex directed graph with integer capacities at most $U$ computes a maximum $s$-$t$ flow for any vertices $s$ and $t$ in $m^{4/3+o(1)}U^{1/3}$ time. This improves upon the previous best running times of $m^{11/8+o(1)}U^{1/4}$ (Liu Sidford 2019), $\tilde{O}(m \sqrt{n} \log U)$ (Lee Sidford 2014), and $O(mn)$ (Orlin 2013) when the graph is not too dense or has large capacities.
To achieve the results this paper we build upon previous algorithmic approaches to maximum flow based on interior point methods (IPMs). In particular, we overcome a key bottleneck of previous advances in IPMs for maxflow (Mądry 2013, Mądry 2016, Liu Sidford 2019), which make progress by maximizing the energy of local $\ell_2$ norm minimizing electric flows. We generalize this approach and instead maximize the divergence of flows which minimize the Bregman divergence distance with respect to the weighted logarithmic barrier. This allows our algorithm to avoid dependencies on the $\ell_4$ norm that appear in other IPM frameworks (e.g. Cohen Mądry Sankowski Vladu 2017, Axiotis Mądry Vladu 2020). Further, we show that smoothed $\ell_2$-$\ell_p$ flows (Kyng, Peng, Sachdeva, Wang 2019), which we previously used to efficiently maximize energy (Liu Sidford 2019), can also be used to efficiently maximize divergence, thereby yielding our desired runtimes. We believe both this generalized view of energy maximization and generalized flow solvers we develop may be of further interest.
△ Less
Submitted 14 April, 2020; v1 submitted 19 March, 2020;
originally announced March 2020.
-
Faster Energy Maximization for Faster Maximum Flow
Authors:
Yang P. Liu,
Aaron Sidford
Abstract:
In this paper we provide an algorithm which given any $m$-edge $n$-vertex directed graph with integer capacities at most $U$ computes a maximum $s$-$t$ flow for any vertices $s$ and $t$ in $m^{11/8+o(1)}U^{1/4}$ time with high probability. This running time improves upon the previous best of $\tilde{O}(m^{10/7} U^{1/7})$ (Mądry 2016), $\tilde{O}(m \sqrt{n} \log U)$ (Lee Sidford 2014), and $O(mn)$…
▽ More
In this paper we provide an algorithm which given any $m$-edge $n$-vertex directed graph with integer capacities at most $U$ computes a maximum $s$-$t$ flow for any vertices $s$ and $t$ in $m^{11/8+o(1)}U^{1/4}$ time with high probability. This running time improves upon the previous best of $\tilde{O}(m^{10/7} U^{1/7})$ (Mądry 2016), $\tilde{O}(m \sqrt{n} \log U)$ (Lee Sidford 2014), and $O(mn)$ (Orlin 2013) when the graph is not too dense or has large capacities.
We achieve this result by leveraging recent advances in solving undirected flow problems on graphs. We show that in the maximum flow framework of (Mądry 2016) the problem of optimizing the amount of perturbation of the central path needed to maximize energy and thereby reduce congestion can be efficiently reduced to a smoothed $\ell_2$-$\ell_p$ flow optimization problem, which can be solved approximately via recent work (Kyng, Peng, Sachdeva, Wang 2019). Leveraging this new primitive, we provide a new long-step interior point method for maximum flow with faster convergence and simpler analysis that no longer needs global potential functions involving energy as in previous methods (Mądry 2013, Mądry 2016).
△ Less
Submitted 31 October, 2019;
originally announced October 2019.
-
Vertex Sparsifiers for c-Edge Connectivity
Authors:
Yang P. Liu,
Richard Peng,
Mark Sellke
Abstract:
We show the existence of O(f(c)k) sized vertex sparsifiers that preserve all edge-connectivity values up to c between a set of k terminal vertices, where f(c) is a function that only depends on c, the edge-connectivity value. This construction is algorithmic: we also provide an algorithm whose running time depends linearly on k, but exponentially in c. It implies that for constant values of c, an…
▽ More
We show the existence of O(f(c)k) sized vertex sparsifiers that preserve all edge-connectivity values up to c between a set of k terminal vertices, where f(c) is a function that only depends on c, the edge-connectivity value. This construction is algorithmic: we also provide an algorithm whose running time depends linearly on k, but exponentially in c. It implies that for constant values of c, an offline sequence of edge insertions/deletions and c-edge-connectivity queries can be answered in polylog time per operation. These results are obtained by combining structural results about minimum terminal separating cuts in undirected graphs with recent developments in expander decomposition based methods for finding small vertex/edge cuts in graphs.
△ Less
Submitted 23 October, 2019;
originally announced October 2019.
-
On the upper tail problem for random hypergraphs
Authors:
Yang P. Liu,
Yufei Zhao
Abstract:
The upper tail problem in a random graph asks to estimate the probability that the number of copies of some fixed subgraph in an Erdős--Rényi random graph exceeds its expectation by some constant factor. There has been much exciting recent progress on this problem.
We study the corresponding problem for hypergraphs, for which less is known about the large deviation rate. We present new phenomena…
▽ More
The upper tail problem in a random graph asks to estimate the probability that the number of copies of some fixed subgraph in an Erdős--Rényi random graph exceeds its expectation by some constant factor. There has been much exciting recent progress on this problem.
We study the corresponding problem for hypergraphs, for which less is known about the large deviation rate. We present new phenomena in upper tail large deviations for sparse random hypergraphs that are not seen in random graphs. We conjecture a formula for the large deviation rate, i.e., the first order asymptotics of the log-probability that the number of copies of fixed subgraph $H$ in a sparse Erdős--Rényi random $k$-uniform hypergraph exceeds its expectation by a constant factor. This conjecture turns out to be significantly more intricate compared to the case for graphs. We verify our conjecture when the fixed subgraph $H$ being counted is a clique, as well as when $H$ is the 3-uniform 6-vertex 4-edge hypergraph consisting of alternating faces of an octahedron, where new techniques are required.
△ Less
Submitted 24 October, 2020; v1 submitted 7 October, 2019;
originally announced October 2019.
-
Near-optimal Approximate Discrete and Continuous Submodular Function Minimization
Authors:
Brian Axelrod,
Yang P. Liu,
Aaron Sidford
Abstract:
In this paper we provide improved running times and oracle complexities for approximately minimizing a submodular function. Our main result is a randomized algorithm, which given any submodular function defined on $n$-elements with range $[-1, 1]$, computes an $ε$-additive approximate minimizer in $\tilde{O}(n/ε^2)$ oracle evaluations with high probability. This improves over the…
▽ More
In this paper we provide improved running times and oracle complexities for approximately minimizing a submodular function. Our main result is a randomized algorithm, which given any submodular function defined on $n$-elements with range $[-1, 1]$, computes an $ε$-additive approximate minimizer in $\tilde{O}(n/ε^2)$ oracle evaluations with high probability. This improves over the $\tilde{O}(n^{5/3}/ε^2)$ oracle evaluation algorithm of Chakrabarty \etal~(STOC 2017) and the $\tilde{O}(n^{3/2}/ε^2)$ oracle evaluation algorithm of Hamoudi \etal.
Further, we leverage a generalization of this result to obtain efficient algorithms for minimizing a broad class of nonconvex functions. For any function $f$ with domain $[0, 1]^n$ that satisfies $\frac{\partial^2f}{\partial x_i \partial x_j} \le 0$ for all $i \neq j$ and is $L$-Lipschitz with respect to the $L^\infty$-norm we give an algorithm that computes an $ε$-additive approximate minimizer with $\tilde{O}(n \cdot \mathrm{poly}(L/ε))$ function evaluation with high probability.
△ Less
Submitted 31 August, 2019;
originally announced September 2019.
-
Constant Girth Approximation for Directed Graphs in Subquadratic Time
Authors:
Shiri Chechik,
Yang P. Liu,
Omer Rotem,
Aaron Sidford
Abstract:
In this paper we provide a $\tilde{O}(m\sqrt{n})$ time algorithm that computes a $3$-multiplicative approximation of the girth of a $n$-node $m$-edge directed graph with non-negative edge lengths. This is the first algorithm which approximates the girth of a directed graph up to a constant multiplicative factor faster than All-Pairs Shortest Paths (APSP) time, i.e. $O(mn)$. Additionally, for any i…
▽ More
In this paper we provide a $\tilde{O}(m\sqrt{n})$ time algorithm that computes a $3$-multiplicative approximation of the girth of a $n$-node $m$-edge directed graph with non-negative edge lengths. This is the first algorithm which approximates the girth of a directed graph up to a constant multiplicative factor faster than All-Pairs Shortest Paths (APSP) time, i.e. $O(mn)$. Additionally, for any integer $k \ge 1$, we provide a deterministic algorithm for a $O(k\log\log n)$-multiplicative approximation to the girth in directed graphs in $\tilde{O}(m^{1+1/k})$ time. Combining the techniques from these two results gives us an algorithm for a $O(k\log k)$-multiplicative approximation to the girth in directed graphs in $\tilde{O}(m^{1+1/k})$ time. Our results naturally also provide algorithms for improved constructions of roundtrip spanners, the analog of spanners in directed graphs.
The previous fastest algorithms for these problems either ran in All-Pairs Shortest Paths (APSP) time, i.e. $O(mn)$, or were due Pachocki et al. (PRSTV18) which provided a randomized algorithm that for any integer $k \ge 1$ in time $\tilde{O}(m^{1+1/k})$ computed with high probability a $O(k\log n)$ multiplicative approximation of the girth. Our first algorithm constitutes the first sub-APSP-time algorithm for approximating the girth to constant accuracy, our second removes the need for randomness and improves the approximation factor in Pachocki et al. (PRSTV18), and our third is the first time versus quality trade-off for obtaining constant approximations.
△ Less
Submitted 14 April, 2020; v1 submitted 24 July, 2019;
originally announced July 2019.
-
Hybridization dynamics in CeCoIn5 revealed by ultrafast optical spectroscopy
Authors:
Y. P. Liu,
Y. J. Zhang,
J. J. Dong,
H. Lee,
Z. X. Wei,
W. L. Zhang,
C. Y. Chen,
H. Q. Yuan,
Y. -F. Yang,
J. Qi
Abstract:
We investigate the quasiparticle dynamics in the prototype heavy fermion CeCoIn$_5$ using ultrafast optical pump-probe spectroscopy. Our results indicate that this material system undergoes hybridization fluctuations before full establishment of the heavy electron coherence, as the temperature decreases from $\sim$120 K ($T^\dagger$) to $\sim$55 K ($T^*$ ). We reveal that the observed anomalous ph…
▽ More
We investigate the quasiparticle dynamics in the prototype heavy fermion CeCoIn$_5$ using ultrafast optical pump-probe spectroscopy. Our results indicate that this material system undergoes hybridization fluctuations before full establishment of the heavy electron coherence, as the temperature decreases from $\sim$120 K ($T^\dagger$) to $\sim$55 K ($T^*$ ). We reveal that the observed anomalous phonon softening and dam** reduction below $T^*$ are directly associated with opening of an indirect hybridization gap. We also discover a distinct collective mode with an energy of $\sim$8 meV, which may be the experimental evidence of the predicted unconventional density wave. Our observations provide critical informations for understanding the hybridization dynamics in heavy fermion materials.
△ Less
Submitted 10 February, 2020; v1 submitted 19 June, 2019;
originally announced June 2019.
-
Parallel Reachability in Almost Linear Work and Square Root Depth
Authors:
Arun Jambulapati,
Yang P. Liu,
Aaron Sidford
Abstract:
In this paper we provide a parallel algorithm that given any $n$-node $m$-edge directed graph and source vertex $s$ computes all vertices reachable from $s$ with $\tilde{O}(m)$ work and $n^{1/2 + o(1)}$ depth with high probability in $n$ . This algorithm also computes a set of $\tilde{O}(n)$ edges which when added to the graph preserves reachability and ensures that the diameter of the resulting g…
▽ More
In this paper we provide a parallel algorithm that given any $n$-node $m$-edge directed graph and source vertex $s$ computes all vertices reachable from $s$ with $\tilde{O}(m)$ work and $n^{1/2 + o(1)}$ depth with high probability in $n$ . This algorithm also computes a set of $\tilde{O}(n)$ edges which when added to the graph preserves reachability and ensures that the diameter of the resulting graph is at most $n^{1/2 + o(1)}$. Our result improves upon the previous best known almost linear work reachability algorithm due to Fineman which had depth $\tilde{O}(n^{2/3})$.
Further, we show how to leverage this algorithm to achieve improved distributed algorithms for single source reachability in the CONGEST model. In particular, we provide a distributed algorithm that given a $n$-node digraph of undirected hop-diameter $D$ solves the single source reachability problem with $\tilde{O}(n^{1/2} + n^{1/3 + o(1)} D^{2/3})$ rounds of the communication in the CONGEST model with high probability in $n$. Our algorithm is nearly optimal whenever $D = O(n^{1/4 - ε})$ for any constant $ε> 0$ and is the first nearly optimal algorithm for general graphs whose diameter is $Ω(n^δ)$ for any constant $δ$.
△ Less
Submitted 5 December, 2019; v1 submitted 21 May, 2019;
originally announced May 2019.
-
Chiral terahertz wave emission from the Weyl semimetal TaAs
Authors:
Y. Gao,
Y. Qin,
Sahal Kaushik,
Evan J. Philip,
Y. P. Liu,
Y. L. Su,
X. Chen,
Z. Li,
H. Weng,
Dmitri E. Kharzeev,
M. K. Liu,
J. Qi
Abstract:
As a fascinating topological phase of matter, Weyl semimetals host chiral fermions with distinct chiralities and spin textures. Optical excitations involving those chiral fermions can induce exotic carrier responses, and in turn lead to novel optical phenomena. Here, we discover strong coherent chiral terahertz emission from the Weyl semimetal TaAs and demonstrate unprecedented manipulation over i…
▽ More
As a fascinating topological phase of matter, Weyl semimetals host chiral fermions with distinct chiralities and spin textures. Optical excitations involving those chiral fermions can induce exotic carrier responses, and in turn lead to novel optical phenomena. Here, we discover strong coherent chiral terahertz emission from the Weyl semimetal TaAs and demonstrate unprecedented manipulation over its polarization on a femtosecond timescale. Such polarization control is achieved via the colossal ultrafast photocurrents in TaAs arising from the circular or linear photogalvanic effect. We unravel that the chiral ultrafast photocurrents are attributed to the large band velocity changes when the Weyl fermions are excited from the Weyl bands to the high-lying bands. The photocurrent generation is maximized at near-IR frequency range close to 1.5 eV. Our findings provide an entirely new design concept for creating chiral photon sources using quantum materials and open up new opportunities for develo** ultrafast opto-electronics using Weyl physics.
△ Less
Submitted 19 June, 2019; v1 submitted 4 January, 2019;
originally announced January 2019.
-
Short Cycles via Low-Diameter Decompositions
Authors:
Yang P. Liu,
Sushant Sachdeva,
Zejun Yu
Abstract:
We present improved algorithms for short cycle decomposition of a graph. Short cycle decompositions were introduced in the recent work of Chu et al, and were used to make progress on several questions in graph sparsification.
For all constants $δ\in (0,1]$, we give an $O(mn^δ)$ time algorithm that, given a graph $G,$ partitions its edges into cycles of length $O(\log n)^\frac{1}δ$, with $O(n)$ e…
▽ More
We present improved algorithms for short cycle decomposition of a graph. Short cycle decompositions were introduced in the recent work of Chu et al, and were used to make progress on several questions in graph sparsification.
For all constants $δ\in (0,1]$, we give an $O(mn^δ)$ time algorithm that, given a graph $G,$ partitions its edges into cycles of length $O(\log n)^\frac{1}δ$, with $O(n)$ extra edges not in any cycle. This gives the first subquadratic, in fact almost linear time, algorithm achieving polylogarithmic cycle lengths. We also give an $m \cdot \exp(O(\sqrt{\log n}))$ time algorithm that partitions the edges of a graph into cycles of length $\exp(O(\sqrt{\log n} \log\log n))$, with $O(n)$ extra edges not in any cycle. This improves on the short cycle decomposition algorithms given in Chu et al in terms of all parameters, and is significantly simpler.
As a result, we obtain faster algorithms and improved guarantees for several problems in graph sparsification -- construction of resistance sparsifiers, graphical spectral sketches, degree preserving sparsifiers, and approximating the effective resistances of all edges.
△ Less
Submitted 11 January, 2019; v1 submitted 11 October, 2018;
originally announced October 2018.
-
Broadband terahertz generation via the interface inverse Rashba-Edelstein effect
Authors:
C. Zhou,
Y. P. Liu,
Z. Wang,
S. J. Ma,
M. W. Jia,
R. Q. Wu,
L. Zhou,
W. Zhang,
M. K. Liu,
Y. Z. Wu,
J. Qi
Abstract:
Novel mechanisms for electromagnetic wave emission in the terahertz (THz) frequency regime emerging at the nanometer scale have recently attracted intense attention for the purpose of searching next-generation broadband THz emitters. Here, we report a new mechanism for broadband THz emission, utilizing the interface inverse Rashba-Edelstein effect. By engineering the symmetry of the Ag/Bi Rashba i…
▽ More
Novel mechanisms for electromagnetic wave emission in the terahertz (THz) frequency regime emerging at the nanometer scale have recently attracted intense attention for the purpose of searching next-generation broadband THz emitters. Here, we report a new mechanism for broadband THz emission, utilizing the interface inverse Rashba-Edelstein effect. By engineering the symmetry of the Ag/Bi Rashba interface, we demonstrate a controllable THz radiation (~0.1-5 THz) waveform emitted from metallic Fe/Ag/Bi heterostructures following photo-excitation. We further reveal that this type of THz radiation can be selectively superimposed on the emission discovered recently due to the inverse Spin Hall effect, yielding a unique film thickness dependent emission pattern. Our results thus offer new opportunities for versatile broadband THz radiation using the interface quantum effects.
△ Less
Submitted 12 April, 2018;
originally announced April 2018.
-
Reproducibility and Pseudo-Determinism in Log-Space
Authors:
Ofer Grossman,
Yang P. Liu
Abstract:
A curious property of randomized log-space search algorithms is that their outputs are often longer than their workspace. This leads to the question: how can we reproduce the results of a randomized log space computation without storing the output or randomness verbatim? Running the algorithm again with new random bits may result in a new (and potentially different) output.
We show that every pr…
▽ More
A curious property of randomized log-space search algorithms is that their outputs are often longer than their workspace. This leads to the question: how can we reproduce the results of a randomized log space computation without storing the output or randomness verbatim? Running the algorithm again with new random bits may result in a new (and potentially different) output.
We show that every problem in search-RL has a randomized log-space algorithm where the output can be reproduced. Specifically, we show that for every problem in search-RL, there are a pair of log-space randomized algorithms A and B where for every input x, A will output some string t_x of size O(log n), such that B when running on (x, t_x) will be pseudo-deterministic: that is, running B multiple times on the same input (x, t_x) will result in the same output on all executions with high probability. Thus, by storing only O(log n) bits in memory, it is possible to reproduce the output of a randomized log-space algorithm.
An algorithm is reproducible without storing any bits in memory (i.e., |t_x|=0) if and only if it is pseudo-deterministic. We show pseudo-deterministic algorithms for finding paths in undirected graphs and Eulerian graphs using logarithmic space. Our algorithms are substantially faster than the best known deterministic algorithms for finding paths in such graphs in log-space.
The algorithm for search-RL has the additional property that its output, when viewed as a random variable depending on the randomness used by the algorithm, has entropy O(log n).
△ Less
Submitted 11 March, 2018;
originally announced March 2018.
-
The "Riemann Hypothesis" is True for Period Polynomials of Almost All Newforms
Authors:
Yang P. Liu,
Peter S. Park,
Zhuo Qun Song
Abstract:
The period polynomial $r_f(z)$ for a weight $k \geq 3$ newform $f \in S_k(Γ_0(N),χ)$ is the generating function for special values of $L(s,f)$. The functional equation for $L(s, f)$ induces a functional equation on $r_f(z)$. **, Ma, Ono, and Soundararajan proved that for all newforms $f$ of even weight $k \ge 4$ and trivial nebetypus, the "Riemann Hypothesis" holds for $r_f(z)$: that is, all root…
▽ More
The period polynomial $r_f(z)$ for a weight $k \geq 3$ newform $f \in S_k(Γ_0(N),χ)$ is the generating function for special values of $L(s,f)$. The functional equation for $L(s, f)$ induces a functional equation on $r_f(z)$. **, Ma, Ono, and Soundararajan proved that for all newforms $f$ of even weight $k \ge 4$ and trivial nebetypus, the "Riemann Hypothesis" holds for $r_f(z)$: that is, all roots of $r_f(z)$ lie on the circle of symmetry $|z| =1/\sqrt{N}$. We generalize their methods to prove that this phenomenon holds for all but possibly finitely many newforms $f$ of weight $k \ge 3$ with any nebentypus. We also show that the roots of $r_f(z)$ are equidistributed if $N$ or $k$ is sufficiently large.
△ Less
Submitted 14 August, 2016; v1 submitted 15 July, 2016;
originally announced July 2016.
-
Bounded Gaps Between Products of Distinct Primes
Authors:
Yang P. Liu,
Peter S. Park,
Zhuo Qun Song
Abstract:
Let $r \ge 2$ be an integer. We adapt the Maynard-Tao sieve to produce the asymptotically best-known bounded gaps between products of $r$ distinct primes. Our result applies to positive-density subsets of the primes that satisfy certain equidistribution conditions. This improves on the work of Thorne and Sono.
Let $r \ge 2$ be an integer. We adapt the Maynard-Tao sieve to produce the asymptotically best-known bounded gaps between products of $r$ distinct primes. Our result applies to positive-density subsets of the primes that satisfy certain equidistribution conditions. This improves on the work of Thorne and Sono.
△ Less
Submitted 1 June, 2017; v1 submitted 13 July, 2016;
originally announced July 2016.