Showing 1–31 of 31 results for author: Perkins, W

Fast and Slow Mixing of the Kawasaki Dynamics on Bounded-Degree Graphs

Authors: Aiya Kuchukova, Marcus Pappik, Will Perkins, Corrine Yap

Abstract: We study the worst-case mixing time of the global Kawasaki dynamics for the fixed-magnetization Ising model on the class of graphs of maximum degree $Δ$. Proving a conjecture of Carlson, Davies, Kolla, and Perkins, we show that below the tree uniqueness threshold, the Kawasaki dynamics mix rapidly for all magnetizations. Disproving a conjecture of Carlson, Davies, Kolla, and Perkins, we show that… ▽ More We study the worst-case mixing time of the global Kawasaki dynamics for the fixed-magnetization Ising model on the class of graphs of maximum degree $Δ$. Proving a conjecture of Carlson, Davies, Kolla, and Perkins, we show that below the tree uniqueness threshold, the Kawasaki dynamics mix rapidly for all magnetizations. Disproving a conjecture of Carlson, Davies, Kolla, and Perkins, we show that the regime of fast mixing does not extend throughout the regime of tractability for this model: there is a range of parameters for which there exist efficient sampling algorithms for the fixed-magnetization Ising model on max-degree $Δ$ graphs, but the Kawasaki dynamics can take exponential time to mix. Our techniques involve showing spectral independence in the fixed-magnetization Ising model and proving a sharp threshold for the existence of multiple metastable states in the Ising model with external field on random regular graphs. △ Less

Submitted 9 May, 2024; originally announced May 2024.

MSC Class: Primary: 60J10; Secondary: 82B20; 68W20

On the hardness of finding balanced independent sets in random bipartite graphs

Authors: Will Perkins, Yuzhou Wang

Abstract: We consider the algorithmic problem of finding large \textit{balanced} independent sets in sparse random bipartite graphs, and more generally the problem of finding independent sets with specified proportions of vertices on each side of the bipartition. In a bipartite graph it is trivial to find an independent set of density at least half (take one of the partition classes). In contrast, in a rand… ▽ More We consider the algorithmic problem of finding large \textit{balanced} independent sets in sparse random bipartite graphs, and more generally the problem of finding independent sets with specified proportions of vertices on each side of the bipartition. In a bipartite graph it is trivial to find an independent set of density at least half (take one of the partition classes). In contrast, in a random bipartite graph of average degree $d$, the largest balanced independent sets (containing equal number of vertices from each class) are typically of density $(2+o_d(1)) \frac{\log d}{d}$. Can we find such large balanced independent sets in these graphs efficiently? By utilizing the overlap gap property and the low-degree algorithmic framework, we prove that local and low-degree algorithms (even those that know the bipartition) cannot find balanced independent sets of density greater than $(1+ε) \frac{\log d}{d}$ for any $ε>0$ fixed and $d$ large but constant. This factor $2$ statistical--computational gap between what exists and what local algorithms can achieve is analogous to the gap for finding large independent sets in (non-bipartite) random graphs. Our results therefor suggest that this gap is pervasive in many models, and that hard computational problems can lurk inside otherwise tractable ones. A particularly striking aspect of the gap in bipartite graphs is that the algorithm achieving the lower bound is extremely simple and can be implemented as a $1$-local algorithm and a degree-$1$ polynomial (a linear function). △ Less

Submitted 25 July, 2023; originally announced July 2023.

Percolation on hypergraphs and the hard-core model

Authors: Tyler Helmuth, Will Perkins, Michail Sarantis

Abstract: We prove tight bounds on the site percolation threshold for $k$-uniform hypergraphs of maximum degree $Δ$ and for $k$-uniform hypergraphs of maximum degree $Δ$ in which any pair of edges overlaps in at most $r$ vertices. The hypergraphs that achieve these bounds are hypertrees, but unlike in the case of graphs, there are many different $k$-uniform, $Δ$-regular hypertrees. Determining the extremal… ▽ More We prove tight bounds on the site percolation threshold for $k$-uniform hypergraphs of maximum degree $Δ$ and for $k$-uniform hypergraphs of maximum degree $Δ$ in which any pair of edges overlaps in at most $r$ vertices. The hypergraphs that achieve these bounds are hypertrees, but unlike in the case of graphs, there are many different $k$-uniform, $Δ$-regular hypertrees. Determining the extremal tree for a given $k, Δ, r$ involves an optimization problem, and our bounds arise from a convex relaxation of this problem. By combining our percolation bounds with the method of disagreement percolation we obtain improved bounds on the uniqueness threshold for the hard-core model on hypergraphs satisfying the same constraints. Our uniqueness conditions imply exponential weak spatial mixing, and go beyond the known bounds for rapid mixing of local Markov chains and existence of efficient approximate counting and sampling algorithms. Our results lead to natural conjectures regarding the aforementioned algorithmic tasks, based on the intuition that uniqueness thresholds for the extremal hypertrees for percolation determine computational thresholds. △ Less

Submitted 21 September, 2023; v1 submitted 19 July, 2023; originally announced July 2023.

Comments: Error in the proof of Theorem 3.1

Perfect Sampling for Hard Spheres from Strong Spatial Mixing

Authors: Konrad Anand, Andreas Göbel, Marcus Pappik, Will Perkins

Abstract: We provide a perfect sampling algorithm for the hard-sphere model on subsets of $\mathbb{R}^d$ with expected running time linear in the volume under the assumption of strong spatial mixing. A large number of perfect and approximate sampling algorithms have been devised to sample from the hard-sphere model, and our perfect sampling algorithm is efficient for a range of parameters for which only eff… ▽ More We provide a perfect sampling algorithm for the hard-sphere model on subsets of $\mathbb{R}^d$ with expected running time linear in the volume under the assumption of strong spatial mixing. A large number of perfect and approximate sampling algorithms have been devised to sample from the hard-sphere model, and our perfect sampling algorithm is efficient for a range of parameters for which only efficient approximate samplers were previously known and is faster than these known approximate approaches. Our methods also extend to the more general setting of Gibbs point processes interacting via finite-range, repulsive potentials. △ Less

Submitted 3 May, 2023; originally announced May 2023.

Geometric Barriers for Stable and Online Algorithms for Discrepancy Minimization

Authors: David Gamarnik, Eren C. Kızıldağ, Will Perkins, Changji Xu

Abstract: For many computational problems involving randomness, intricate geometric features of the solution space have been used to rigorously rule out powerful classes of algorithms. This is often accomplished through the lens of the multi Overlap Gap Property ($m$-OGP), a rigorous barrier against algorithms exhibiting input stability. In this paper, we focus on the algorithmic tractability of two models:… ▽ More For many computational problems involving randomness, intricate geometric features of the solution space have been used to rigorously rule out powerful classes of algorithms. This is often accomplished through the lens of the multi Overlap Gap Property ($m$-OGP), a rigorous barrier against algorithms exhibiting input stability. In this paper, we focus on the algorithmic tractability of two models: (i) discrepancy minimization, and (ii) the symmetric binary perceptron (\texttt{SBP}), a random constraint satisfaction problem as well as a toy model of a single-layer neural network. Our first focus is on the limits of online algorithms. By establishing and leveraging a novel geometrical barrier, we obtain sharp hardness guarantees against online algorithms for both the \texttt{SBP} and discrepancy minimization. Our results match the best known algorithmic guarantees, up to constant factors. Our second focus is on efficiently finding a constant discrepancy solution, given a random matrix $\mathcal{M}\in\mathbb{R}^{M\times n}$. In a smooth setting, where the entries of $\mathcal{M}$ are i.i.d. standard normal, we establish the presence of $m$-OGP for $n=Θ(M\log M)$. Consequently, we rule out the class of stable algorithms at this value. These results give the first rigorous evidence towards a conjecture of Altschuler and Niles-Weed~\cite[Conjecture~1]{altschuler2021discrepancy}. Our methods use the intricate geometry of the solution space to prove tight hardness results for online algorithms. The barrier we establish is a novel variant of the $m$-OGP. Furthermore, it regards $m$-tuples of solutions with respect to correlated instances, with growing values of $m$, $m=ω(1)$. Importantly, our results rule out online algorithms succeeding even with an exponentially small probability. △ Less

Submitted 13 February, 2023; originally announced February 2023.

Machine-learned climate model corrections from a global storm-resolving model

Authors: Anna Kwa, Spencer K. Clark, Brian Henn, Noah D. Brenowitz, Jeremy McGibbon, W. Andre Perkins, Oliver Watt-Meyer, Lucas Harris, Christopher S. Bretherton

Abstract: Due to computational constraints, running global climate models (GCMs) for many years requires a lower spatial grid resolution (${\gtrsim}50$ km) than is optimal for accurately resolving important physical processes. Such processes are approximated in GCMs via subgrid parameterizations, which contribute significantly to the uncertainty in GCM predictions. One approach to improving the accuracy of… ▽ More Due to computational constraints, running global climate models (GCMs) for many years requires a lower spatial grid resolution (${\gtrsim}50$ km) than is optimal for accurately resolving important physical processes. Such processes are approximated in GCMs via subgrid parameterizations, which contribute significantly to the uncertainty in GCM predictions. One approach to improving the accuracy of a coarse-grid global climate model is to add machine-learned state-dependent corrections at each simulation timestep, such that the climate model evolves more like a high-resolution global storm-resolving model (GSRM). We train neural networks to learn the state-dependent temperature, humidity, and radiative flux corrections needed to nudge a 200 km coarse-grid climate model to the evolution of a 3~km fine-grid GSRM. When these corrective ML models are coupled to a year-long coarse-grid climate simulation, the time-mean spatial pattern errors are reduced by 6-25% for land surface temperature and 9-25% for land surface precipitation with respect to a no-ML baseline simulation. The ML-corrected simulations develop other biases in climate and circulation that differ from, but have comparable amplitude to, the baseline simulation. △ Less

Submitted 21 November, 2022; originally announced November 2022.

On the zeroes of hypergraph independence polynomials

Authors: David Galvin, Gwen McKinley, Will Perkins, Michail Sarantis, Prasad Tetali

Abstract: We study the locations of complex zeroes of independence polynomials of bounded degree hypergraphs. For graphs, this is a long-studied subject with applications to statistical physics, algorithms, and combinatorics. Results on zero-free regions for bounded-degree graphs include Shearer's result on the optimal zero-free disk, along with several recent results on other zero-free regions. Much less i… ▽ More We study the locations of complex zeroes of independence polynomials of bounded degree hypergraphs. For graphs, this is a long-studied subject with applications to statistical physics, algorithms, and combinatorics. Results on zero-free regions for bounded-degree graphs include Shearer's result on the optimal zero-free disk, along with several recent results on other zero-free regions. Much less is known for hypergraphs. We make some steps towards an understanding of zero-free regions for bounded-degree hypergaphs by proving that all hypergraphs of maximum degree $Δ$ have a zero-free disk almost as large as the optimal disk for graphs of maximum degree $Δ$ established by Shearer (of radius $\sim 1/(e Δ)$). Up to logarithmic factors in $Δ$ this is optimal, even for hypergraphs with all edge-sizes strictly greater than $2$. We conjecture that for $k\ge 3$, $k$-uniform linear hypergraphs have a much larger zero-free disk of radius $Ω(Δ^{- \frac{1}{k-1}} )$. We establish this in the case of linear hypertrees. △ Less

Submitted 18 November, 2022; v1 submitted 1 November, 2022; originally announced November 2022.

Algorithms and Barriers in the Symmetric Binary Perceptron Model

Authors: David Gamarnik, Eren C. Kızıldağ, Will Perkins, Changji Xu

Abstract: The symmetric binary perceptron ($\texttt{SBP}$) exhibits a dramatic statistical-to-computational gap: the densities at which known efficient algorithms find solutions are far below the threshold for the existence of solutions. Furthermore, the $\texttt{SBP}$ exhibits a striking structural property: at all positive constraint densities almost all of its solutions are 'totally frozen' singletons se… ▽ More The symmetric binary perceptron ($\texttt{SBP}$) exhibits a dramatic statistical-to-computational gap: the densities at which known efficient algorithms find solutions are far below the threshold for the existence of solutions. Furthermore, the $\texttt{SBP}$ exhibits a striking structural property: at all positive constraint densities almost all of its solutions are 'totally frozen' singletons separated by large Hamming distance \cite{perkins2021frozen,abbe2021proof}. This suggests that finding a solution to the $\texttt{SBP}$ may be computationally intractable. At the same time, the $\texttt{SBP}$ does admit polynomial-time search algorithms at low enough densities. A conjectural explanation for this conundrum was put forth in \cite{baldassi2020clustering}: efficient algorithms succeed in the face of freezing by finding exponentially rare clusters of large size. However, it was discovered recently that such rare large clusters exist at all subcritical densities, even at those well above the limits of known efficient algorithms \cite{abbe2021binary}. Thus the driver of the statistical-to-computational gap exhibited by this model remains a mystery. In this paper, we conduct a different landscape analysis to explain the algorithmic tractability of this problem. We show that at high enough densities the $\texttt{SBP}$ exhibits the multi Overlap Gap Property ($m-$OGP), an intricate geometrical property known to be a rigorous barrier for large classes of algorithms. Our analysis shows that the $m-$OGP threshold (a) is well below the satisfiability threshold; and (b) matches the best known algorithmic threshold up to logarithmic factors as $m\to\infty$. We then prove that the $m-$OGP rules out the class of stable algorithms for the $\texttt{SBP}$ above this threshold. We conjecture that the $m \to \infty$ limit of the $m$-OGP threshold marks the algorithmic threshold for the problem. △ Less

Submitted 29 March, 2022; originally announced March 2022.

Strong spatial mixing for repulsive point processes

Authors: Marcus Michelen, Will Perkins

Abstract: We prove that a Gibbs point process interacting via a finite-range, repulsive potential $φ$ exhibits a strong spatial mixing property for activities $λ< e/Δ_φ$, where $Δ_φ$ is the potential-weighted connective constant of $φ$, defined recently in [MP21]. Using this we derive several analytic and algorithmic consequences when $λ$ satisfies this bound: (1) We prove new identities for the infinite vo… ▽ More We prove that a Gibbs point process interacting via a finite-range, repulsive potential $φ$ exhibits a strong spatial mixing property for activities $λ< e/Δ_φ$, where $Δ_φ$ is the potential-weighted connective constant of $φ$, defined recently in [MP21]. Using this we derive several analytic and algorithmic consequences when $λ$ satisfies this bound: (1) We prove new identities for the infinite volume pressure and surface pressure of such a process (and in the case of the surface pressure establish its existence). (2) We prove that local block dynamics for sampling from the model on a box of volume $N$ in $\mathbb R^d$ mixes in time $O(N \log N)$, giving efficient randomized algorithms to approximate the partition function and approximately sample from these models. (3) We use the above identities and algorithms to give efficient approximation algorithms for the pressure and surface pressure. △ Less

Submitted 16 August, 2022; v1 submitted 17 February, 2022; originally announced February 2022.

Fast and perfect sampling of subgraphs and polymer systems

Authors: Antonio Blanca, Sarah Cannon, Will Perkins

Abstract: We give an efficient perfect sampling algorithm for weighted, connected induced subgraphs (or graphlets) of rooted, bounded degree graphs. Our algorithm utilizes a vertex-percolation process with a carefully chosen rejection filter and works under a percolation subcriticality condition. We show that this condition is optimal in the sense that the task of (approximately) sampling weighted rooted gr… ▽ More We give an efficient perfect sampling algorithm for weighted, connected induced subgraphs (or graphlets) of rooted, bounded degree graphs. Our algorithm utilizes a vertex-percolation process with a carefully chosen rejection filter and works under a percolation subcriticality condition. We show that this condition is optimal in the sense that the task of (approximately) sampling weighted rooted graphlets becomes impossible in finite expected time for infinite graphs and intractable for finite graphs when the condition does not hold. We apply our sampling algorithm as a subroutine to give near linear-time perfect sampling algorithms for polymer models and weighted non-rooted graphlets in finite graphs, two widely studied yet very different problems. This new perfect sampling algorithm for polymer models gives improved sampling algorithms for spin systems at low temperatures on expander graphs and unbalanced bipartite graphs, among other applications. △ Less

Submitted 15 November, 2023; v1 submitted 11 February, 2022; originally announced February 2022.

Computational thresholds for the fixed-magnetization Ising model

Authors: Charlie Carlson, Ewan Davies, Alexandra Kolla, Will Perkins

Abstract: The ferromagnetic Ising model is a model of a magnetic material and a central topic in statistical physics. It also plays a starring role in the algorithmic study of approximate counting: approximating the partition function of the ferromagnetic Ising model with uniform external field is tractable at all temperatures and on all graphs, due to the randomized algorithm of Jerrum and Sinclair. Here w… ▽ More The ferromagnetic Ising model is a model of a magnetic material and a central topic in statistical physics. It also plays a starring role in the algorithmic study of approximate counting: approximating the partition function of the ferromagnetic Ising model with uniform external field is tractable at all temperatures and on all graphs, due to the randomized algorithm of Jerrum and Sinclair. Here we show that hidden inside the model are hard computational problems. For the class of bounded-degree graphs we find computational thresholds for the approximate counting and sampling problems for the ferromagnetic Ising model at fixed magnetization (that is, fixing the number of $+1$ and $-1$ spins). In particular, letting $β_c(Δ)$ denote the critical inverse temperature of the zero-field Ising model on the infinite $Δ$-regular tree, and $η_{Δ,β,1}^+$ denote the mean magnetization of the zero-field $+$ measure on the infinite $Δ$-regular tree at inverse temperature $β$, we prove, for the class of graphs of maximum degree $Δ$: 1. For $β< β_c(Δ)$ there is an FPRAS and efficient sampling scheme for the fixed-magnetization Ising model for all magnetizations $η$. 2. For $β> β_c(Δ)$, there is an FPRAS and efficient sampling scheme for the fixed-magnetization Ising model for magnetizations $η$ such that $|η| >η_{Δ,β,1}^+ $. 3. For $β> β_c(Δ)$, there is no FPRAS for the fixed-magnetization Ising model for magnetizations $η$ such that $|η| <η_{Δ,β,1}^+ $ unless NP=RP\@. △ Less

Submitted 4 November, 2021; originally announced November 2021.

Approximately counting independent sets in bipartite graphs via graph containers

Authors: Matthew Jenssen, Will Perkins, Aditya Potukuchi

Abstract: By implementing algorithmic versions of Sapozhenko's graph container methods, we give new algorithms for approximating the number of independent sets in bipartite graphs. Our first algorithm applies to $d$-regular, bipartite graphs satisfying a weak expansion condition: when $d$ is constant, and the graph is a bipartite $Ω( \log^2 d/d)$-expander, we obtain an FPTAS for the number of independent se… ▽ More By implementing algorithmic versions of Sapozhenko's graph container methods, we give new algorithms for approximating the number of independent sets in bipartite graphs. Our first algorithm applies to $d$-regular, bipartite graphs satisfying a weak expansion condition: when $d$ is constant, and the graph is a bipartite $Ω( \log^2 d/d)$-expander, we obtain an FPTAS for the number of independent sets. Previously such a result for $d>5$ was known only for graphs satisfying the much stronger expansion conditions of random bipartite graphs. The algorithm also applies to weighted independent sets: for a $d$-regular, bipartite $α$-expander, with $α>0$ fixed, we give an FPTAS for the hard-core model partition function at fugacity $λ=Ω(\log d / d^{1/4})$. Finally we present an algorithm that applies to all $d$-regular, bipartite graphs, runs in time $\exp\left( O\left( n \cdot \frac{ \log^3 d }{d } \right) \right)$, and outputs a $(1 + o(1))$-approximation to the number of independent sets. △ Less

Submitted 8 September, 2021; originally announced September 2021.

Approximation algorithms for the random-field Ising model

Authors: Tyler Helmuth, Holden Lee, Will Perkins, Mohan Ravichandran, Qiang Wu

Abstract: Approximating the partition function of the ferromagnetic Ising model with general external fields is known to be #BIS-hard in the worst case, even for bounded-degree graphs, and it is widely believed that no polynomial-time approximation scheme exists. This motivates an average-case question: are there classes of instances for which polynomial-time approximation schemes exist? We investigate this… ▽ More Approximating the partition function of the ferromagnetic Ising model with general external fields is known to be #BIS-hard in the worst case, even for bounded-degree graphs, and it is widely believed that no polynomial-time approximation scheme exists. This motivates an average-case question: are there classes of instances for which polynomial-time approximation schemes exist? We investigate this question for the random field Ising model on graphs with maximum degree $Δ$. We establish the existence of fully polynomial-time approximation schemes and samplers with high probability over the random fields if the external fields are IID Gaussians with variance larger than a constant depending only on the inverse temperature and $Δ$. The main challenge comes from the positive density of vertices at which the external field is small. These regions, which may have connected components of size $Θ(\log n)$, are a barrier to algorithms based on establishing a zero-free region, and cause worst-case analyses of Glauber dynamics to fail. The analysis of our algorithm is based on percolation on a self-avoiding walk tree. △ Less

Submitted 26 August, 2021; originally announced August 2021.

Comments: 20 pages

Approximate counting and sampling via local central limit theorems

Authors: Vishesh Jain, Will Perkins, Ashwin Sah, Mehtaab Sawhney

Abstract: We give an FPTAS for computing the number of matchings of size $k$ in a graph $G$ of maximum degree $Δ$ on $n$ vertices, for all $k \le (1-δ)m^*(G)$, where $δ>0$ is fixed and $m^*(G)$ is the matching number of $G$, and an FPTAS for the number of independent sets of size $k \le (1-δ) α_c(Δ) n$, where $α_c(Δ)$ is the NP-hardness threshold for this problem. We also provide quasi-linear time randomize… ▽ More We give an FPTAS for computing the number of matchings of size $k$ in a graph $G$ of maximum degree $Δ$ on $n$ vertices, for all $k \le (1-δ)m^*(G)$, where $δ>0$ is fixed and $m^*(G)$ is the matching number of $G$, and an FPTAS for the number of independent sets of size $k \le (1-δ) α_c(Δ) n$, where $α_c(Δ)$ is the NP-hardness threshold for this problem. We also provide quasi-linear time randomized algorithms to approximately sample from the uniform distribution on matchings of size $k \leq (1-δ)m^*(G)$ and independent sets of size $k \leq (1-δ)α_c(Δ)n$. Our results are based on a new framework for exploiting local central limit theorems as an algorithmic tool. We use a combination of Fourier inversion, probabilistic estimates, and the deterministic approximation of partition functions at complex activities to extract approximations of the coefficients of the partition function. For our results for independent sets, we prove a new local central limit theorem for the hard-core model that applies to all fugacities below $λ_c(Δ)$, the uniqueness threshold on the infinite $Δ$-regular tree. △ Less

Submitted 2 August, 2021; originally announced August 2021.

Comments: 26 pages; comments welcome!

Approximately counting independent sets of a given size in bounded-degree graphs

Authors: Ewan Davies, Will Perkins

Abstract: We determine the computational complexity of approximately counting and sampling independent sets of a given size in bounded-degree graphs. That is, we identify a critical density $α_c(Δ)$ and provide (i) for $α< α_c(Δ)$ randomized polynomial-time algorithms for approximately sampling and counting independent sets of given size at most $αn$ in $n$-vertex graphs of maximum degree $Δ$; and (ii) a pr… ▽ More We determine the computational complexity of approximately counting and sampling independent sets of a given size in bounded-degree graphs. That is, we identify a critical density $α_c(Δ)$ and provide (i) for $α< α_c(Δ)$ randomized polynomial-time algorithms for approximately sampling and counting independent sets of given size at most $αn$ in $n$-vertex graphs of maximum degree $Δ$; and (ii) a proof that unless NP=RP, no such algorithms exist for $α>α_c(Δ)$. The critical density is the occupancy fraction of the hard core model on the complete graph $K_{Δ+1}$ at the uniqueness threshold on the infinite $Δ$-regular tree, giving $α_c(Δ)\sim\frac{e}{1+e}\frac{1}Δ$ as $Δ\to\infty$. Our methods apply more generally to anti-ferromagnetic 2-spin systems and motivate new questions in extremal combinatorics. △ Less

Submitted 24 January, 2023; v1 submitted 9 February, 2021; originally announced February 2021.

Finite-size scaling, phase coexistence, and algorithms for the random cluster model on random graphs

Authors: Tyler Helmuth, Matthew Jenssen, Will Perkins

Abstract: For $Δ\ge 5$ and $q$ large as a function of $Δ$, we give a detailed picture of the phase transition of the random cluster model on random $Δ$-regular graphs. In particular, we determine the limiting distribution of the weights of the ordered and disordered phases at criticality and prove exponential decay of correlations and central limit theorems away from criticality. Our techniques are based… ▽ More For $Δ\ge 5$ and $q$ large as a function of $Δ$, we give a detailed picture of the phase transition of the random cluster model on random $Δ$-regular graphs. In particular, we determine the limiting distribution of the weights of the ordered and disordered phases at criticality and prove exponential decay of correlations and central limit theorems away from criticality. Our techniques are based on using polymer models and the cluster expansion to control deviations from the ordered and disordered ground states. These techniques also yield efficient approximate counting and sampling algorithms for the Potts and random cluster models on random $Δ$-regular graphs at all temperatures when $q$ is large. This includes the critical temperature at which it is known the Glauber and Swendsen-Wang dynamics for the Potts model mix slowly. We further prove new slow-mixing results for Markov chains, most notably that the Swendsen-Wang dynamics mix exponentially slowly throughout an open interval containing the critical temperature. This was previously only known at the critical temperature. Many of our results apply more generally to $Δ$-regular graphs satisfying a small-set expansion condition. △ Less

Submitted 15 September, 2021; v1 submitted 20 June, 2020; originally announced June 2020.

Comments: This update includes new results on the slow mixing of Markov chains (Theorem 6)

Correlation decay for hard spheres via Markov chains

Authors: Tyler Helmuth, Will Perkins, Samantha Petti

Abstract: We improve upon all known lower bounds on the critical fugacity and critical density of the hard sphere model in dimensions two and higher. As the dimension tends to infinity our improvements are by factors of $2$ and $1.7$, respectively. We make these improvements by utilizing techniques from theoretical computer science to show that a certain Markov chain for sampling from the hard sphere model… ▽ More We improve upon all known lower bounds on the critical fugacity and critical density of the hard sphere model in dimensions two and higher. As the dimension tends to infinity our improvements are by factors of $2$ and $1.7$, respectively. We make these improvements by utilizing techniques from theoretical computer science to show that a certain Markov chain for sampling from the hard sphere model mixes rapidly at low enough fugacities. We then prove an equivalence between optimal spatial and temporal mixing for hard spheres to deduce our results. △ Less

Submitted 21 July, 2021; v1 submitted 15 January, 2020; originally announced January 2020.

Efficient sampling and counting algorithms for the Potts model on $\mathbb Z^d$ at all temperatures

Authors: Christian Borgs, Jennifer Chayes, Tyler Helmuth, Will Perkins, Prasad Tetali

Abstract: For $d \ge 2$ and all $q\geq q_{0}(d)$ we give an efficient algorithm to approximately sample from the $q$-state ferromagnetic Potts and random cluster models on finite tori $(\mathbb Z / n \mathbb Z )^d$ for any inverse temperature $β\geq 0$. This shows that the physical phase transition of the Potts model presents no algorithmic barrier to efficient sampling, and stands in contrast to Markov cha… ▽ More For $d \ge 2$ and all $q\geq q_{0}(d)$ we give an efficient algorithm to approximately sample from the $q$-state ferromagnetic Potts and random cluster models on finite tori $(\mathbb Z / n \mathbb Z )^d$ for any inverse temperature $β\geq 0$. This shows that the physical phase transition of the Potts model presents no algorithmic barrier to efficient sampling, and stands in contrast to Markov chain mixing time results: the Glauber dynamics mix slowly at and below the critical temperature, and the Swendsen--Wang dynamics mix slowly at the critical temperature. We also provide an efficient algorithm (an FPRAS) for approximating the partition functions of these models at all temperatures. Our algorithms are based on representing the random cluster model as a contour model using Pirogov--Sinai theory, and then computing an accurate approximation of the logarithm of the partition function by inductively truncating the resulting cluster expansion. The main innovation of our approach is an algorithmic treatment of unstable ground states, which is essential for our algorithms to apply to all inverse temperatures $β$. By treating unstable ground states our work gives a general template for converting probabilistic applications of Pirogov-Sinai theory to efficient algorithms. △ Less

Submitted 8 August, 2022; v1 submitted 19 September, 2019; originally announced September 2019.

Counting independent sets in unbalanced bipartite graphs

Authors: Sarah Cannon, Will Perkins

Abstract: We give an FPTAS for approximating the partition function of the hard-core model for bipartite graphs when there is sufficient imbalance in the degrees or fugacities between the sides $(L,R)$ of the bipartition. This includes, among others, the biregular case when $λ=1$ (approximating the number of independent sets of $G$) and $Δ_R \geq 7Δ_L \log(Δ_L)$. Our approximation algorithm is based on trun… ▽ More We give an FPTAS for approximating the partition function of the hard-core model for bipartite graphs when there is sufficient imbalance in the degrees or fugacities between the sides $(L,R)$ of the bipartition. This includes, among others, the biregular case when $λ=1$ (approximating the number of independent sets of $G$) and $Δ_R \geq 7Δ_L \log(Δ_L)$. Our approximation algorithm is based on truncating the cluster expansion of a polymer model partition function that expresses the hard-core partition function in terms of deviations from independent sets that are empty on one side of the bipartition. As a consequence of the method, we also prove that the hard-core model on such graphs exhibits exponential decay of correlations by utilizing connections between the cluster expansion and joint cumulants. △ Less

Submitted 4 June, 2019; originally announced June 2019.

Fast algorithms at low temperatures via Markov chains

Authors: Zongchen Chen, Andreas Galanis, Leslie Ann Goldberg, Will Perkins, James Stewart, Eric Vigoda

Abstract: We define a discrete-time Markov chain for abstract polymer models and show that under sufficient decay of the polymer weights, this chain mixes rapidly. We apply this Markov chain to polymer models derived from the hard-core and ferromagnetic Potts models on bounded-degree (bipartite) expander graphs. In this setting, Jenssen, Keevash and Perkins (2019) recently gave an FPTAS and an efficient sam… ▽ More We define a discrete-time Markov chain for abstract polymer models and show that under sufficient decay of the polymer weights, this chain mixes rapidly. We apply this Markov chain to polymer models derived from the hard-core and ferromagnetic Potts models on bounded-degree (bipartite) expander graphs. In this setting, Jenssen, Keevash and Perkins (2019) recently gave an FPTAS and an efficient sampling algorithm at sufficiently high fugacity and low temperature respectively. Their method is based on using the cluster expansion to obtain a complex zero-free region for the partition function of a polymer model, and then approximating this partition function using the polynomial interpolation method of Barvinok. Our approach via the polymer model Markov chain circumvents the zero-free analysis and the generalization to complex parameters, and leads to a sampling algorithm with a fast running time of $O(n \log n)$ for the Potts model and $O(n^2 \log n)$ for the hard-core model, in contrast to typical running times of $n^{O(\log Δ)}$ for algorithms based on Barvinok's polynomial interpolation method on graphs of maximum degree $Δ$. We finally combine our results for the hard-core and ferromagnetic Potts models with standard Markov chain comparison tools to obtain polynomial mixing time for the usual spin Glauber dynamics restricted to even and odd or `red' dominant portions of the respective state spaces. △ Less

Submitted 13 April, 2021; v1 submitted 20 January, 2019; originally announced January 2019.

Algorithms for #BIS-hard problems on expander graphs

Authors: Matthew Jenssen, Peter Keevash, Will Perkins

Abstract: We give an FPTAS and an efficient sampling algorithm for the high-fugacity hard-core model on bounded-degree bipartite expander graphs and the low-temperature ferromagnetic Potts model on bounded-degree expander graphs. The results apply, for example, to random (bipartite) $Δ$-regular graphs, for which no efficient algorithms were known for these problems (with the exception of the Ising model) in… ▽ More We give an FPTAS and an efficient sampling algorithm for the high-fugacity hard-core model on bounded-degree bipartite expander graphs and the low-temperature ferromagnetic Potts model on bounded-degree expander graphs. The results apply, for example, to random (bipartite) $Δ$-regular graphs, for which no efficient algorithms were known for these problems (with the exception of the Ising model) in the non-uniqueness regime of the infinite $Δ$-regular tree. We also find efficient counting and sampling algorithms for proper $q$-colorings of random $Δ$-regular bipartite graphs when $q$ is sufficiently small as a function of $Δ$. △ Less

Submitted 23 March, 2020; v1 submitted 12 July, 2018; originally announced July 2018.

Algorithmic Pirogov-Sinai theory

Authors: Tyler Helmuth, Will Perkins, Guus Regts

Abstract: We develop an efficient algorithmic approach for approximate counting and sampling in the low-temperature regime of a broad class of statistical physics models on finite subsets of the lattice $\mathbb Z^d$ and on the torus $(\mathbb Z/n \mathbb Z)^d$. Our approach is based on combining contour representations from Pirogov-Sinai theory with Barvinok's approach to approximate counting using truncat… ▽ More We develop an efficient algorithmic approach for approximate counting and sampling in the low-temperature regime of a broad class of statistical physics models on finite subsets of the lattice $\mathbb Z^d$ and on the torus $(\mathbb Z/n \mathbb Z)^d$. Our approach is based on combining contour representations from Pirogov-Sinai theory with Barvinok's approach to approximate counting using truncated Taylor series. Some consequences of our main results include an FPTAS for approximating the partition function of the hard-core model at sufficiently high fugacity on subsets of $\mathbb Z^d$ with appropriate boundary conditions and an efficient sampling algorithm for the ferromagnetic Potts model on the discrete torus $(\mathbb Z/n \mathbb Z)^d$ at sufficiently low temperature. △ Less

Submitted 16 June, 2023; v1 submitted 29 June, 2018; originally announced June 2018.

Comments: We fixed a typo in the series expansion for log Z(z) on page 20

Information-theoretic thresholds from the cavity method

Authors: Amin Coja-Oghlan, Florent Krzakala, Will Perkins, Lenka Zdeborova

Abstract: Vindicating a sophisticated but non-rigorous physics approach called the cavity method, we establish a formula for the mutual information in statistical inference problems induced by random graphs and we show that the mutual information holds the key to understanding certain important phase transitions in random graph models. We work out several concrete applications of these general results. For… ▽ More Vindicating a sophisticated but non-rigorous physics approach called the cavity method, we establish a formula for the mutual information in statistical inference problems induced by random graphs and we show that the mutual information holds the key to understanding certain important phase transitions in random graph models. We work out several concrete applications of these general results. For instance, we pinpoint the exact condensation phase transition in the Potts antiferromagnet on the random graph, thereby improving prior approximate results [Contucci et al.: Communications in Mathematical Physics 2013]. Further, we prove the conjecture from [Krzakala et al.: PNAS 2007] about the condensation phase transition in the random graph coloring problem for any number $q\geq3$ of colors. Moreover, we prove the conjecture on the information-theoretic threshold in the disassortative stochastic block model [Decelle et al.: Phys. Rev. E 2011]. Additionally, our general result implies the conjectured formula for the mutual information in Low-Density Generator Matrix codes [Montanari: IEEE Transactions on Information Theory 2005]. △ Less

Submitted 10 May, 2018; v1 submitted 2 November, 2016; originally announced November 2016.

MSC Class: 68Q87

Journal ref: Advances in Mathematics Volume 333, 31 July 2018, Pages 694-795

Belief Propagation on replica symmetric random factor graph models

Authors: Amin Coja-Oghlan, Will Perkins

Abstract: According to physics predictions, the free energy of random factor graph models that satisfy a certain "static replica symmetry" condition can be calculated via the Belief Propagation message passing scheme [Krzakala et al., PNAS 2007]. Here we prove this conjecture for two general classes of random factor graph models, namely Poisson random factor graphs and random regular factor graphs. Specific… ▽ More According to physics predictions, the free energy of random factor graph models that satisfy a certain "static replica symmetry" condition can be calculated via the Belief Propagation message passing scheme [Krzakala et al., PNAS 2007]. Here we prove this conjecture for two general classes of random factor graph models, namely Poisson random factor graphs and random regular factor graphs. Specifically, we show that the messages constructed just as in the case of acyclic factor graphs asymptotically satisfy the Belief Propagation equations and that the free energy density is given by the Bethe free energy formula. △ Less

Submitted 27 March, 2016; originally announced March 2016.

MSC Class: 05C80

Spectral Thresholds in the Bipartite Stochastic Block Model

Authors: Laura Florescu, Will Perkins

Abstract: We consider a bipartite stochastic block model on vertex sets $V_1$ and $V_2$, with planted partitions in each, and ask at what densities efficient algorithms can recover the partition of the smaller vertex set. When $|V_2| \gg |V_1|$, multiple thresholds emerge. We first locate a sharp threshold for detection of the partition, in the sense of the results of \cite{mossel2012stochastic,mossel2013… ▽ More We consider a bipartite stochastic block model on vertex sets $V_1$ and $V_2$, with planted partitions in each, and ask at what densities efficient algorithms can recover the partition of the smaller vertex set. When $|V_2| \gg |V_1|$, multiple thresholds emerge. We first locate a sharp threshold for detection of the partition, in the sense of the results of \cite{mossel2012stochastic,mossel2013proof} and \cite{massoulie2014community} for the stochastic block model. We then show that at a higher edge density, the singular vectors of the rectangular biadjacency matrix exhibit a localization / delocalization phase transition, giving recovery above the threshold and no recovery below. Nevertheless, we propose a simple spectral algorithm, Diagonal Deletion SVD, which recovers the partition at a nearly optimal edge density. The bipartite stochastic block model studied here was used by \cite{feldman2014algorithm} to give a unified algorithm for recovering planted partitions and assignments in random hypergraphs and random $k$-SAT formulae respectively. Our results give the best known bounds for the clause density at which solutions can be found efficiently in these models as well as showing a barrier to further improvement via this reduction to the bipartite block model. △ Less

Submitted 24 May, 2016; v1 submitted 22 June, 2015; originally announced June 2015.

Comments: updated version, will appear in COLT 2016

Subsampled Power Iteration: a Unified Algorithm for Block Models and Planted CSP's

Authors: Vitaly Feldman, Will Perkins, Santosh Vempala

Abstract: We present an algorithm for recovering planted solutions in two well-known models, the stochastic block model and planted constraint satisfaction problems, via a common generalization in terms of random bipartite graphs. Our algorithm matches up to a constant factor the best-known bounds for the number of edges (or constraints) needed for perfect recovery and its running time is linear in the numb… ▽ More We present an algorithm for recovering planted solutions in two well-known models, the stochastic block model and planted constraint satisfaction problems, via a common generalization in terms of random bipartite graphs. Our algorithm matches up to a constant factor the best-known bounds for the number of edges (or constraints) needed for perfect recovery and its running time is linear in the number of edges used. The time complexity is significantly better than both spectral and SDP-based approaches. The main contribution of the algorithm is in the case of unequal sizes in the bipartition (corresponding to odd uniformity in the CSP). Here our algorithm succeeds at a significantly lower density than the spectral approaches, surpassing a barrier based on the spectral norm of a random matrix. Other significant features of the algorithm and analysis include (i) the critical use of power iteration with subsampling, which might be of independent interest; its analysis requires kee** track of multiple norms of an evolving solution (ii) it can be implemented statistically, i.e., with very limited access to the input distribution (iii) the algorithm is extremely simple to implement and runs in linear time, and thus is practical even for very large instances. △ Less

Submitted 28 April, 2015; v1 submitted 10 July, 2014; originally announced July 2014.

On the Complexity of Random Satisfiability Problems with Planted Solutions

Authors: Vitaly Feldman, Will Perkins, Santosh Vempala

Abstract: The problem of identifying a planted assignment given a random $k$-SAT formula consistent with the assignment exhibits a large algorithmic gap: while the planted solution becomes unique and can be identified given a formula with $O(n\log n)$ clauses, there are distributions over clauses for which the best known efficient algorithms require $n^{k/2}$ clauses. We propose and study a unified model fo… ▽ More The problem of identifying a planted assignment given a random $k$-SAT formula consistent with the assignment exhibits a large algorithmic gap: while the planted solution becomes unique and can be identified given a formula with $O(n\log n)$ clauses, there are distributions over clauses for which the best known efficient algorithms require $n^{k/2}$ clauses. We propose and study a unified model for planted $k$-SAT, which captures well-known special cases. An instance is described by a planted assignment $σ$ and a distribution on clauses with $k$ literals. We define its distribution complexity as the largest $r$ for which the distribution is not $r$-wise independent ($1 \le r \le k$ for any distribution with a planted assignment). Our main result is an unconditional lower bound, tight up to logarithmic factors, for statistical (query) algorithms [Kearns 1998, Feldman et. al 2012], matching known upper bounds, which, as we show, can be implemented using a statistical algorithm. Since known approaches for problems over distributions have statistical analogues (spectral, MCMC, gradient-based, convex optimization etc.), this lower bound provides a rigorous explanation of the observed algorithmic gap. The proof introduces a new general technique for the analysis of statistical query algorithms. It also points to a geometric paring phenomenon in the space of all planted assignments. We describe consequences of our lower bounds to Feige's refutation hypothesis [Feige 2002] and to lower bounds on general convex programs that solve planted $k$-SAT. Our bounds also extend to other planted $k$-CSP models, and, in particular, provide concrete evidence for the security of Goldreich's one-way function and the associated pseudorandom generator when used with a sufficiently hard predicate [Goldreich 2000]. △ Less

Submitted 6 March, 2018; v1 submitted 19 November, 2013; originally announced November 2013.

Comments: Extended abstract appeared in STOC 2015

On Sharp Thresholds in Random Geometric Graphs

Authors: Milan Bradonjić, Will Perkins

Abstract: We give a characterization of vertex-monotone properties with sharp thresholds in a Poisson random geometric graph or hypergraph. As an application we show that a geometric model of random k-SAT exhibits a sharp threshold for satisfiability. We give a characterization of vertex-monotone properties with sharp thresholds in a Poisson random geometric graph or hypergraph. As an application we show that a geometric model of random k-SAT exhibits a sharp threshold for satisfiability. △ Less

Submitted 22 April, 2014; v1 submitted 5 August, 2013; originally announced August 2013.

Comments: Replaces an earlier version with the title "Thresholds for Random Geometric k-SAT"

On the Resilience of Bipartite Networks

Authors: Shelby Heinecke, Will Perkins, Lev Reyzin

Abstract: Motivated by problems modeling the spread of infections in networks, in this paper we explore which bipartite graphs are most resilient to widespread infections under various parameter settings. Namely, we study bipartite networks with a requirement of a minimum degree $d$ on one side under an independent infection, independent transmission model. We completely characterize the optimal graphs in t… ▽ More Motivated by problems modeling the spread of infections in networks, in this paper we explore which bipartite graphs are most resilient to widespread infections under various parameter settings. Namely, we study bipartite networks with a requirement of a minimum degree $d$ on one side under an independent infection, independent transmission model. We completely characterize the optimal graphs in the case $d=1$, which already produces non-trivial behavior, and we give extremal results for the more general cases. We show that in the case $d=2$, surprisingly, the optimally resilient set of graphs includes a graph that is not one of the two "extremes" found in the case $d=1$. Then, we briefly examine the case where we force a connectivity requirement instead of a one-sided degree requirement and again, we find that the set of the most resilient graphs contains more than the two "extremes." We also show that determining the subgraph of an arbitrary bipartite graph most resilient to infection is NP-hard for any one-sided minimal degree $d \ge 1$. △ Less

Submitted 8 January, 2018; v1 submitted 24 June, 2013; originally announced June 2013.

Comments: 12 pages

Random k-SAT and the Power of Two Choices

Authors: Will Perkins

Abstract: We study an Achlioptas-process version of the random k-SAT process: a bounded number of k-clauses are drawn uniformly at random at each step, and exactly one added to the growing formula according to a particular rule. We prove the existence of a rule that shifts the satisfiability threshold. This extends a well-studied area of probabilistic combinatorics (Achlioptas processes) to random CSP's. In… ▽ More We study an Achlioptas-process version of the random k-SAT process: a bounded number of k-clauses are drawn uniformly at random at each step, and exactly one added to the growing formula according to a particular rule. We prove the existence of a rule that shifts the satisfiability threshold. This extends a well-studied area of probabilistic combinatorics (Achlioptas processes) to random CSP's. In particular, while a rule to delay the 2-SAT threshold was known previously, this is the first proof of a rule to shift the threshold of k-SAT for k >= 3. We then propose a gap decision problem based upon this semi-random model. The aim of the problem is to investigate the hardness of the random k-SAT decision problem, as opposed to the problem of finding an assignment or certificate of unsatisfiability. Finally, we discuss connections to the study of Achlioptas random graph processes. △ Less

Submitted 15 October, 2013; v1 submitted 24 September, 2012; originally announced September 2012.

Comments: 13 pages

Trusted Certificates in Quantum Cryptography

Authors: William Perkins

Abstract: This paper analyzes the performance of Kak's three stage quantum cryptographic protocol based on public key cryptography against a man-in-the-middle attack. A method for protecting against such an attack is presented using certificates distributed by a trusted third party. This paper analyzes the performance of Kak's three stage quantum cryptographic protocol based on public key cryptography against a man-in-the-middle attack. A method for protecting against such an attack is presented using certificates distributed by a trusted third party. △ Less

Submitted 10 March, 2006; originally announced March 2006.

Comments: 4 pages, 2 figures