Showing 1–18 of 18 results for author: Kent-Dobias, J

Algorithm-independent bounds on complex optimization through the statistics of marginal optima

Authors: Jaron Kent-Dobias

Abstract: Optimization seeks extremal points in a function. When there are superextensively many optima, optimization algorithms are liable to get stuck. Under these conditions, generic algorithms tend to find marginal optima, which have many nearly flat directions. In a companion paper, we introduce a technique to count marginal optima in random landscapes. Here, we use the statistics of marginal optima ca… ▽ More Optimization seeks extremal points in a function. When there are superextensively many optima, optimization algorithms are liable to get stuck. Under these conditions, generic algorithms tend to find marginal optima, which have many nearly flat directions. In a companion paper, we introduce a technique to count marginal optima in random landscapes. Here, we use the statistics of marginal optima calculated using this technique to produce generic bounds on optimization, based on the simple principle that algorithms will overwhelmingly tend to get stuck only where marginal optima are found. We demonstrate the idea on a simple non-Gaussian problem of maximizing the sum of squared random functions on a compact space. Numeric experiments using both gradient descent and generalized approximate message passing algorithms fall inside the expected bounds. △ Less

Submitted 2 July, 2024; originally announced July 2024.

Conditioning the complexity of random landscapes on marginal optima

Authors: Jaron Kent-Dobias

Abstract: Marginal optima are minima or maxima of a function with many nearly flat directions. In settings with many competing optima, marginal ones tend to attract algorithms and physical dynamics. Often, the important family of marginal attractors are a vanishing minority compared with nonmarginal optima and other unstable stationary points. We introduce a generic technique for conditioning the statistics… ▽ More Marginal optima are minima or maxima of a function with many nearly flat directions. In settings with many competing optima, marginal ones tend to attract algorithms and physical dynamics. Often, the important family of marginal attractors are a vanishing minority compared with nonmarginal optima and other unstable stationary points. We introduce a generic technique for conditioning the statistics of stationary points in random landscapes on their marginality, and apply it in three isotropic settings with qualitatively different structure: in the spherical spin-glasses, where the energy is Gaussian and its Hessian is GOE; in multispherical spin glasses, which are Gaussian but non-GOE; and in sums of squared spherical random functions, which are non-Gaussian. In these problems we are able to fully characterize the distribution of marginal optima in the landscape, including when they are in the minority. △ Less

Submitted 2 July, 2024; originally announced July 2024.

Origin of Symmetry Breaking in the Grasshopper Model

Authors: David Llamas, Jaron Kent-Dobias, Kun Chen, Adrian Kent, Olga Goulko

Abstract: The planar grasshopper problem, originally introduced in (Goulko & Kent 2017 Proc. R. Soc. A 473, 20170494), is a striking example of a model with long-range isotropic interactions whose ground states break rotational symmetry. In this work we analyze and explain the nature of this symmetry breaking with emphasis on the importance of dimensionality. Interestingly, rotational symmetry is recovered… ▽ More The planar grasshopper problem, originally introduced in (Goulko & Kent 2017 Proc. R. Soc. A 473, 20170494), is a striking example of a model with long-range isotropic interactions whose ground states break rotational symmetry. In this work we analyze and explain the nature of this symmetry breaking with emphasis on the importance of dimensionality. Interestingly, rotational symmetry is recovered in three dimensions for small jumps, which correspond to the non-isotropic cogwheel regime of the two-dimensional problem. We discuss simplified models that reproduce the symmetry properties of the original system in N dimensions. For the full grasshopper model in two dimensions we obtain quantitative predictions for optimal perturbations of the disk. Our analytical results are confirmed by numerical simulations. △ Less

Submitted 21 March, 2024; v1 submitted 8 November, 2023; originally announced November 2023.

Comments: Ancillary files with animations of 3d shapes included

Journal ref: Phys. Rev. Research 6, 023235 (2024)

Arrangement of nearby minima and saddles in the mixed spherical energy landscapes

Authors: Jaron Kent-Dobias

Abstract: The mixed spherical models were recently found to violate long-held assumptions about mean-field glassy dynamics. In particular, the threshold energy, where most stationary points are marginal and that in the simpler pure models attracts long-time dynamics, seems to lose significance. Here, we compute the typical distribution of stationary points relative to each other in mixed models with a repli… ▽ More The mixed spherical models were recently found to violate long-held assumptions about mean-field glassy dynamics. In particular, the threshold energy, where most stationary points are marginal and that in the simpler pure models attracts long-time dynamics, seems to lose significance. Here, we compute the typical distribution of stationary points relative to each other in mixed models with a replica symmetric complexity. We examine the stability of nearby points, accounting for the presence of an isolated eigenvalue in their spectrum due to their proximity. Despite finding rich structure not present in the pure models, we find nothing that distinguishes the points that do attract the dynamics. Instead, we find new geometric significance of the old threshold energy, and invalidate pictures of the arrangement of most marginal inherent states into a continuous manifold. △ Less

Submitted 4 December, 2023; v1 submitted 22 June, 2023; originally announced June 2023.

Comments: Submission to SciPost

Journal ref: SciPost Phys. 16, 001 (2024)

When is the average number of saddle points typical?

Authors: Jaron Kent-Dobias

Abstract: A common measure of a function's complexity is the count of its stationary points. For complicated functions, this count grows exponentially with the volume and dimension of their domain. In practice, the count is averaged over a class of functions (the annealed average), but the large numbers involved can produce averages biased by extremely rare samples. Typical counts are reliably found by taki… ▽ More A common measure of a function's complexity is the count of its stationary points. For complicated functions, this count grows exponentially with the volume and dimension of their domain. In practice, the count is averaged over a class of functions (the annealed average), but the large numbers involved can produce averages biased by extremely rare samples. Typical counts are reliably found by taking the average of the logarithm (the quenched average), which is more difficult and not often done in practice. When most stationary points are uncorrelated with each other, quenched and anneals averages are equal. Equilibrium heuristics can guarantee when most of the lowest minima will be uncorrelated. We show that these equilibrium heuristics cannot be used to draw conclusions about other minima and saddles by producing examples among Gaussian-correlated functions on the hypersphere where the count of certain saddles and minima has different quenched and annealed averages, despite being guaranteed `safe' in the equilibrium setting. We determine conditions for the emergence of nontrivial correlations between saddles, and discuss the implications for the geometry of those functions and what out-of-equilibrium settings might be affected. △ Less

Submitted 22 June, 2023; originally announced June 2023.

Journal ref: EPL 143, 61003 (2023)

Normal forms, universal scaling functions, and extending the validity of the RG

Authors: James P. Sethna, David Hathcock, Jaron Kent-Dobias, Archishman Raju

Abstract: Our community has a deep and sophisticated understanding of phase transitions and their universal scaling functions. We outline and advocate an ambitious program to use this understanding as an anchor for describing the surrounding phases. We explain how to use normal form theory to write universal scaling functions in systems where the renormalization-group flows cannot be linearized. We use the… ▽ More Our community has a deep and sophisticated understanding of phase transitions and their universal scaling functions. We outline and advocate an ambitious program to use this understanding as an anchor for describing the surrounding phases. We explain how to use normal form theory to write universal scaling functions in systems where the renormalization-group flows cannot be linearized. We use the 2d Ising model to demonstrate how to calculate high-precision implementations of universal scaling functions, and how to extend them into a complete description of the surrounding phases. We discuss prospects and challenges involved into extending these early successes to the many other systems where the RG has successfully described emergent scale invariance, making them invaluable tools for engineers, biologists, and social scientists studying complex systems. △ Less

Submitted 24 April, 2023; v1 submitted 31 March, 2023; originally announced April 2023.

Comments: Contribution to the book commemorating Michael Fisher's contributions to condensed-matter physics and critical phenomena

Log-correlated color in Monet's paintings

Authors: Jaron Kent-Dobias

Abstract: We describe evidence for logarithmic correlations within the paintings of Claude Monet. We describe evidence for logarithmic correlations within the paintings of Claude Monet. △ Less

Submitted 14 September, 2022; v1 submitted 5 September, 2022; originally announced September 2022.

How to count in hierarchical landscapes: a 'full' solution to mean-field complexity

Authors: Jaron Kent-Dobias, Jorge Kurchan

Abstract: We derive the general solution for counting the stationary points of mean-field complex landscapes. It incorporates Parisi's solution for the ground state, as it should. Using this solution, we count the stationary points of two models: one with multi-step replica symmetry breaking, and one with full replica symmetry breaking. We derive the general solution for counting the stationary points of mean-field complex landscapes. It incorporates Parisi's solution for the ground state, as it should. Using this solution, we count the stationary points of two models: one with multi-step replica symmetry breaking, and one with full replica symmetry breaking. △ Less

Submitted 2 September, 2022; v1 submitted 13 July, 2022; originally announced July 2022.

Analytic continuation over complex landscapes

Authors: Jaron Kent-Dobias, Jorge Kurchan

Abstract: In this paper we follow up the study of 'complex complex landscapes,' rugged landscapes of many complex variables. Unlike real landscapes, the classification of saddles by index is trivial. Instead, the spectrum of fluctuations at stationary points determines their topological stability under analytic continuation of the theory. Topological changes, which occur at so-called Stokes points, prolifer… ▽ More In this paper we follow up the study of 'complex complex landscapes,' rugged landscapes of many complex variables. Unlike real landscapes, the classification of saddles by index is trivial. Instead, the spectrum of fluctuations at stationary points determines their topological stability under analytic continuation of the theory. Topological changes, which occur at so-called Stokes points, proliferate among saddles with marginal (flat) directions and are suppressed otherwise. This gives a direct interpretation of the gap or 'threshold' energy -- which in the real case separates saddles from minima -- as the level where the spectrum of the hessian matrix of stationary points develops a gap. This leads to different consequences for the analytic continuation of real landscapes with different structures: the global minima of 'one step replica-symmetry broken' landscapes lie beyond a threshold, their hessians are gapped, and are locally protected from Stokes points, whereas those of 'many step replica-symmetry broken' have gapless hessians and Stokes points immediately proliferate. A new matrix ensemble is found, playing the role that GOE plays for real landscapes in determining the topological nature of saddles. △ Less

Submitted 12 April, 2022; originally announced April 2022.

Complex complex landscapes

Authors: Jaron Kent-Dobias, Jorge Kurchan

Abstract: We study the saddle-points of the $p$-spin model -- the best understood example of a `complex' (rugged) landscape -- when its $N$ variables are complex. These points are the solutions to a system of $N$ random equations of degree $p-1$. We solve for $\overline{\mathcal N}$, the number of solutions averaged over randomness in the $N\to\infty$ limit. We find that it saturates the Bézout bound… ▽ More We study the saddle-points of the $p$-spin model -- the best understood example of a `complex' (rugged) landscape -- when its $N$ variables are complex. These points are the solutions to a system of $N$ random equations of degree $p-1$. We solve for $\overline{\mathcal N}$, the number of solutions averaged over randomness in the $N\to\infty$ limit. We find that it saturates the Bézout bound $\log\overline{\mathcal N}\sim N\log(p-1)$. The Hessian of each saddle is given by a random matrix of the form $C^\dagger C$, where $C$ is a complex symmetric Gaussian matrix with a shift to its diagonal. Its spectrum has a transition where a gap develops that generalizes the notion of `threshold level' well-known in the real problem. The results from the real problem are recovered in the limit of real parameters. In this case, only the square-root of the total number of solutions are real. In terms of the complex energy, the solutions are divided into sectors where the saddles have different topological properties. △ Less

Submitted 18 December, 2020; v1 submitted 11 December, 2020; originally announced December 2020.

Journal ref: Phys. Rev. Research 3, 023064 (2021)

Glass phenomenology in the hard matrix model

Authors: J. Dong, V. Elser, G. Gyawali, K. Y. Jee, J. Kent-Dobias, A. Mandaiya, M. Renz, Y. Su

Abstract: We introduce a new toy model for the study of glasses: the hard-matrix model (HMM). This may be viewed as a single particle moving on $\mathrm{SO}(N)$, where there is a potential proportional to the 1-norm of the matrix. The ground states of the model are "crystals" where all matrix elements have the same magnitude. These are the Hadamard matrices when $N$ is divisible by four. Just as finding the… ▽ More We introduce a new toy model for the study of glasses: the hard-matrix model (HMM). This may be viewed as a single particle moving on $\mathrm{SO}(N)$, where there is a potential proportional to the 1-norm of the matrix. The ground states of the model are "crystals" where all matrix elements have the same magnitude. These are the Hadamard matrices when $N$ is divisible by four. Just as finding the latter has challenged mathematicians, our model fails to find them upon cooling and instead shows all the behaviors that characterize physical glasses. With simulations we have located the first-order crystallization temperature, the Kauzmann temperature where the glass would have the same entropy as the crystal, as well as the standard, measurement-time dependent glass transition temperature. Our model also brings to light a new kind of elementary excitation special to the glass phase: the "rubicon". In our model these are associated with the finite density of matrix elements near zero, the maximum in their contribution to the energy. Rubicons enable the system to cross between basins without thermal activation, a possibility not much discussed in the standard landscape picture. We use these modes to explain the slow dynamics in our model and speculate about their role in its quantum extension in the context of many-body localization. △ Less

Submitted 2 August, 2021; v1 submitted 16 December, 2019; originally announced December 2019.

Comments: 20 pages, 9 figures

Visualizing probabilistic models in Minkowski space with intensive symmetrized Kullback-Leibler embedding

Authors: Han Kheng Teoh, Katherine N. Quinn, Jaron Kent-Dobias, Colin B. Clement, Qingyang Xu, James P. Sethna

Abstract: We show that the predicted probability distributions for any $N$-parameter statistical model taking the form of an exponential family can be explicitly and analytically embedded isometrically in a $N{+}N$-dimensional Minkowski space. That is, the model predictions can be visualized as control parameters are varied, preserving the natural distance between probability distributions. All pairwise dis… ▽ More We show that the predicted probability distributions for any $N$-parameter statistical model taking the form of an exponential family can be explicitly and analytically embedded isometrically in a $N{+}N$-dimensional Minkowski space. That is, the model predictions can be visualized as control parameters are varied, preserving the natural distance between probability distributions. All pairwise distances between model instances are given by the symmetrized Kullback-Leibler divergence. We give formulas for these intensive symmetrized Kullback Leibler (isKL) coordinate embeddings, and illustrate the resulting visualizations with the Bernoulli (coin toss) problem, the ideal gas, $n$ sided die, the nonlinear least squares fit, and the Gaussian fit. We highlight how isKL can be used to determine the minimum number of parameters needed to describe probabilistic data, and conclude by visualizing the prediction space of the two-dimensional Ising model, where we examine the manifold behavior near its critical point. △ Less

Submitted 2 July, 2020; v1 submitted 12 December, 2019; originally announced December 2019.

Comments: 18 pages, 9 figures

Journal ref: Phys. Rev. Research 2, 033221 (2020)

Elastic properties of hidden order in URu$_{\text2}$Si$_{\text2}$ are reproduced by a staggered nematic

Authors: Jaron Kent-Dobias, Michael Matty, Brad Ramshaw

Abstract: We develop a phenomenological mean field theory describing the hidden order phase in URu$_{\text2}$Si$_{\text2}$ as a nematic of the $\text B_{\text{1g}}$ representation staggered along the $c$-axis. Several experimental features are reproduced by this theory: the topology of the temperature--pressure phase diagram, the response of the elastic modulus $(C_{11}-C_{12})/2$ above the transition at am… ▽ More We develop a phenomenological mean field theory describing the hidden order phase in URu$_{\text2}$Si$_{\text2}$ as a nematic of the $\text B_{\text{1g}}$ representation staggered along the $c$-axis. Several experimental features are reproduced by this theory: the topology of the temperature--pressure phase diagram, the response of the elastic modulus $(C_{11}-C_{12})/2$ above the transition at ambient pressure, and orthorhombic symmetry breaking in the high-pressure antiferromagnetic phase. In this scenario, hidden order is characterized by broken rotational symmetry that is modulated along the $c$-axis, the primary order of the high-pressure phase is an unmodulated nematic, and the triple point joining those two phases with the high-temperature paramagnetic phase is a Lifshitz point. △ Less

Submitted 3 July, 2020; v1 submitted 3 October, 2019; originally announced October 2019.

Journal ref: Phys. Rev. B 102, 075129 (2020)

Cluster representations and the Wolff algorithm in arbitrary external fields

Authors: Jaron Kent-Dobias, James P Sethna

Abstract: We introduce a natural way to extend celebrated spin-cluster Monte Carlo algorithms for fast thermal lattice simulations at criticality, like Wolff, to systems in arbitrary fields, be they linear magnetic vector fields or nonlinear anisotropic ones. By generalizing the 'ghost spin' representation to one with a 'ghost transformation,' global invariance to spin symmetry transformations is restored a… ▽ More We introduce a natural way to extend celebrated spin-cluster Monte Carlo algorithms for fast thermal lattice simulations at criticality, like Wolff, to systems in arbitrary fields, be they linear magnetic vector fields or nonlinear anisotropic ones. By generalizing the 'ghost spin' representation to one with a 'ghost transformation,' global invariance to spin symmetry transformations is restored at the cost of an extra degree of freedom which lives in the space of symmetry transformations. The ordinary cluster-building process can then be run on the new representation. We show that this extension preserves the scaling of accelerated dynamics in the absence of a field for Ising, Potts, and $\mathrm O(n)$ models and demonstrate the method's use in modelling the presence of novel nonlinear fields. We also provide a C++ library for the method's convenient implementation for arbitrary models. △ Less

Submitted 22 October, 2018; v1 submitted 10 May, 2018; originally announced May 2018.

Comments: 10 pages, 4 figures, 1 table

Journal ref: Phys. Rev. E 98, 063306 (2018)

Smooth and global Ising universal scaling functions

Authors: Jaron Kent-Dobias, James P. Sethna

Abstract: We describe a method for approximating the universal scaling functions for the Ising model in a field. By making use of parametric coordinates, the free energy scaling function has a polynomial series everywhere. Its form is taken to be a sum of the simplest functions that contain the singularities which must be present: the Langer essential singularity and the Yang--Lee edge singularity. Requirin… ▽ More We describe a method for approximating the universal scaling functions for the Ising model in a field. By making use of parametric coordinates, the free energy scaling function has a polynomial series everywhere. Its form is taken to be a sum of the simplest functions that contain the singularities which must be present: the Langer essential singularity and the Yang--Lee edge singularity. Requiring that the function match series expansions in the low- and high-temperature zero-field limits fixes the parametric coordinate transformation. For the two-dimensional Ising model, we show that this procedure converges exponentially with the order to which the series are matched, up to seven digits of accuracy. To facilitate use, we provide Python and Mathematica implementations of the code at both lowest order (three digit) and high accuracy. △ Less

Submitted 28 October, 2021; v1 submitted 12 July, 2017; originally announced July 2017.

Normal form for renormalization groups

Authors: Archishman Raju, Colin B. Clement, Lorien X. Hayden, Jaron P. Kent-Dobias, Danilo B. Liarte, D. Zeb Rocklin, James P. Sethna

Abstract: The results of the renormalization group are commonly advertised as the existence of power law singularities near critical points. The classic predictions are often violated and logarithmic and exponential corrections are treated on a case-by-case basis. We use the mathematics of normal form theory to systematically group these into universality families of seemingly unrelated systems united by co… ▽ More The results of the renormalization group are commonly advertised as the existence of power law singularities near critical points. The classic predictions are often violated and logarithmic and exponential corrections are treated on a case-by-case basis. We use the mathematics of normal form theory to systematically group these into universality families of seemingly unrelated systems united by common scaling variables. We recover and explain the existing literature and predict the nonlinear generalization for the universal homogeneous scaling functions. We show that this procedure leads to a better handling of the singularity even in classic cases and elaborate our framework using several examples. △ Less

Submitted 21 February, 2019; v1 submitted 31 May, 2017; originally announced June 2017.

Journal ref: Phys. Rev. X 9, 021014 (2019)

Deformation of crystals: Connections with statistical physics

Authors: James P. Sethna, Matthew K. Bierbaum, Karin A. Dahmen, Carl P. Goodrich, Julia R. Greer, Lorien X. Hayden, Jaron P. Kent-Dobias, Edward D. Lee, Danilo B. Liarte, Xiaoyue Ni, Katherine N. Quinn, Archishman Raju, D. Zeb Rocklin, Ashivni Shekhawat, Stefano Zapperi

Abstract: We give a bird's-eye view of the plastic deformation of crystals aimed at the statistical physics community, and a broad introduction into the statistical theories of forced rigid systems aimed at the plasticity community. Memory effects in magnets, spin glasses, charge density waves, and dilute colloidal suspensions are discussed in relation to the onset of plastic yielding in crystals. Dislocati… ▽ More We give a bird's-eye view of the plastic deformation of crystals aimed at the statistical physics community, and a broad introduction into the statistical theories of forced rigid systems aimed at the plasticity community. Memory effects in magnets, spin glasses, charge density waves, and dilute colloidal suspensions are discussed in relation to the onset of plastic yielding in crystals. Dislocation avalanches and complex dislocation tangles are discussed via a brief introduction to the renormalization group and scaling. Analogies to emergent scale invariance in fracture, jamming, coarsening, and a variety of depinning transitions are explored. Dislocation dynamics in crystals challenges non equilibrium statistical physics. Statistical physics provides both cautionary tales of subtle memory effects in nonequilibrium systems, and systematic tools designed to address complex scale-invariant behavior on multiple length and time scales. △ Less

Submitted 17 November, 2016; v1 submitted 19 September, 2016; originally announced September 2016.

Comments: 28 pages, 16 figures

Journal ref: Annu. Rev. Mater. Res. 47, 217 (2017)

Energy Driven Pattern Formation in Planar Dipole-Dipole Systems in the Presence of Weak Noise

Authors: Jaron Kent-Dobias, Andrew J. Bernoff

Abstract: We study pattern formation in planar fluid systems driven by intermolecular cohesion (which manifests as a line tension) and dipole-dipole repulsion which are observed in physical systems including ferrofluids in Hele-Shaw cells and Langmuir layers. When the dipolar repulsion is sufficiently strong, domains undergo forked branching reminiscent of viscous fingering. A known difficulty with these mo… ▽ More We study pattern formation in planar fluid systems driven by intermolecular cohesion (which manifests as a line tension) and dipole-dipole repulsion which are observed in physical systems including ferrofluids in Hele-Shaw cells and Langmuir layers. When the dipolar repulsion is sufficiently strong, domains undergo forked branching reminiscent of viscous fingering. A known difficulty with these models is that the energy associated with dipole-dipole interactions is singular at small distances. Following previous work, we demonstrate how to ameliorate this singularity and show that in the macroscopic limit, only the relative scale of the microscopic details of a system are relevant, and develop an expression for the system energy that depends only on a generalized line tension, Λ, that in turn depends logarithmically on that scale. We conduct numerical studies that use energy minimization to find equilibrium states. Following the subcritical bifurcations from the circle, we find a few highly symmetric stable shapes, but nothing that resembles the observed diversity of experimental and dynamically simulated domains. The application of a weak random background to the energy landscape stabilizes a smörgåsbord of domain morphologies recovering the diversity observed experimentally. With this technique, we generate a large sample of qualitatively realistic shapes and use them to create an empirical model for extracting Λ using only a shape's perimeter and morphology with high accuracy. △ Less

Submitted 24 February, 2015; v1 submitted 14 June, 2014; originally announced June 2014.

Comments: 19 pages, 11 figures

Journal ref: Phys. Rev. E 91, 032919 (2015)