Showing 1–50 of 201 results for author: Biroli, G

Quantum Thermalization via Travelling Waves

Authors: Antonio Picano, Giulio Biroli, Marco Schirò

Abstract: Isolated quantum many-body systems which thermalize under their own dynamics are expected to act as their own thermal baths, thereby bringing their local subsystems to thermal equilibrium. Here we show that the infinite-dimensional limit of a quantum lattice model, as described by Dynamical Mean-Field theory (DMFT), provides a natural framework to understand this self-consistent thermalization pro… ▽ More Isolated quantum many-body systems which thermalize under their own dynamics are expected to act as their own thermal baths, thereby bringing their local subsystems to thermal equilibrium. Here we show that the infinite-dimensional limit of a quantum lattice model, as described by Dynamical Mean-Field theory (DMFT), provides a natural framework to understand this self-consistent thermalization process. Using the Fermi-Hubbard model as working example, we demonstrate that the emergence of a self-consistent bath thermalising the system is characterized by a sharp thermalization front, moving balistically and separating the initial condition from the long-time thermal fixed point. We characterize the full DMFT dynamics through an effective temperature for which we derive a travelling-wave equation of the Fisher-Kolmogorov-Petrovsky-Piskunov (FKPP) type. This equation allows to predict the asymptotic shape of the front and its velocity, which match perfectly the full DMFT numerics. Our results provide a new angle to understand the onset of quantum thermalisation in closed isolated systems. △ Less

Submitted 30 May, 2024; originally announced May 2024.

Comments: 18 pages, 4 figures

Cascade of phase transitions in the training of Energy-based models

Authors: Dimitrios Bachtis, Giulio Biroli, Aurélien Decelle, Beatriz Seoane

Abstract: In this paper, we investigate the feature encoding process in a prototypical energy-based generative model, the Restricted Boltzmann Machine (RBM). We start with an analytical investigation using simplified architectures and data structures, and end with numerical analysis of real trainings on real datasets. Our study tracks the evolution of the model's weight matrix through its singular value dec… ▽ More In this paper, we investigate the feature encoding process in a prototypical energy-based generative model, the Restricted Boltzmann Machine (RBM). We start with an analytical investigation using simplified architectures and data structures, and end with numerical analysis of real trainings on real datasets. Our study tracks the evolution of the model's weight matrix through its singular value decomposition, revealing a series of phase transitions associated to a progressive learning of the principal modes of the empirical probability distribution. The model first learns the center of mass of the modes and then progressively resolve all modes through a cascade of phase transitions. We first describe this process analytically in a controlled setup that allows us to study analytically the training dynamics. We then validate our theoretical results by training the Bernoulli-Bernoulli RBM on real data sets. By using data sets of increasing dimension, we show that learning indeed leads to sharp phase transitions in the high-dimensional limit. Moreover, we propose and test a mean-field finite-size scaling hypothesis. This shows that the first phase transition is in the same universality class of the one we studied analytically, and which is reminiscent of the mean-field paramagnetic-to-ferromagnetic phase transition. △ Less

Submitted 29 May, 2024; v1 submitted 23 May, 2024; originally announced May 2024.

Comments: 19 pages, 6 figures

Normalizing flows as an enhanced sampling method for atomistic supercooled liquids

Authors: Gerhard Jung, Giulio Biroli, Ludovic Berthier

Abstract: Normalizing flows can transform a simple prior probability distribution into a more complex target distribution. Here, we evaluate the ability and efficiency of generative machine learning methods to sample the Boltzmann distribution of an atomistic model for glass-forming liquids. This is a notoriously difficult task, as it amounts to ergodically exploring the complex free energy landscape of a d… ▽ More Normalizing flows can transform a simple prior probability distribution into a more complex target distribution. Here, we evaluate the ability and efficiency of generative machine learning methods to sample the Boltzmann distribution of an atomistic model for glass-forming liquids. This is a notoriously difficult task, as it amounts to ergodically exploring the complex free energy landscape of a disordered and frustrated many-body system. We optimize a normalizing flow model to successfully transform high-temperature configurations of a dense liquid into low-temperature ones, near the glass transition. We perform a detailed comparative analysis with established enhanced sampling techniques developed in the physics literature to assess and rank the performance of normalizing flows against state-of-the-art algorithms. We demonstrate that machine learning methods are very promising, showing a large speedup over conventional molecular dynamics. Normalizing flows show performances comparable to parallel tempering and population annealing, while still falling far behind the swap Monte Carlo algorithm. Our study highlights the potential of generative machine learning models in scientific computing for complex systems, but also points to some of its current limitations and the need for further improvement. △ Less

Submitted 15 April, 2024; originally announced April 2024.

From Zero to Hero: How local curvature at artless initial conditions leads away from bad minima

Authors: Tony Bonnaire, Giulio Biroli, Chiara Cammarota

Abstract: We investigate the optimization dynamics of gradient descent in a non-convex and high-dimensional setting, with a focus on the phase retrieval problem as a case study for complex loss landscapes. We first study the high-dimensional limit where both the number $M$ and the dimension $N$ of the data are going to infinity at fixed signal-to-noise ratio $α= M/N$. By analyzing how the local curvature ch… ▽ More We investigate the optimization dynamics of gradient descent in a non-convex and high-dimensional setting, with a focus on the phase retrieval problem as a case study for complex loss landscapes. We first study the high-dimensional limit where both the number $M$ and the dimension $N$ of the data are going to infinity at fixed signal-to-noise ratio $α= M/N$. By analyzing how the local curvature changes during optimization, we uncover that for intermediate $α$, the Hessian displays a downward direction pointing towards good minima in the first regime of the descent, before being trapped in bad minima at the end. Hence, the local landscape is benign and informative at first, before gradient descent brings the system into a uninformative maze. The transition between the two regimes is associated to a BBP-type threshold in the time-dependent Hessian. Through both theoretical analysis and numerical experiments, we show that in practical cases, i.e. for finite but even very large $N$, successful optimization via gradient descent in phase retrieval is achieved by falling towards the good minima before reaching the bad ones. This mechanism explains why successful recovery is obtained well before the algorithmic transition corresponding to the high-dimensional limit. Technically, this is associated to strong logarithmic corrections of the algorithmic transition at large $N$ with respect to the one expected in the $N\to\infty$ limit. Our analysis sheds light on such a new mechanism that facilitate gradient descent dynamics in finite large dimensions, also highlighting the importance of good initialization of spectral properties for optimization in complex high-dimensional landscapes. △ Less

Submitted 4 March, 2024; originally announced March 2024.

Comments: 21 pages, 10 figures

Dynamical Regimes of Diffusion Models

Authors: Giulio Biroli, Tony Bonnaire, Valentin de Bortoli, Marc Mézard

Abstract: Using statistical physics methods, we study generative diffusion models in the regime where the dimension of space and the number of data are large, and the score function has been trained optimally. Our analysis reveals three distinct dynamical regimes during the backward generative diffusion process. The generative dynamics, starting from pure noise, encounters first a 'speciation' transition wh… ▽ More Using statistical physics methods, we study generative diffusion models in the regime where the dimension of space and the number of data are large, and the score function has been trained optimally. Our analysis reveals three distinct dynamical regimes during the backward generative diffusion process. The generative dynamics, starting from pure noise, encounters first a 'speciation' transition where the gross structure of data is unraveled, through a mechanism similar to symmetry breaking in phase transitions. It is followed at later time by a 'collapse' transition where the trajectories of the dynamics become attracted to one of the memorized data points, through a mechanism which is similar to the condensation in a glass phase. For any dataset, the speciation time can be found from a spectral analysis of the correlation matrix, and the collapse time can be found from the estimation of an 'excess entropy' in the data. The dependence of the collapse time on the dimension and number of data provides a thorough characterization of the curse of dimensionality for diffusion models. Analytical solutions for simple models like high-dimensional Gaussian mixtures substantiate these findings and provide a theoretical framework, while extensions to more complex scenarios and numerical validations with real datasets confirm the theoretical predictions. △ Less

Submitted 28 February, 2024; originally announced February 2024.

Comments: 22 pages, 11 figures

Yielding and plasticity in amorphous solids

Authors: Ludovic Berthier, Giulio Biroli, M. Lisa Manning, Francesco Zamponi

Abstract: The physics of disordered media, from metallic glasses to colloidal suspensions, granular matter and biological tissues, offers difficult challenges because it often occurs far from equilibrium, in materials lacking symmetries and evolving through complex energy landscapes. Here, we review recent theoretical efforts to provide microscopic insights into the mechanical properties of amorphous media… ▽ More The physics of disordered media, from metallic glasses to colloidal suspensions, granular matter and biological tissues, offers difficult challenges because it often occurs far from equilibrium, in materials lacking symmetries and evolving through complex energy landscapes. Here, we review recent theoretical efforts to provide microscopic insights into the mechanical properties of amorphous media using approaches from statistical mechanics as unifying frameworks. We cover both the initial regime corresponding to small deformations, and the yielding transition marking a change between elastic response and plastic flow. We discuss the specific features arising for systems evolving near a jamming transition, and extend our discussion to recent studies of the rheology of dense biological and active materials. △ Less

Submitted 17 January, 2024; originally announced January 2024.

Comments: 20 pages, 7 figures

Dynamical Facilitation Governs the Equilibration Dynamics of Glasses

Authors: Rahul N. Chacko, François P. Landes, Giulio Biroli, Olivier Dauchot, Andrea J. Liu, David R. Reichman

Abstract: Convincing evidence of domain growth in the heating of ultrastable glasses suggests that the equilibration dynamics of super-cooled liquids could be driven by a nucleation and growth mechanism. We investigate this possibility by simulating the equilibration dynamics of a model glass during both heating and cooling between poorly and well-annealed states. Though we do observe the growth of domains… ▽ More Convincing evidence of domain growth in the heating of ultrastable glasses suggests that the equilibration dynamics of super-cooled liquids could be driven by a nucleation and growth mechanism. We investigate this possibility by simulating the equilibration dynamics of a model glass during both heating and cooling between poorly and well-annealed states. Though we do observe the growth of domains during heating, we find that domains are absent during cooling. This absence is inconsistent with classical nucleation theory. By comparing the equilibration dynamics of our glass with that of two models with kinetic constraints, we demonstrate that dynamical facilitation generically leads to heating driven by domain growth and cooling without domains. Our results provide strong evidence that dynamical facilitation, not nucleation and interfacial-tension-driven domain growth, is the driving mechanism for the equilibration dynamics of glass-formers. △ Less

Submitted 10 May, 2024; v1 submitted 22 December, 2023; originally announced December 2023.

Comments: 21 pages, 16 figures. Supplemental Movies too large for arXiv. Will provide download link once available. Available on request until then

Large-deviation analysis of rare resonances for the Many-Body localization transition

Authors: Giulio Biroli, Alexander K. Hartmann, Marco Tarzia

Abstract: A central theoretical issue at the core of the current research on many-body localization (MBL) consists in characterizing the statistics of rare long-range resonances in many-body eigenstates. This is of paramount importance to understand: (i) the critical properties of the MBL transition and the mechanism for its destabilization through quantum avalanches; (ii) the unusual transport and anomalou… ▽ More A central theoretical issue at the core of the current research on many-body localization (MBL) consists in characterizing the statistics of rare long-range resonances in many-body eigenstates. This is of paramount importance to understand: (i) the critical properties of the MBL transition and the mechanism for its destabilization through quantum avalanches; (ii) the unusual transport and anomalously slow out-of-equilibrium relaxation when the transition is approached from the metallic side. In order to study and characterize such long-range rare resonances, we develop a large-deviations approach based on an analogy with the physics of directed polymers in random media, and in particular with their freezing glass transition on infinite-dimensional graphs. The basic idea is to enlarge the parameter space by adding an auxiliary parameter (which plays the role of the inverse temperature in the directed polymer formulation) which allows us to fine-tune the effect of anomalously large outliers in the far-tails of the probability distributions of the transmission amplitudes between far-away many-body configurations in the Hilbert space. We first benchmark our approach onto two non-interacting paradigmatic toy models, namely the single-particle Anderson model on the (loop-less) Cayley tree and the Rosenzweig-Porter random matrix ensemble, and then apply it to the study of a class of disordered quantum spin chains in a transverse field. This analysis shows the existence of a broad disorder range in which rare, long-distance resonances, that may form only for a few specific realizations of the disorder and a few specific choice of the random initial state, destabilize the MBL phase, while the genuine MBL transition is shifted to much larger values of the disorder than originally thought. △ Less

Submitted 22 December, 2023; originally announced December 2023.

Comments: 34 pages, 16 figures

Ductile-to-brittle transition and yielding in soft amorphous materials: perspectives and open questions

Authors: Thibaut Divoux, Elisabeth Agoritsas, Stefano Aime, Catherine Barentin, Jean-Louis Barrat, Roberto Benzi, Ludovic Berthier, Dapeng Bi, Giulio Biroli, Daniel Bonn, Philippe Bourrianne, Mehdi Bouzid, Emanuela Del Gado, Hélène Delanoë-Ayari, Kasra Farain, Suzanne Fielding, Matthias Fuchs, Jasper van der Gucht, Silke Henkes, Maziyar Jalaal, Yogesh M. Joshi, Anaël Lemaître, Robert L. Leheny, Sébastien Manneville, Kirsten Martens , et al. (15 additional authors not shown)

Abstract: Soft amorphous materials are viscoelastic solids ubiquitously found around us, from clays and cementitious pastes to emulsions and physical gels encountered in food or biomedical engineering. Under an external deformation, these materials undergo a noteworthy transition from a solid to a liquid state that reshapes the material microstructure. This yielding transition was the main theme of a worksh… ▽ More Soft amorphous materials are viscoelastic solids ubiquitously found around us, from clays and cementitious pastes to emulsions and physical gels encountered in food or biomedical engineering. Under an external deformation, these materials undergo a noteworthy transition from a solid to a liquid state that reshapes the material microstructure. This yielding transition was the main theme of a workshop held from January 9 to 13, 2023 at the Lorentz Center in Leiden. The manuscript presented here offers a critical perspective on the subject, synthesizing insights from the various brainstorming sessions and informal discussions that unfolded during this week of vibrant exchange of ideas. The result of these exchanges takes the form of a series of open questions that represent outstanding experimental, numerical, and theoretical challenges to be tackled in the near future. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: 21 pages, 7 figures, perspective on the workshop 'Yield stress and fluidization in brittle and ductile amorphous systems' held from January 9 to 13, 2023 at the Lorentz Center in Leiden

Mean-Field Analysis of the Glassy Dynamics of an Elastoplastic Model of Super-Cooled Liquids

Authors: Joseph W. Baron, Giulio Biroli

Abstract: We present a mean-field theory of a coarse-grained model of a super-cooled liquid in which relaxation occurs via local plastic rearrangements. Local relaxation can be induced by thermal fluctuations or by the long-range elastic consequences of other rearrangements. We extract the temperature dependence of both the relaxation time and the lengthscale of dynamical correlations. We find two dynamical… ▽ More We present a mean-field theory of a coarse-grained model of a super-cooled liquid in which relaxation occurs via local plastic rearrangements. Local relaxation can be induced by thermal fluctuations or by the long-range elastic consequences of other rearrangements. We extract the temperature dependence of both the relaxation time and the lengthscale of dynamical correlations. We find two dynamical regimes. First, a regime in which the characteristic time and length scales diverge as a power law at a critical temperature $T_c$. This regime is found by an approximation that neglects activated relaxation channels, which can be interpreted as akin to the one found by the mode-coupling transition of glasses. In reality, only a cross-over takes place at $T_c$. The residual plastic activity leads to a second regime characterised by an Arrhenius law below $T_c$. In this case, we show that the lengthscale governing dynamical correlations diverges as a power law as $T\to 0$, and is logarithmically related to the relaxation time. △ Less

Submitted 6 December, 2023; originally announced December 2023.

Comments: 15 pages, 7 figures

Curvature-driven pathways interpolating between stationary points: the case of the pure spherical 3-spin model

Authors: Alessandro Pacco, Giulio Biroli, Valentina Ros

Abstract: This paper focuses on characterizing the energy profile along pathways connecting different regions of configuration space in the context of a prototypical glass model, the pure spherical $p$-spin model with $p=3$. The study investigates pairs of stationary points (local minima or rank-1 saddles), analyzing the energy profile along geodesic paths and comparing them with "perturbed" pathways correl… ▽ More This paper focuses on characterizing the energy profile along pathways connecting different regions of configuration space in the context of a prototypical glass model, the pure spherical $p$-spin model with $p=3$. The study investigates pairs of stationary points (local minima or rank-1 saddles), analyzing the energy profile along geodesic paths and comparing them with "perturbed" pathways correlated to the landscape curvature. The goal is to assess the extent to which information from the local Hessian matrices around stationary points can identify paths with lower energy barriers. Surprisingly, unlike findings in other systems, the direction of softest local curvature is not a reliable predictor of low-energy paths, except in the case in which the direction of softest curvature corresponds to an isolated mode of the Hessian. However, other information encoded in the local Hessian does allow the identification of pathways associated with lower energy barriers. We conclude commenting on implications for the system's activated dynamics. △ Less

Submitted 30 November, 2023; originally announced November 2023.

Roadmap on machine learning glassy liquids

Authors: Gerhard Jung, Rinske M. Alkemade, Victor Bapst, Daniele Coslovich, Laura Filion, François P. Landes, Andrea Liu, Francesco Saverio Pezzicoli, Hayato Shiba, Giovanni Volpe, Francesco Zamponi, Ludovic Berthier, Giulio Biroli

Abstract: Unraveling the connections between microscopic structure, emergent physical properties, and slow dynamics has long been a challenge in the field of the glass transition. The absence of clear visible structural order in amorphous configurations complicates the identification of the key features related to structural relaxation and transport properties. The difficulty in sampling equilibrated config… ▽ More Unraveling the connections between microscopic structure, emergent physical properties, and slow dynamics has long been a challenge in the field of the glass transition. The absence of clear visible structural order in amorphous configurations complicates the identification of the key features related to structural relaxation and transport properties. The difficulty in sampling equilibrated configurations at low temperatures hampers thorough numerical and theoretical investigations. This roadmap article explores the potential of machine learning (ML) techniques to face these challenges, building on the algorithms that have revolutionized computer vision and image recognition. We present successful ML applications, as well as many open problems for the future, such as transferability and interpretability of ML approaches. We highlight new ideas and directions in which ML could provide breakthroughs to better understand glassy liquids. To foster a collaborative community effort, the article introduces the "GlassBench" dataset, providing simulation data and benchmarks for both two-dimensional and three-dimensional glass-formers. Emphasizing the importance of benchmarks, we identify critical metrics for comparing the performance of emerging ML methodologies, in line with benchmarking practices in image and text recognition. The goal of this roadmap is to provide guidelines for the development of ML techniques in systems displaying slow dynamics, while inspiring new directions to improve our understanding of glassy liquids. △ Less

Submitted 23 November, 2023; originally announced November 2023.

On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions

Authors: Simon Martin, Francis Bach, Giulio Biroli

Abstract: We study the training dynamics of a shallow neural network with quadratic activation functions and quadratic cost in a teacher-student setup. In line with previous works on the same neural architecture, the optimization is performed following the gradient flow on the population risk, where the average over data points is replaced by the expectation over their distribution, assumed to be Gaussian.W… ▽ More We study the training dynamics of a shallow neural network with quadratic activation functions and quadratic cost in a teacher-student setup. In line with previous works on the same neural architecture, the optimization is performed following the gradient flow on the population risk, where the average over data points is replaced by the expectation over their distribution, assumed to be Gaussian.We first derive convergence properties for the gradient flow and quantify the overparameterization that is necessary to achieve a strong signal recovery. Then, assuming that the teachers and the students at initialization form independent orthonormal families, we derive a high-dimensional limit for the flow and show that the minimal overparameterization is sufficient for strong recovery. We verify by numerical experiments that these results hold for more general initializations. △ Less

Submitted 7 November, 2023; originally announced November 2023.

Dynamic heterogeneity at the experimental glass transition predicted by transferable machine learning

Authors: Gerhard Jung, Giulio Biroli, Ludovic Berthier

Abstract: We develop a transferable machine learning model which predicts structural relaxation from amorphous supercooled liquid structures. The trained networks are able to predict dynamic heterogeneity across a broad range of temperatures and time scales with excellent accuracy and transferability. We use the network transferability to predict dynamic heterogeneity down to the experimental glass transiti… ▽ More We develop a transferable machine learning model which predicts structural relaxation from amorphous supercooled liquid structures. The trained networks are able to predict dynamic heterogeneity across a broad range of temperatures and time scales with excellent accuracy and transferability. We use the network transferability to predict dynamic heterogeneity down to the experimental glass transition temperature, $T_g$, where structural relaxation cannot be analyzed using molecular dynamics simulations. The results indicate that the strength, the geometry and the characteristic length scale of the dynamic heterogeneity evolve much more slowly near $T_g$ compared to their evolution at higher temperatures. Our results show that machine learning techniques can provide physical insights on the nature of the glass transition that cannot be gained using conventional simulation techniques. △ Less

Submitted 31 October, 2023; originally announced October 2023.

Journal ref: Phys. Rev. B 109, 064205 (2024)

Shear-Induced Phase Behavior and Topological Defects in Two-Dimensional Crystals

Authors: Federico Ghimenti, Misaki Ozawa, Giulio Biroli, Gilles Tarjus

Abstract: We investigate through numerical simulations how a two-dimensional crystal yields and flows under an applied shear. We focus over a range that allows us to both address the response in the limit of an infinitesimal shear rate and describe the phase behavior of the system at a finite shear rate. In doing so, we carefully discuss the role of the topological defects and of the finite-size effects. We… ▽ More We investigate through numerical simulations how a two-dimensional crystal yields and flows under an applied shear. We focus over a range that allows us to both address the response in the limit of an infinitesimal shear rate and describe the phase behavior of the system at a finite shear rate. In doing so, we carefully discuss the role of the topological defects and of the finite-size effects. We map out the whole phase diagram of the flowing steady state in the plane formed by temperature and shear rate. Shear-induced melting of the two-dimensional crystal is found to proceed in two steps: first, the solid loses long-range bond-orientational order and flows, even for an infinitesimal shear rate (in the thermodynamic limit). The resulting flowing hexatic phase then melts to a flowing, rather isotropic, liquid at a finite shear rate that depends on temperature. Finally, at a high shear rate, a third regime corresponding to a strongly anisotropic string-like flowing phase appears. △ Less

Submitted 8 October, 2023; originally announced October 2023.

Far-from-equilibrium criticality in the Random Field Ising Model with Eshelby Interactions

Authors: Saverio Rossi, Giulio Biroli, Misaki Ozawa, Gilles Tarjus

Abstract: We study a quasi-statically driven random field Ising model (RFIM) at zero temperature with interactions mediated by the long-range anisotropic Eshelby kernel. Analogously to amorphous solids at their yielding transition, and differently from ferromagnetic and dipolar RFIMs, the model shows a discontinuous magnetization jump associated with the appearance of a band-like structure for weak disorder… ▽ More We study a quasi-statically driven random field Ising model (RFIM) at zero temperature with interactions mediated by the long-range anisotropic Eshelby kernel. Analogously to amorphous solids at their yielding transition, and differently from ferromagnetic and dipolar RFIMs, the model shows a discontinuous magnetization jump associated with the appearance of a band-like structure for weak disorder and a continuous magnetization growth, yet punctuated by avalanches, for strong disorder. Through a finite-size scaling analysis in 2 and 3 dimensions we find that the two regimes are separated by a finite-disorder critical point which we characterize. We discuss similarities and differences between the present model and models of sheared amorphous solids. △ Less

Submitted 26 September, 2023; originally announced September 2023.

Journal ref: Phys. Rev. B 108, L220202 (2023)

Interactions and migration rescuing ecological diversity

Authors: Giulia Garcia Lorenzana, Ada Altieri, Giulio Biroli

Abstract: How diversity is maintained in natural ecosystems is a long-standing question in Theoretical Ecology. By studying a system that combines ecological dynamics, heterogeneous interactions and spatial structure, we uncover a new mechanism for the survival of diversity-rich ecosystems in the presence of demographic fluctuations. For a single species, one finds a continuous phase transition between an e… ▽ More How diversity is maintained in natural ecosystems is a long-standing question in Theoretical Ecology. By studying a system that combines ecological dynamics, heterogeneous interactions and spatial structure, we uncover a new mechanism for the survival of diversity-rich ecosystems in the presence of demographic fluctuations. For a single species, one finds a continuous phase transition between an extinction and a survival state, that falls into the universality class of Directed Percolation. Here we show that the case of many species with heterogeneous interactions is different and richer. By merging theory and simulations, we demonstrate that with sufficiently strong demographic noise, the system exhibits behavior akin to the single-species case, undergoing a continuous transition. Conversely, at low demographic noise, we observe unique features indicative of the ecosystem's complexity. The combined effects of the heterogeneity in the interaction network and migration enable the community to thrive, even in situations where demographic noise would lead to the extinction of isolated species. The emergence of mutualism induces the development of global bistability, accompanied by sudden tip** points. We present a way to predict the catastrophic shift from high diversity to extinction by probing responses to perturbations as an early warning signal. △ Less

Submitted 5 February, 2024; v1 submitted 18 September, 2023; originally announced September 2023.

Comments: 13 pages, 10 figures, + 14 pages, 6 figures in Appendix

High-Dimensional Non-Convex Landscapes and Gradient Descent Dynamics

Authors: Tony Bonnaire, Davide Ghio, Kamesh Krishnamurthy, Francesca Mignacco, Atsushi Yamamura, Giulio Biroli

Abstract: In these lecture notes we present different methods and concepts developed in statistical physics to analyze gradient descent dynamics in high-dimensional non-convex landscapes. Our aim is to show how approaches developed in physics, mainly statistical physics of disordered systems, can be used to tackle open questions on high-dimensional dynamics in Machine Learning. In these lecture notes we present different methods and concepts developed in statistical physics to analyze gradient descent dynamics in high-dimensional non-convex landscapes. Our aim is to show how approaches developed in physics, mainly statistical physics of disordered systems, can be used to tackle open questions on high-dimensional dynamics in Machine Learning. △ Less

Submitted 10 November, 2023; v1 submitted 7 August, 2023; originally announced August 2023.

Comments: Lectures given by G. Biroli at the 2022 Les Houches Summer School "Statistical Physics and Machine Learning"

Generative diffusion in very large dimensions

Authors: Giulio Biroli, Marc Mézard

Abstract: Generative models based on diffusion have become the state of the art in the last few years, notably for image generation. Here, we analyse them in the high-dimensional limit, where data are formed by a very large number of variables. We use methods from statistical physics and focus on two well-controlled high-dimensional cases: a Gaussian model and the Curie-Weiss model of ferromagnetism. In the… ▽ More Generative models based on diffusion have become the state of the art in the last few years, notably for image generation. Here, we analyse them in the high-dimensional limit, where data are formed by a very large number of variables. We use methods from statistical physics and focus on two well-controlled high-dimensional cases: a Gaussian model and the Curie-Weiss model of ferromagnetism. In the latter case, we highlight the mechanism of symmetry breaking in the inverse diffusion, and point out that, in order to reconstruct the relative asymmetry of the two low-temperature states, and thus to obtain the correct probability weights, one needs a database with a number of points much larger than the dimension of each data point. We characterize the scaling laws in the number of data and in the number of dimensions for an efficient generation. △ Less

Submitted 24 August, 2023; v1 submitted 6 June, 2023; originally announced June 2023.

Comments: 10 pages

Journal ref: J. Stat. Mech. (2023) 093402

Scaling Description of Dynamical Heterogeneity and Avalanches of Relaxation in Glass-Forming Liquids

Authors: Ali Tahaei, Giulio Biroli, Misaki Ozawa, Marko Popović, Matthieu Wyart

Abstract: We provide a theoretical description of dynamical heterogeneities in glass-forming liquids, based on the premise that relaxation occurs via local rearrangements coupled by elasticity. In our framework, the growth of the dynamical correlation length $ξ$ and of the correlation volume $χ_4$ are controlled by a zero-temperature fixed point. We connect this critical behavior to the properties of the di… ▽ More We provide a theoretical description of dynamical heterogeneities in glass-forming liquids, based on the premise that relaxation occurs via local rearrangements coupled by elasticity. In our framework, the growth of the dynamical correlation length $ξ$ and of the correlation volume $χ_4$ are controlled by a zero-temperature fixed point. We connect this critical behavior to the properties of the distribution of local energy barriers at zero temperature. Our description makes a direct connection between dynamical heterogeneities and avalanche-type relaxation associated to dynamic facilitation, allowing us to relate the size distribution of heterogeneities to their time evolution. Within an avalanche, a local region relaxes multiple times, the more the larger is the avalanche. This property, related to the nature of the zero-temperature fixed point, directly leads to decoupling of particle diffusion and relaxation time (the so-called Stokes-Einstein violation). Our most salient predictions are tested and confirmed by numerical simulations of scalar and tensorial thermal elasto-plastic models. △ Less

Submitted 3 August, 2023; v1 submitted 29 April, 2023; originally announced May 2023.

Quenched complexity of equilibria for asymmetric Generalized Lotka-Volterra equations

Authors: Valentina Ros, Felix Roy, Giulio Biroli, Guy Bunin

Abstract: We consider the Generalized Lotka-Volterra system of equations with all-to-all, random asymmetric interactions describing high-dimensional, very diverse and well-mixed ecosystems. We analyze the multiple equilibria phase of the model and compute its quenched complexity, i.e., the expected value of the logarithm of the number of equilibria of the dynamical equations. We discuss the resulting distri… ▽ More We consider the Generalized Lotka-Volterra system of equations with all-to-all, random asymmetric interactions describing high-dimensional, very diverse and well-mixed ecosystems. We analyze the multiple equilibria phase of the model and compute its quenched complexity, i.e., the expected value of the logarithm of the number of equilibria of the dynamical equations. We discuss the resulting distribution of equilibria as a function of their diversity, stability and average abundance. We obtain the quenched complexity by means of the replicated Kac-Rice formalism, and compare the results with the same quantity obtained within the annealed approximation, as well as with the results of the cavity calculation and, in the limit of symmetric interactions, of standard methods to compute the complexity developed in the context of glasses. △ Less

Submitted 25 June, 2023; v1 submitted 11 April, 2023; originally announced April 2023.

Comments: v2 with small modifications

Generalized Lotka-Volterra equations with random, non-reciprocal interactions: the typical number of equilibria

Authors: Valentina Ros, Felix Roy, Giulio Biroli, Guy Bunin, Ari M. Turner

Abstract: We compute the typical number of equilibria of the Generalized Lotka-Volterra equations describing species-rich ecosystems with random, non-reciprocal interactions using the replicated Kac-Rice method. We characterize the multiple-equilibria phase by determining the average abundance and similaritybetween equilibria as a function of their diversity (i.e. of the number of coexisting species) and of… ▽ More We compute the typical number of equilibria of the Generalized Lotka-Volterra equations describing species-rich ecosystems with random, non-reciprocal interactions using the replicated Kac-Rice method. We characterize the multiple-equilibria phase by determining the average abundance and similaritybetween equilibria as a function of their diversity (i.e. of the number of coexisting species) and of the variability of the interactions. We show that linearly unstable equilibria are dominant, and that the typical number of equilibria differs with respect to the average number. △ Less

Submitted 25 June, 2023; v1 submitted 4 December, 2022; originally announced December 2022.

Comments: v2 with minor changes

Journal ref: Physical Review Letters 130 (25), 257401 (2023)

Predicting dynamic heterogeneity in glass-forming liquids by physics-inspired machine learning

Authors: Gerhard Jung, Giulio Biroli, Ludovic Berthier

Abstract: We introduce GlassMLP, a machine learning framework using physics-inspired structural input to predict the long-time dynamics in deeply supercooled liquids. We apply this deep neural network to atomistic models in 2D and 3D. Its performance is better than the state of the art while being more parsimonious in terms of training data and fitting parameters. GlassMLP quantitatively predicts four-point… ▽ More We introduce GlassMLP, a machine learning framework using physics-inspired structural input to predict the long-time dynamics in deeply supercooled liquids. We apply this deep neural network to atomistic models in 2D and 3D. Its performance is better than the state of the art while being more parsimonious in terms of training data and fitting parameters. GlassMLP quantitatively predicts four-point dynamic correlations and the geometry of dynamic heterogeneity. Transferability across system sizes allows us to efficiently probe the temperature evolution of spatial dynamic correlations, revealing a profound change with temperature in the geometry of rearranging regions. △ Less

Submitted 28 September, 2023; v1 submitted 29 October, 2022; originally announced October 2022.

Journal ref: Phys. Rev. Lett. 130, 238202 (2023)

Elasticity, Facilitation and Dynamic Heterogeneity in Glass-Forming liquids

Authors: Misaki Ozawa, Giulio Biroli

Abstract: We study the role of elasticity-induced facilitation on the dynamics of glass-forming liquids by a coarse-grained two-dimensional model in which local relaxation events, taking place by thermal activation, can trigger new relaxations by long-range elastically-mediated interactions. By simulations and an analytical theory, we show that the model reproduces the main salient facts associated with dyn… ▽ More We study the role of elasticity-induced facilitation on the dynamics of glass-forming liquids by a coarse-grained two-dimensional model in which local relaxation events, taking place by thermal activation, can trigger new relaxations by long-range elastically-mediated interactions. By simulations and an analytical theory, we show that the model reproduces the main salient facts associated with dynamic heterogeneity and offers a mechanism to explain the emergence of dynamical correlations at the glass transition. We also discuss how it can be generalized and combined with current theories. △ Less

Submitted 19 September, 2022; originally announced September 2022.

Comments: Letter + SI

Dynamical Heterogeneity in Glass-Forming Liquids

Authors: Giulio Biroli, Kunimasa Miyazaki, David R. Reichman

Abstract: We review the phenomena of dynamical heterogeneity in glass-forming systems and its description within replica and mean-field theories of the glass transition. We review the phenomena of dynamical heterogeneity in glass-forming systems and its description within replica and mean-field theories of the glass transition. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Comments: To appear as a chapter in the book "Spin Glass Theory and Far Beyond - Replica Symmetry Breaking after 40 years"

The RFOT Theory of Glasses: Recent Progress and Open Issues

Authors: Giulio Biroli, Jean-Philippe Bouchaud

Abstract: The Random First Order Transition (RFOT) theory started with the pioneering work of Kirkpatrick, Thirumalai and Wolynes. It leverages the methods and advances of the theory of disordered systems. It fares remarkably well at reproducing the salient experimental facts of super-cooled liquids. Yet, direct and indisputable experimental validations are missing. In this short survey, we will review rece… ▽ More The Random First Order Transition (RFOT) theory started with the pioneering work of Kirkpatrick, Thirumalai and Wolynes. It leverages the methods and advances of the theory of disordered systems. It fares remarkably well at reproducing the salient experimental facts of super-cooled liquids. Yet, direct and indisputable experimental validations are missing. In this short survey, we will review recent investigations that broadly support all static aspects of RFOT, but also those for which the standard dynamical extension of the theory appears to be struggling, in particular in relation with facilitation effects. We discuss possible solutions and open issues. △ Less

Submitted 11 August, 2022; originally announced August 2022.

Wavelet Conditional Renormalization Group

Authors: Tanguy Marchand, Misaki Ozawa, Giulio Biroli, Stéphane Mallat

Abstract: We develop a multiscale approach to estimate high-dimensional probability distributions from a dataset of physical fields or configurations observed in experiments or simulations. In this way we can estimate energy functions (or Hamiltonians) and efficiently generate new samples of many-body systems in various domains, from statistical physics to cosmology. Our method -- the Wavelet Conditional Re… ▽ More We develop a multiscale approach to estimate high-dimensional probability distributions from a dataset of physical fields or configurations observed in experiments or simulations. In this way we can estimate energy functions (or Hamiltonians) and efficiently generate new samples of many-body systems in various domains, from statistical physics to cosmology. Our method -- the Wavelet Conditional Renormalization Group (WC-RG) -- proceeds scale by scale, estimating models for the conditional probabilities of "fast degrees of freedom" conditioned by coarse-grained fields. These probability distributions are modeled by energy functions associated with scale interactions, and are represented in an orthogonal wavelet basis. WC-RG decomposes the microscopic energy function as a sum of interaction energies at all scales and can efficiently generate new samples by going from coarse to fine scales. Near phase transitions, it avoids the "critical slowing down" of direct estimation and sampling algorithms. This is explained theoretically by combining results from RG and wavelet theories, and verified numerically for the Gaussian and $\varphi^4$ field theories. We show that multiscale WC-RG energy-based models are more general than local potential models and can capture the physics of complex many-body interacting systems at all length scales. This is demonstrated for weak-gravitational-lensing fields reflecting dark matter distributions in cosmology, which include long-range interactions with long-tail probability distributions. WC-RG has a large number of potential applications in non-equilibrium systems, where the underlying distribution is not known {\it a priori}. Finally, we discuss the connection between WC-RG and deep network architectures. △ Less

Submitted 11 July, 2022; originally announced July 2022.

Comments: 36 pages, 21 figures

Finite-disorder critical point in the yielding transition of elasto-plastic models

Authors: Saverio Rossi, Giulio Biroli, Misaki Ozawa, Gilles Tarjus, Francesco Zamponi

Abstract: Upon loading, amorphous solids can exhibit brittle yielding, with the abrupt formation of macroscopic shear bands leading to fracture, or ductile yielding, with a multitude of plastic events leading to homogeneous flow. It has been recently proposed, and subsequently questioned, that the two regimes are separated by a sharp critical point, as a function of some control parameter characterizing the… ▽ More Upon loading, amorphous solids can exhibit brittle yielding, with the abrupt formation of macroscopic shear bands leading to fracture, or ductile yielding, with a multitude of plastic events leading to homogeneous flow. It has been recently proposed, and subsequently questioned, that the two regimes are separated by a sharp critical point, as a function of some control parameter characterizing the intrinsic disorder strength and the degree of stability of the solid. In order to resolve this issue, we have performed extensive numerical simulations of athermally driven elasto-plastic models with long-range and anisotropic realistic interaction kernels in two and three dimensions. Our results provide clear evidence for a finite-disorder critical point separating brittle and ductile yielding, and we provide an estimate of the critical exponents in 2D and 3D. △ Less

Submitted 24 November, 2022; v1 submitted 22 April, 2022; originally announced April 2022.

Journal ref: Phys. Rev. Lett. 129, 228002 (2022)

Equilibrium Fluctuations in Mean-field Disordered Models

Authors: Giampaolo Folena, Giulio Biroli, Patrick Charbonneau, Yi Hu, Francesco Zamponi

Abstract: Mean-field models of glasses that present a random first order transition exhibit highly non-trivial fluctuations. Building on previous studies that focused on the critical scaling regime, we here obtain a fully quantitative framework for all equilibrium conditions. By means of the replica method we evaluate Gaussian fluctuations of the overlaps around the thermodynamic limit, decomposing them in… ▽ More Mean-field models of glasses that present a random first order transition exhibit highly non-trivial fluctuations. Building on previous studies that focused on the critical scaling regime, we here obtain a fully quantitative framework for all equilibrium conditions. By means of the replica method we evaluate Gaussian fluctuations of the overlaps around the thermodynamic limit, decomposing them in thermal fluctuations inside each state and heterogeneous fluctuations between different states. We first test and compare our analytical results with numerical simulation results for the p-spin spherical model and the random orthogonal model, and then analyze the random Lorentz gas. In all cases, a strong quantitative agreement is obtained. Our analysis thus provides a robust scheme for identifying the key finite-size (or finite-dimensional) corrections to the mean-field treatment of these paradigmatic glass models. △ Less

Submitted 23 June, 2022; v1 submitted 15 February, 2022; originally announced February 2022.

Comments: 39 pages, 21 figures, major changes in the nomenclature and revision of the appendices

Journal ref: Phys. Rev. E 106, 024605 (2022)

Artificial selection of communities drives the emergence of structured interactions

Authors: Jules Fraboul, Giulio Biroli, Silvia De Monte

Abstract: Species-rich communities, such as the microbiota or microbial ecosystems, provide key functions for human health and climatic resilience. Increasing effort is being dedicated to design experimental protocols for selecting community-level functions of interest. These experiments typically involve selection acting on populations of communities, each of which is composed of multiple species. If numer… ▽ More Species-rich communities, such as the microbiota or microbial ecosystems, provide key functions for human health and climatic resilience. Increasing effort is being dedicated to design experimental protocols for selecting community-level functions of interest. These experiments typically involve selection acting on populations of communities, each of which is composed of multiple species. If numerical simulations started to explore the evolutionary dynamics of this complex, multi-scale system, a comprehensive theoretical understanding of the process of artificial selection of communities is still lacking. Here, we propose a general model for the evolutionary dynamics of communities composed of a large number of interacting species, described by disordered generalised Lotka-Volterra equations. Our analytical and numerical results reveal that selection for scalar community functions leads to the emergence, along an evolutionary trajectory, of a low-dimensional structure in an initially featureless interaction matrix. Such structure reflects the combination of the properties of the ancestral community and of the selective pressure. Our analysis determines how the speed of adaptation scales with the system parameters and the abundance distribution of the evolved communities. Artificial selection for larger total abundance is thus shown to drive increased levels of mutualism and interaction diversity. Inference of the interaction matrix is proposed as a method to assess the emergence of structured interactions from experimentally accessible measures. △ Less

Submitted 21 June, 2023; v1 submitted 13 December, 2021; originally announced December 2021.

Journal ref: Journal of Theoretical Biology, Volume 571, 2023, 111557, ISSN 0022-5193

Critical behavior of the Anderson model on the Bethe lattice via a large-deviation approach

Authors: Giulio Biroli, Alexander K. Hartmann, Marco Tarzia

Abstract: We present a new large-deviation approach to investigate the critical properties of the Anderson model on the Bethe lattice close to the localization transition in the thermodynamic limit. Our method allows us to study accurately the distribution of the local density of states (LDoS) down to very small probability tails as small as $10^{-50}$ which are completely out of reach for standard numerica… ▽ More We present a new large-deviation approach to investigate the critical properties of the Anderson model on the Bethe lattice close to the localization transition in the thermodynamic limit. Our method allows us to study accurately the distribution of the local density of states (LDoS) down to very small probability tails as small as $10^{-50}$ which are completely out of reach for standard numerical techniques. We perform a thorough analysis of the functional form and of the tails of the probability distribution of the LDoS which yields for the first time a direct, transparent, and precise estimation of the correlation volume close to the Anderson transition. Such correlation volume is found to diverge exponentially when the localization is approached from the delocalized regime, in a singular way that is in agreement with the analytic predictions of the supersymmetric treatment. △ Less

Submitted 4 October, 2021; originally announced October 2021.

Comments: 11 pages, 6 figures. arXiv admin note: substantial text overlap with arXiv:1810.07545

Journal ref: Phys. Rev. B 105, 094202 (2022)

Local dynamical heterogeneity in glass formers

Authors: Giulio Biroli, Patrick Charbonneau, Giampaolo Folena, Yi Hu, Francesco Zamponi

Abstract: We study the local dynamical fluctuations in glass-forming models of particles embedded in $d$-dimensional space, in the mean-field limit of $d\to\infty$. Our analytical calculation reveals that single-particle observables, such as squared particle displacements, display divergent fluctuations around the dynamical (or mode-coupling) transition, due to the emergence of nontrivial correlations betwe… ▽ More We study the local dynamical fluctuations in glass-forming models of particles embedded in $d$-dimensional space, in the mean-field limit of $d\to\infty$. Our analytical calculation reveals that single-particle observables, such as squared particle displacements, display divergent fluctuations around the dynamical (or mode-coupling) transition, due to the emergence of nontrivial correlations between displacements along different directions. This effect notably gives rise to a divergent non-Gaussian parameter, $α_2$. The $d\to\infty$ local dynamics therefore becomes quite rich upon approaching the glass transition. The finite-$d$ remnant of this phenomenon further provides a long sought-after, first-principle explanation for the growth of $α_2$ around the glass transition that is \emph{not based on multi-particle correlations}. △ Less

Submitted 6 March, 2022; v1 submitted 24 September, 2021; originally announced September 2021.

Comments: 5 pages, 4 figures

Journal ref: Phys. Rev. Lett. 128, 175501 (2022)

On the Dynamics of Liquids in the Large-Dimensional Limit

Authors: Chen Liu, Giulio Biroli, David Reichman, Grzegorz Szamel

Abstract: In this work, we analytically derive the exact closed dynamical equations for a liquid with short-ranged interactions in large spatial dimensions using the same statistical mechanics tools employed to analyze Brownian motion. Our derivation greatly simplifies the original path-integral-based route to these equations and provides new insight into the physical features associated with high-dimension… ▽ More In this work, we analytically derive the exact closed dynamical equations for a liquid with short-ranged interactions in large spatial dimensions using the same statistical mechanics tools employed to analyze Brownian motion. Our derivation greatly simplifies the original path-integral-based route to these equations and provides new insight into the physical features associated with high-dimensional liquids and glass formation. Most importantly, our construction provides a facile route to the exact dynamical analysis of important related dynamical problems, as well as a means to devise cluster generalizations of the exact solution in infinite dimensions. This latter fact opens the door to the construction of increasingly accurate theories of vitrification in three-dimensional liquids. △ Less

Submitted 5 August, 2021; originally announced August 2021.

Effects of intraspecific cooperative interactions in large ecosystems

Authors: Ada Altieri, Giulio Biroli

Abstract: We analyze the role of the Allee effect, a positive correlation between population density and mean individual fitness, for ecological communities formed by a large number of species. Our study is performed using the generalized Lotka-Volterra model with random interactions between species. We obtain the phase diagram and analyze the nature of the multiple equilibria phase. Remarkable differences… ▽ More We analyze the role of the Allee effect, a positive correlation between population density and mean individual fitness, for ecological communities formed by a large number of species. Our study is performed using the generalized Lotka-Volterra model with random interactions between species. We obtain the phase diagram and analyze the nature of the multiple equilibria phase. Remarkable differences emerge with respect to the case of the logistic growth case, thus revealing the major role played by the functional response in determining aggregate behaviours of ecosystems. △ Less

Submitted 20 May, 2021; v1 submitted 10 May, 2021; originally announced May 2021.

Comments: 40 pages, 7 figures. v2 with minor revisions

Journal ref: SciPost Phys. 12, 013 (2022)

Revisiting the Concept of Activation in Supercooled Liquids

Authors: Marco Baity-Jesi, Giulio Biroli, David R. Reichman

Abstract: In this work we revisit the description of dynamics based on the concepts of metabasins and activation in mildly supercooled liquids via the analysis of the dynamics of a paradigmatic glass former between its onset temperature $T_{o}$ and mode-coupling temperature $T_{c}$. First, we provide measures that demonstrate that the onset of glassiness is indeed connected to the landscape, and that metaba… ▽ More In this work we revisit the description of dynamics based on the concepts of metabasins and activation in mildly supercooled liquids via the analysis of the dynamics of a paradigmatic glass former between its onset temperature $T_{o}$ and mode-coupling temperature $T_{c}$. First, we provide measures that demonstrate that the onset of glassiness is indeed connected to the landscape, and that metabasin waiting time distributions are so broad that the system can remain stuck in a metabasin for times that exceed $τ_α$ by orders of magnitude. We then reanalyze the transitions between metabasins, providing several indications that the standard picture of activated dynamics in terms of traps does not hold in this regime. Instead, we propose that here activation is principally driven by entropic instead of energetic barriers. In particular, we illustrate that activation is not controlled by the hop** of high energetic barriers, and should more properly be interpreted as the entropic selection of nearly barrierless but rare pathways connecting metabasins on the landscape. △ Less

Submitted 1 June, 2021; v1 submitted 12 March, 2021; originally announced March 2021.

Comments: 11 pages, 9 figures. Version accepted in EPJE topical issue

Journal ref: The European Physical Journal E volume 44, Article number: 77 (2021)

On the interplay between data structure and loss function in classification problems

Authors: Stéphane d'Ascoli, Marylou Gabrié, Levent Sagun, Giulio Biroli

Abstract: One of the central puzzles in modern machine learning is the ability of heavily overparametrized models to generalize well. Although the low-dimensional structure of typical datasets is key to this behavior, most theoretical studies of overparametrization focus on isotropic inputs. In this work, we instead consider an analytically tractable model of structured data, where the input covariance is b… ▽ More One of the central puzzles in modern machine learning is the ability of heavily overparametrized models to generalize well. Although the low-dimensional structure of typical datasets is key to this behavior, most theoretical studies of overparametrization focus on isotropic inputs. In this work, we instead consider an analytically tractable model of structured data, where the input covariance is built from independent blocks allowing us to tune the saliency of low-dimensional structures and their alignment with respect to the target function. Using methods from statistical physics, we derive a precise asymptotic expression for the train and test error achieved by random feature models trained to classify such data, which is valid for any convex loss function. We study in detail how the data structure affects the double descent curve, and show that in the over-parametrized regime, its impact is greater for logistic loss than for mean-squared loss: the easier the task, the wider the gap in performance at the advantage of the logistic loss. Our insights are confirmed by numerical experiments on MNIST and CIFAR10. △ Less

Submitted 12 October, 2021; v1 submitted 9 March, 2021; originally announced March 2021.

Elastoplasticity Mediates Dynamical Heterogeneity Below the Mode-Coupling Temperature

Authors: Rahul N. Chacko, François P. Landes, Giulio Biroli, Olivier Dauchot, Andrea J. Liu, David R. Reichman

Abstract: As liquids approach the glass transition temperature, dynamical heterogeneity emerges as a crucial universal feature of their behavior. Dynamic facilitation, where local motion triggers further motion nearby, plays a major role in this phenomenon. Here we show that long-range, elastically-mediated facilitation appears below the mode-coupling temperature, adding to the short-range component present… ▽ More As liquids approach the glass transition temperature, dynamical heterogeneity emerges as a crucial universal feature of their behavior. Dynamic facilitation, where local motion triggers further motion nearby, plays a major role in this phenomenon. Here we show that long-range, elastically-mediated facilitation appears below the mode-coupling temperature, adding to the short-range component present at all temperatures. Our results suggest deep connections between the supercooled liquid and glass states, and pave the way for a deeper understanding of dynamical heterogeneity in glassy systems. △ Less

Submitted 4 March, 2021; v1 submitted 2 March, 2021; originally announced March 2021.

Comments: 6 pages, 4 figures. SM included as ancillary

Journal ref: Phys. Rev. Lett. 127, 048002 (2021)

Mean-field caging in a random Lorentz gas

Authors: Giulio Biroli, Patrick Charbonneau, Yi Hu, Harukuni Ikeda, Grzegorz Szamel, Francesco Zamponi

Abstract: The random Lorentz gas (RLG) is a minimal model of both percolation and glassiness, which leads to a paradox in the infinite-dimensional, $d\rightarrow\infty$ limit: the localization transition is then expected to be continuous for the former and discontinuous for the latter. As a putative resolution, we have recently suggested that as $d$ increases the behavior of the RLG converges to the glassy… ▽ More The random Lorentz gas (RLG) is a minimal model of both percolation and glassiness, which leads to a paradox in the infinite-dimensional, $d\rightarrow\infty$ limit: the localization transition is then expected to be continuous for the former and discontinuous for the latter. As a putative resolution, we have recently suggested that as $d$ increases the behavior of the RLG converges to the glassy description, and that percolation physics is recovered thanks to finite-$d$ perturbative and non-perturbative (instantonic) corrections [Biroli et al. arXiv:2003.11179]. Here, we expand on the $d\rightarrow\infty$ physics by considering a simpler static solution as well as the dynamical solution of the RLG. Comparing the $1/d$ correction of this solution with numerical results reveals that even perturbative corrections fall out of reach of existing theoretical descriptions. Comparing the dynamical solution with the mode-coupling theory (MCT) results further reveals that although key quantitative features of MCT are far off the mark, it does properly capture the discontinuous nature of the $d\rightarrow\infty$ RLG. These insights help chart a path toward a complete description of finite-dimensional glasses. △ Less

Submitted 23 February, 2021; originally announced February 2021.

Comments: 12 pages, 2 figures

Journal ref: J.Phys.Chem.B 125, 6244 (2021)

Rare events and disorder control the brittle yielding of well-annealed amorphous solids

Authors: Misaki Ozawa, Ludovic Berthier, Giulio Biroli, Gilles Tarjus

Abstract: We use atomistic computer simulations to provide a microscopic description of the brittle failure of amorphous materials, and we assess the role of rare events and quenched disorder. We argue that brittle yielding originates at rare soft regions, similarly to Griffiths effects in disordered systems. We numerically demonstrate how localized plastic events in such soft regions trigger macroscopic fa… ▽ More We use atomistic computer simulations to provide a microscopic description of the brittle failure of amorphous materials, and we assess the role of rare events and quenched disorder. We argue that brittle yielding originates at rare soft regions, similarly to Griffiths effects in disordered systems. We numerically demonstrate how localized plastic events in such soft regions trigger macroscopic failure via the propagation of a shear band. This physical picture, which no longer holds in poorly annealed ductile materials, allows us to discuss the role of finite size effects in brittle yielding and reinforces the similarities between yielding and other disorder-controlled nonequilibrium phase transitions. △ Less

Submitted 11 July, 2022; v1 submitted 10 February, 2021; originally announced February 2021.

Comments: 12 pages, 10 figures

Journal ref: Phys. Rev. Research 4, 023227 (2022)

Amorphous Order & Non-linear Susceptibilities in Glassy Materials

Authors: Giulio Biroli, Jean-Philippe Bouchaud, Francois Ladieu

Abstract: We review 15 years of theoretical and experimental work on the non-linear response of glassy systems. We argue that an anomalous growth of the peak value of non-linear susceptibilities is a signature of growing "amorphous order" in the system, with spin-glasses as a case in point. Experimental results on supercooled liquids are fully compatible with the RFOT prediction of compact "glassites" of in… ▽ More We review 15 years of theoretical and experimental work on the non-linear response of glassy systems. We argue that an anomalous growth of the peak value of non-linear susceptibilities is a signature of growing "amorphous order" in the system, with spin-glasses as a case in point. Experimental results on supercooled liquids are fully compatible with the RFOT prediction of compact "glassites" of increasing volume as temperature is decreased, or as the system ages. We clarify why such a behaviour is hard to explain within purely kinetic theories of glass formation, despite recent claims to the contrary. △ Less

Submitted 11 January, 2021; originally announced January 2021.

Comments: Contribution to be submitted to Dave Thirumalai Festschrift in The Journal of Physical Chemistry

The Lévy-Rosenzweig-Porter random matrix ensemble

Authors: Giulio Biroli, Marco Tarzia

Abstract: In this paper we consider an extension of the Rosenzweig-Porter (RP) model, the Lévy-RP (L-RP) model, in which the off-diagonal matrix elements are broadly distributed, providing a more realistic benchmark to develop an effective description of non-ergodic extended (NEE) states in interacting many-body disordered systems. We put forward a simple, general, and intuitive argument that allows one to… ▽ More In this paper we consider an extension of the Rosenzweig-Porter (RP) model, the Lévy-RP (L-RP) model, in which the off-diagonal matrix elements are broadly distributed, providing a more realistic benchmark to develop an effective description of non-ergodic extended (NEE) states in interacting many-body disordered systems. We put forward a simple, general, and intuitive argument that allows one to unveil the multifractal structure of the mini-bands in the local spectrum when hybridization is due to anomalously large transition amplitudes in the tails of the distribution. The idea is that the energy spreading of the mini-bands can be determined self-consistently by requiring that the maximum of the matrix elements between a site $i$ and the other $N^{D_1}$ sites of the support set is of the same order of the Thouless energy itself $N^{D_1 - 1}$. This argument yields the fractal dimensions that characterize the statistics of the multifractal wave-functions in the NEE phase, as well as the whole phase diagram of the L-RP ensemble. Its predictions are confirmed both analytically, by a thorough investigation of the self-consistent equation for the local density of states obtained using the cavity approach, and numerically, via extensive exact diagonalizations. △ Less

Submitted 17 January, 2021; v1 submitted 23 December, 2020; originally announced December 2020.

Comments: 21 pages, 14 figures

Journal ref: Phys. Rev. B 103, 104205 (2021)

Searching for the Gardner transition in glassy glycerol

Authors: Samuel Albert, Giulio Biroli, François Ladieu, Roland Tourbot, Pierfrancesco Urbani

Abstract: We search for a Gardner transition in glassy glycerol, a standard molecular glass, measuring the third harmonics cubic susceptibility $χ_3^{(3)}$ from slightly below the usual glass transition temperature down to $10K$. According to the mean field picture, if local motion within the glass were becoming highly correlated due to the emergence of a Gardner phase then $χ_3^{(3)}$, which is analogous t… ▽ More We search for a Gardner transition in glassy glycerol, a standard molecular glass, measuring the third harmonics cubic susceptibility $χ_3^{(3)}$ from slightly below the usual glass transition temperature down to $10K$. According to the mean field picture, if local motion within the glass were becoming highly correlated due to the emergence of a Gardner phase then $χ_3^{(3)}$, which is analogous to the dynamical spin-glass susceptibility, should increase and diverge at the Gardner transition temperature $T_G$. We find instead that upon cooling $| χ_3^{(3)} |$ decreases by several orders of magnitude and becomes roughly constant in the regime $100K-10K$. We rationalize our findings by assuming that the low temperature physics is described by localized excitations weakly interacting via a spin-glass dipolar pairwise interaction in a random magnetic field. Our quantitative estimations show that the spin-glass interaction is twenty to fifty times smaller than the local random field contribution, thus rationalizing the absence of the spin-glass Gardner phase. This hints at the fact that a Gardner phase may be suppressed in standard molecular glasses, but it also suggests ways to favor its existence in other amorphous solids and by changing the preparation protocol. △ Less

Submitted 8 December, 2020; v1 submitted 7 October, 2020; originally announced October 2020.

Comments: 9 pages, 5 figures

Journal ref: Phys. Rev. Lett. 126, 028001 (2021)

Properties of equilibria and glassy phases of the random Lotka-Volterra model with demographic noise

Authors: Ada Altieri, Felix Roy, Chiara Cammarota, Giulio Biroli

Abstract: In this letter we study a reference model in theoretical ecology, the disordered Lotka-Volterra model for ecological communities, in the presence of finite demographic noise. Our theoretical analysis, which takes advantage of a map** to an equilibrium disordered system, proves that for sufficiently heterogeneous interactions and low demographic noise the system displays a multiple equilibria pha… ▽ More In this letter we study a reference model in theoretical ecology, the disordered Lotka-Volterra model for ecological communities, in the presence of finite demographic noise. Our theoretical analysis, which takes advantage of a map** to an equilibrium disordered system, proves that for sufficiently heterogeneous interactions and low demographic noise the system displays a multiple equilibria phase, which we fully characterize. In particular, we show that in this phase the number of stable equilibria is exponential in the number of species. Upon further decreasing the demographic noise, we unveil a "Gardner" transition to a marginally stable phase, similar to that observed in jamming of amorphous materials. We confirm and complement our analytical results by numerical simulations. Furthermore, we extend their relevance by showing that they hold for others interacting random dynamical systems, such as the Random Replicant Model. Finally, we discuss their extension to the case of asymmetric couplings. △ Less

Submitted 22 September, 2020; originally announced September 2020.

Comments: 5 pages, 5 figures in the main text. 19 pages and 13 figures considering the Supplementary Material

Journal ref: Phys. Rev. Lett. 126, 258301 (2021)

Out of equilibrium Phase Diagram of the Quantum Random Energy Model

Authors: Giulio Biroli, Davide Facoetti, Marco Schiró, Marco Tarzia, Pierpaolo Vivo

Abstract: In this paper we study the out-of-equilibrium phase diagram of the quantum version of Derrida's Random Energy Model, which is the simplest model of mean-field spin glasses. We interpret its corresponding quantum dynamics in Fock space as a one-particle problem in very high dimension to which we apply different theoretical methods tailored for high-dimensional lattices: the Forward-Scattering Appro… ▽ More In this paper we study the out-of-equilibrium phase diagram of the quantum version of Derrida's Random Energy Model, which is the simplest model of mean-field spin glasses. We interpret its corresponding quantum dynamics in Fock space as a one-particle problem in very high dimension to which we apply different theoretical methods tailored for high-dimensional lattices: the Forward-Scattering Approximation, a map** to the Rosenzweig-Porter model, and the cavity method. Our results indicate the existence of two transition lines and three distinct dynamical phases: a completely many-body localized phase at low energy, a fully ergodic phase at high energy, and a multifractal "bad metal" phase at intermediate energy. In the latter, eigenfunctions occupy a diverging volume, yet an exponentially vanishing fraction of the total Hilbert space. We discuss the limitations of our approximations and the relationship with previous studies. △ Less

Submitted 11 March, 2021; v1 submitted 21 September, 2020; originally announced September 2020.

Comments: 21 pages, 13 figures

Journal ref: Phys. Rev. B 103, 014204 (2021)

An analytic theory of shallow networks dynamics for hinge loss classification

Authors: Franco Pellegrini, Giulio Biroli

Abstract: Neural networks have been shown to perform incredibly well in classification tasks over structured high-dimensional datasets. However, the learning dynamics of such networks is still poorly understood. In this paper we study in detail the training dynamics of a simple type of neural network: a single hidden layer trained to perform a classification task. We show that in a suitable mean-field limit… ▽ More Neural networks have been shown to perform incredibly well in classification tasks over structured high-dimensional datasets. However, the learning dynamics of such networks is still poorly understood. In this paper we study in detail the training dynamics of a simple type of neural network: a single hidden layer trained to perform a classification task. We show that in a suitable mean-field limit this case maps to a single-node learning problem with a time-dependent dataset determined self-consistently from the average nodes population. We specialize our theory to the prototypical case of a linearly separable dataset and a linear hinge loss, for which the dynamics can be explicitly solved. This allow us to address in a simple setting several phenomena appearing in modern networks such as slowing down of training dynamics, crossover between rich and lazy learning, and overfitting. Finally, we asses the limitations of mean-field theory by studying the case of large but finite number of nodes and of training samples. △ Less

Submitted 19 June, 2020; originally announced June 2020.

Comments: 16 pages, 6 figures

Glasses and aging: A Statistical Mechanics Perspective

Authors: Francesco Arceri, François P. Landes, Ludovic Berthier, Giulio Biroli

Abstract: We review the field of the glass transition, glassy dynamics and aging from a statistical mechanics perspective. We give a brief introduction to the subject and explain the main phenomenology encountered in glassy systems, with a particular emphasis on spatially heterogeneous dynamics. We review the main theoretical approaches currently available to account for these glassy phenomena, including re… ▽ More We review the field of the glass transition, glassy dynamics and aging from a statistical mechanics perspective. We give a brief introduction to the subject and explain the main phenomenology encountered in glassy systems, with a particular emphasis on spatially heterogeneous dynamics. We review the main theoretical approaches currently available to account for these glassy phenomena, including recent developments regarding mean-field theory of liquids and glasses, novel computational tools, and connections to the jamming transition. Finally, the physics of aging and off-equilibrium dynamics exhibited by glassy materials is discussed. △ Less

Submitted 8 October, 2020; v1 submitted 17 June, 2020; originally announced June 2020.

Comments: 50 pages, 24 figs. This is an updated version of a chapter initially written in 2009 for the Encyclopedia of Complexity and Systems Science (Springer). arXiv admin note: text overlap with arXiv:1011.2578

Dynamical Instantons and Activated Processes in Mean-Field Glass Models

Authors: V. Ros, G. Biroli, C. Cammarota

Abstract: We focus on the energy landscape of a simple mean-field model of glasses and analyze activated barrier-crossing by combining the Kac-Rice method for high-dimensional Gaussian landscapes with dynamical field theory. In particular, we consider Langevin dynamics at low temperature in the energy landscape of the pure spherical $p$-spin model. We select as initial condition for the dynamics one of the… ▽ More We focus on the energy landscape of a simple mean-field model of glasses and analyze activated barrier-crossing by combining the Kac-Rice method for high-dimensional Gaussian landscapes with dynamical field theory. In particular, we consider Langevin dynamics at low temperature in the energy landscape of the pure spherical $p$-spin model. We select as initial condition for the dynamics one of the many unstable index-1 saddles in the vicinity of a reference local minimum. We show that the associated dynamical mean-field equations admit two solutions: one corresponds to falling back to the original reference minimum, and the other to reaching a new minimum past the barrier. By varying the saddle we scan and characterize the properties of such minima reachable by activated barrier-crossing. Finally, using time-reversal transformations, we construct the two-point function dynamical instanton of the corresponding activated process. △ Less

Submitted 15 December, 2020; v1 submitted 15 June, 2020; originally announced June 2020.

Comments: v3, conclusions extended and minor revisions

Journal ref: SciPost Phys. 10, 002 (2021)

Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval

Authors: Stefano Sarao Mannelli, Giulio Biroli, Chiara Cammarota, Florent Krzakala, Pierfrancesco Urbani, Lenka Zdeborová

Abstract: Despite the widespread use of gradient-based algorithms for optimizing high-dimensional non-convex functions, understanding their ability of finding good minima instead of being trapped in spurious ones remains to a large extent an open problem. Here we focus on gradient flow dynamics for phase retrieval from random measurements. When the ratio of the number of measurements over the input dimensio… ▽ More Despite the widespread use of gradient-based algorithms for optimizing high-dimensional non-convex functions, understanding their ability of finding good minima instead of being trapped in spurious ones remains to a large extent an open problem. Here we focus on gradient flow dynamics for phase retrieval from random measurements. When the ratio of the number of measurements over the input dimension is small the dynamics remains trapped in spurious minima with large basins of attraction. We find analytically that above a critical ratio those critical points become unstable develo** a negative direction toward the signal. By numerical experiments we show that in this regime the gradient flow algorithm is not trapped; it drifts away from the spurious critical points along the unstable direction and succeeds in finding the global minimum. Using tools from statistical physics we characterize this phenomenon, which is related to a BBP-type transition in the Hessian of the spurious minima. △ Less

Submitted 12 June, 2020; originally announced June 2020.

Comments: 9 pages, 5 figures + appendix

Journal ref: Advances in Neural Information Processing Systems, v22, page 3265--327, 2020

Triple descent and the two kinds of overfitting: Where & why do they appear?

Authors: Stéphane d'Ascoli, Levent Sagun, Giulio Biroli

Abstract: A recent line of research has highlighted the existence of a "double descent" phenomenon in deep learning, whereby increasing the number of training examples $N$ causes the generalization error of neural networks to peak when $N$ is of the same order as the number of parameters $P$. In earlier works, a similar phenomenon was shown to exist in simpler models such as linear regression, where the pea… ▽ More A recent line of research has highlighted the existence of a "double descent" phenomenon in deep learning, whereby increasing the number of training examples $N$ causes the generalization error of neural networks to peak when $N$ is of the same order as the number of parameters $P$. In earlier works, a similar phenomenon was shown to exist in simpler models such as linear regression, where the peak instead occurs when $N$ is equal to the input dimension $D$. Since both peaks coincide with the interpolation threshold, they are often conflated in the litterature. In this paper, we show that despite their apparent similarity, these two scenarios are inherently different. In fact, both peaks can co-exist when neural networks are applied to noisy regression tasks. The relative size of the peaks is then governed by the degree of nonlinearity of the activation function. Building on recent developments in the analysis of random feature models, we provide a theoretical ground for this sample-wise triple descent. As shown previously, the nonlinear peak at $N\!=\!P$ is a true divergence caused by the extreme sensitivity of the output function to both the noise corrupting the labels and the initialization of the random features (or the weights in neural networks). This peak survives in the absence of noise, but can be suppressed by regularization. In contrast, the linear peak at $N\!=\!D$ is solely due to overfitting the noise in the labels, and forms earlier during training. We show that this peak is implicitly regularized by the nonlinearity, which is why it only becomes salient at high noise and is weakly affected by explicit regularization. Throughout the paper, we compare analytical results obtained in the random feature model with the outcomes of numerical experiments involving deep neural networks. △ Less

Submitted 13 October, 2020; v1 submitted 5 June, 2020; originally announced June 2020.

Dynamical Mean-Field Theory and Aging Dynamics

Authors: Ada Altieri, Giulio Biroli, Chiara Cammarota

Abstract: Dynamical Mean-Field Theory (DMFT) replaces the many-body dynamical problem with one for a single degree of freedom in a thermal bath whose features are determined self-consistently. By focusing on models with soft disordered $p$-spin interactions, we show how to incorporate the mean-field theory of aging within dynamical mean-field theory. We study cases with only one slow time-scale, correspondi… ▽ More Dynamical Mean-Field Theory (DMFT) replaces the many-body dynamical problem with one for a single degree of freedom in a thermal bath whose features are determined self-consistently. By focusing on models with soft disordered $p$-spin interactions, we show how to incorporate the mean-field theory of aging within dynamical mean-field theory. We study cases with only one slow time-scale, corresponding statically to the one-step replica symmetry breaking (1RSB) phase, and cases with an infinite number of slow time-scales, corresponding statically to the full replica symmetry breaking (FRSB) phase. For the former, we show that the effective temperature of the slow degrees of freedom is fixed by requiring critical dynamical behavior on short time-scales, i.e. marginality. For the latter, we find that aging on an infinite number of slow time-scales is governed by a stochastic equation where the clock for dynamical evolution is fixed by the change of effective temperature, hence obtaining a dynamical derivation of the stochastic equation at the basis of the FRSB phase. Our results extend the realm of the mean-field theory of aging to all situations where DMFT holds. △ Less

Submitted 11 May, 2020; originally announced May 2020.

Comments: 28 pages, 3 figures

Journal ref: J. Phys. A: Math. Theor. 53 375006 (2020)