-
Quantifying memory in spin glasses
Authors:
Janus Collaboration,
I. Paga,
J. He,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
I. Gonzalez-Adalid Pemartin,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz Sudupe,
D. Navarro,
R. L. Orbach,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
D. L. Schlagel,
B. Seoane
, et al. (2 additional authors not shown)
Abstract:
Rejuvenation and memory, long considered the distinguishing features of spin glasses, have recently been proven to result from the growth of multiple length scales. This insight, enabled by simulations on the Janus~II supercomputer, has opened the door to a quantitative analysis. We combine numerical simulations with comparable experiments to introduce two coefficients that quantify memory. A thir…
▽ More
Rejuvenation and memory, long considered the distinguishing features of spin glasses, have recently been proven to result from the growth of multiple length scales. This insight, enabled by simulations on the Janus~II supercomputer, has opened the door to a quantitative analysis. We combine numerical simulations with comparable experiments to introduce two coefficients that quantify memory. A third coefficient has been recently presented by Freedberg et al. We show that these coefficients are physically equivalent by studying their temperature and waiting-time dependence.
△ Less
Submitted 5 July, 2023;
originally announced July 2023.
-
Multifractality in spin glasses
Authors:
Janus Collaboration,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
I. Gonzalez-Adalid Pemartin,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz Sudupe,
D. Navarro,
I. Paga,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
D. Yllanes
Abstract:
We unveil the multifractal behavior of Ising spin glasses in their low-temperature phase. Using the Janus II custom-built supercomputer, the spin-glass correlation function is studied locally. Dramatic fluctuations are found when pairs of sites at the same distance are compared. The scaling of these fluctuations, as the spin-glass coherence length grows with time, is characterized through the comp…
▽ More
We unveil the multifractal behavior of Ising spin glasses in their low-temperature phase. Using the Janus II custom-built supercomputer, the spin-glass correlation function is studied locally. Dramatic fluctuations are found when pairs of sites at the same distance are compared. The scaling of these fluctuations, as the spin-glass coherence length grows with time, is characterized through the computation of the singularity spectrum and its corresponding Legendre transform. A comparatively small number of site pairs controls the average correlation that governs the response to a magnetic field. We explain how this scenario of dramatic fluctuations (at length scales smaller than the coherence length) can be reconciled with the smooth, self-averaging behavior that has long been considered to describe spin-glass dynamics.
△ Less
Submitted 22 January, 2024; v1 submitted 7 June, 2023;
originally announced June 2023.
-
Initial Guessing Bias: How Untrained Networks Favor Some Classes
Authors:
Emanuele Francazi,
Aurelien Lucchi,
Marco Baity-Jesi
Abstract:
Understanding and controlling biasing effects in neural networks is crucial for ensuring accurate and fair model performance. In the context of classification problems, we provide a theoretical analysis demonstrating that the structure of a deep neural network (DNN) can condition the model to assign all predictions to the same class, even before the beginning of training, and in the absence of exp…
▽ More
Understanding and controlling biasing effects in neural networks is crucial for ensuring accurate and fair model performance. In the context of classification problems, we provide a theoretical analysis demonstrating that the structure of a deep neural network (DNN) can condition the model to assign all predictions to the same class, even before the beginning of training, and in the absence of explicit biases. We prove that, besides dataset properties, the presence of this phenomenon, which we call \textit{Initial Guessing Bias} (IGB), is influenced by model choices including dataset preprocessing methods, and architectural decisions, such as activation functions, max-pooling layers, and network depth. Our analysis of IGB provides information for architecture selection and model initialization. We also highlight theoretical consequences, such as the breakdown of node-permutation symmetry, the violation of self-averaging and the non-trivial effects that depth has on the phenomenon.
△ Less
Submitted 13 June, 2024; v1 submitted 1 June, 2023;
originally announced June 2023.
-
An Introduction to the Theory of Spin Glasses
Authors:
Ada Altieri,
Marco Baity-Jesi
Abstract:
We review the main methods used to study spin glasses. In the first part, we focus on methods for fully connected models and systems defined on a tree, such as the replica method, the Thouless-Anderson-Palmer formalism, the cavity method, and the dynamical mean-field theory. In the second part, we deal with the description of low-dimensional systems, mostly in three spatial dimensions, which are m…
▽ More
We review the main methods used to study spin glasses. In the first part, we focus on methods for fully connected models and systems defined on a tree, such as the replica method, the Thouless-Anderson-Palmer formalism, the cavity method, and the dynamical mean-field theory. In the second part, we deal with the description of low-dimensional systems, mostly in three spatial dimensions, which are mostly studied through numerical simulations. We conclude by mentioning some of the main open problems in the field.
△ Less
Submitted 9 February, 2023;
originally announced February 2023.
-
On the superposition principle and non-linear response in spin glasses
Authors:
I. Paga,
Q. Zhai,
M. Baity-Jesi,
E. Calore,
A. Cruz,
C. Cummings,
L. A. Fernandez,
J. M. Gil-Narvion,
I. Gonzalez-Adalid Pemartin,
A. Gordillo-Guerrero,
D. Iñiguez,
G. G. Kenning,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz-Sudupe,
D. Navarro,
R. L. Orbach,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
D. L. Schlagel
, et al. (3 additional authors not shown)
Abstract:
The extended principle of superposition has been a touchstone of spin glass dynamics for almost thirty years. The Uppsala group has demonstrated its validity for the metallic spin glass, CuMn, for magnetic fields $H$ up to 10 Oe at the reduced temperature $T_\mathrm{r}=T/T_\mathrm{g} = 0.95$, where $T_\mathrm{g}$ is the spin glass condensation temperature. For $H > 10$ Oe, they observe a departure…
▽ More
The extended principle of superposition has been a touchstone of spin glass dynamics for almost thirty years. The Uppsala group has demonstrated its validity for the metallic spin glass, CuMn, for magnetic fields $H$ up to 10 Oe at the reduced temperature $T_\mathrm{r}=T/T_\mathrm{g} = 0.95$, where $T_\mathrm{g}$ is the spin glass condensation temperature. For $H > 10$ Oe, they observe a departure from linear response which they ascribe to the development of non-linear dynamics. The thrust of this paper is to develop a microscopic origin for this behavior by focusing on the time development of the spin glass correlation length, $ξ(t,t_\mathrm{w};H)$. Here, $t$ is the time after $H$ changes, and $t_\mathrm{w}$ is the time from the quench for $T>T_\mathrm{g}$ to the working temperature $T$ until $H$ changes. We connect the growth of $ξ(t,t_\mathrm{w};H)$ to the barrier heights $Δ(t_\mathrm{w})$ that set the dynamics. The effect of $H$ on the magnitude of $Δ(t_\mathrm{w})$ is responsible for affecting differently the two dynamical protocols associated with turning $H$ off (TRM, or thermoremanent magnetization) or on (ZFC, or zero field-cooled magnetization). In this paper, we display the difference between the zero-field cooled $ξ_{\text {ZFC}}(t,t_\mathrm{w};H)$ and the thermoremanent magnetization $ξ_{\text {TRM}}(t,t_\mathrm{w};H)$ correlation lengths as $H$ increases, both experimentally and through numerical simulations, corresponding to the violation of the extended principle of superposition in line with the finding of the Uppsala Group.
△ Less
Submitted 26 June, 2023; v1 submitted 21 July, 2022;
originally announced July 2022.
-
Memory and rejuvenation in spin glasses: aging systems are ruled by more than one length scale
Authors:
Janus Collaboration,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
I. Gonzalez-Adalid Pemartin,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz-Sudupe,
D. Navarro,
I. Paga,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
Memory and rejuvenation effects in the magnetic response of off-equilibrium spin glasses have been widely regarded as the doorway into the experimental exploration of ultrametricity and temperature chaos (maybe the most exotic features in glassy free-energy landscapes). Unfortunately, despite more than twenty years of theoretical efforts following the experimental discovery of memory and rejuvenat…
▽ More
Memory and rejuvenation effects in the magnetic response of off-equilibrium spin glasses have been widely regarded as the doorway into the experimental exploration of ultrametricity and temperature chaos (maybe the most exotic features in glassy free-energy landscapes). Unfortunately, despite more than twenty years of theoretical efforts following the experimental discovery of memory and rejuvenation, these effects have thus far been impossible to simulate reliably. Yet, three recent developments convinced us to accept this challenge: first, the custom-built Janus II supercomputer makes it possible to carry out "numerical experiments" in which the very same quantities that can be measured in single crystals of CuMn are computed from the simulation, allowing for parallel analysis of the simulation/experiment data. Second, Janus II simulations have taught us how numerical and experimental length scales should be compared. Third, we have recently understood how temperature chaos materializes in aging dynamics. All three aspects have proved crucial for reliably reproducing rejuvenation and memory effects on the computer. Our analysis shows that (at least) three different length scales play a key role in aging dynamics, while essentially all theoretical analyses of the aging dynamics emphasize the presence and the crucial role of a single glassy correlation length.
△ Less
Submitted 30 August, 2022; v1 submitted 13 July, 2022;
originally announced July 2022.
-
Competition between Barrier- and Entropy-Driven Activation in Glasses
Authors:
Matthew R. Carbone,
Marco Baity-Jesi
Abstract:
In simplified models of glasses we clarify the existence of two different kinds of activated dynamics, which coexist, with one of the two dominating over the other. One is the energy barrier hop** that is typically used to picture activation, and the other one, which we call entropic activation, is driven by the scarcity of convenient directions. When entropic activation dominates, the height of…
▽ More
In simplified models of glasses we clarify the existence of two different kinds of activated dynamics, which coexist, with one of the two dominating over the other. One is the energy barrier hop** that is typically used to picture activation, and the other one, which we call entropic activation, is driven by the scarcity of convenient directions. When entropic activation dominates, the height of the energy barriers is no longer the decisive to describe the system's slowdown. In our analysis, dominance of one mechanism over the other depends on the shape of the density of states and temperature. We also find that at low temperatures a phase transition between the two kinds of activation can occur. Our framework can be used to harmonize the facilitation and thermodynamic pictures of the slowdown of glasses.
△ Less
Submitted 4 January, 2022;
originally announced January 2022.
-
Revisiting the Concept of Activation in Supercooled Liquids
Authors:
Marco Baity-Jesi,
Giulio Biroli,
David R. Reichman
Abstract:
In this work we revisit the description of dynamics based on the concepts of metabasins and activation in mildly supercooled liquids via the analysis of the dynamics of a paradigmatic glass former between its onset temperature $T_{o}$ and mode-coupling temperature $T_{c}$. First, we provide measures that demonstrate that the onset of glassiness is indeed connected to the landscape, and that metaba…
▽ More
In this work we revisit the description of dynamics based on the concepts of metabasins and activation in mildly supercooled liquids via the analysis of the dynamics of a paradigmatic glass former between its onset temperature $T_{o}$ and mode-coupling temperature $T_{c}$. First, we provide measures that demonstrate that the onset of glassiness is indeed connected to the landscape, and that metabasin waiting time distributions are so broad that the system can remain stuck in a metabasin for times that exceed $τ_α$ by orders of magnitude. We then reanalyze the transitions between metabasins, providing several indications that the standard picture of activated dynamics in terms of traps does not hold in this regime. Instead, we propose that here activation is principally driven by entropic instead of energetic barriers. In particular, we illustrate that activation is not controlled by the hop** of high energetic barriers, and should more properly be interpreted as the entropic selection of nearly barrierless but rare pathways connecting metabasins on the landscape.
△ Less
Submitted 1 June, 2021; v1 submitted 12 March, 2021;
originally announced March 2021.
-
Spin-glass dynamics in the presence of a magnetic field: exploration of microscopic properties
Authors:
I. Paga,
Q. Zhai,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
I. Gonzalez-Adalid Pemartin,
A Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz-Sudupe,
D. Navarro,
R. L. Orbach,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
D. L. Schlagel,
B. Seoane,
A. Tarancon
, et al. (2 additional authors not shown)
Abstract:
The synergy between experiment, theory, and simulations enables a microscopic analysis of spin-glass dynamics in a magnetic field in the vicinity of and below the spin-glass transition temperature $T_\mathrm{g}$. The spin-glass correlation length, $ξ(t,t_\mathrm{w};T)$, is analysed both in experiments and in simulations in terms of the waiting time $t_\mathrm{w}$ after the spin glass has been cool…
▽ More
The synergy between experiment, theory, and simulations enables a microscopic analysis of spin-glass dynamics in a magnetic field in the vicinity of and below the spin-glass transition temperature $T_\mathrm{g}$. The spin-glass correlation length, $ξ(t,t_\mathrm{w};T)$, is analysed both in experiments and in simulations in terms of the waiting time $t_\mathrm{w}$ after the spin glass has been cooled down to a stabilised measuring temperature $T<T_\mathrm{g}$ and of the time $t$ after the magnetic field is changed. This correlation length is extracted experimentally for a CuMn 6 at. % single crystal, as well as for simulations on the Janus II special-purpose supercomputer, the latter with time and length scales comparable to experiment. The non-linear magnetic susceptibility is reported from experiment and simulations, using $ξ(t,t_\mathrm{w};T)$ as the scaling variable. Previous experiments are reanalysed, and disagreements about the nature of the Zeeman energy are resolved. The growth of the spin-glass magnetisation in zero-field magnetisation experiments, $M_\mathrm{ZFC}(t,t_\mathrm{w};T)$, is measured from simulations, verifying the scaling relationships in the dynamical or non-equilibrium regime. Our preliminary search for the de Almeida-Thouless line in $D=3$ is discussed.
△ Less
Submitted 10 March, 2021; v1 submitted 4 January, 2021;
originally announced January 2021.
-
Temperature chaos is present in off-equilibrium spin-glass dynamics
Authors:
Janus Collaboration,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
I. Gonzalez-Adalid Pemartin,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz-Sudupe,
D. Navarro,
I. Paga,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
We find a dynamic effect in the non-equilibrium dynamics of a spin glass that closely parallels equilibrium temperature chaos. This effect, that we name dynamic temperature chaos, is spatially heterogeneous to a large degree. The key controlling quantity is the time-growing spin-glass coherence length. Our detailed characterization of dynamic temperature chaos paves the way for the analysis of rec…
▽ More
We find a dynamic effect in the non-equilibrium dynamics of a spin glass that closely parallels equilibrium temperature chaos. This effect, that we name dynamic temperature chaos, is spatially heterogeneous to a large degree. The key controlling quantity is the time-growing spin-glass coherence length. Our detailed characterization of dynamic temperature chaos paves the way for the analysis of recent and forthcoming experiments. This work has been made possible thanks to the most massive simulation to date of non-equilibrium dynamics, carried out on the Janus~II custom-built supercomputer.
△ Less
Submitted 6 July, 2021; v1 submitted 18 November, 2020;
originally announced November 2020.
-
Scaling law describes the spin-glass response in theory, experiments and simulations
Authors:
Q. Zhai,
I. Paga,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
I. Gonzalez-Adalid Pemartin,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz-Sudupe,
D. Navarro,
R. L. Orbach,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
D. L. Schlagel,
B. Seoane,
A. Tarancon
, et al. (2 additional authors not shown)
Abstract:
The correlation length $ξ$, a key quantity in glassy dynamics, can now be precisely measured for spin glasses both in experiments and in simulations. However, known analysis methods lead to discrepancies either for large external fields or close to the glass temperature. We solve this problem by introducing a scaling law that takes into account both the magnetic field and the time-dependent spin-g…
▽ More
The correlation length $ξ$, a key quantity in glassy dynamics, can now be precisely measured for spin glasses both in experiments and in simulations. However, known analysis methods lead to discrepancies either for large external fields or close to the glass temperature. We solve this problem by introducing a scaling law that takes into account both the magnetic field and the time-dependent spin-glass correlation length. The scaling law is successfully tested against experimental measurements in a CuMn single crystal and against large-scale simulations on the Janus II dedicated computer.
△ Less
Submitted 30 November, 2020; v1 submitted 7 July, 2020;
originally announced July 2020.
-
Effective Trap-like Activated Dynamics in a Continuous Landscape
Authors:
Matthew R. Carbone,
Valerio Astuti,
Marco Baity-Jesi
Abstract:
We use a simple model to extend network models for activated dynamics to a continuous landscape with a well-defined notion of distance and a direct connection to many-body systems. The model consists of a tracer in a high-dimensional funnel landscape with no disorder. We find a non-equilibrium low-temperature phase with aging dynamics, that is effectively equivalent to that of models with built-in…
▽ More
We use a simple model to extend network models for activated dynamics to a continuous landscape with a well-defined notion of distance and a direct connection to many-body systems. The model consists of a tracer in a high-dimensional funnel landscape with no disorder. We find a non-equilibrium low-temperature phase with aging dynamics, that is effectively equivalent to that of models with built-in disorder, such as Trap Model, Step Model and REM.
△ Less
Submitted 3 May, 2020; v1 submitted 8 January, 2020;
originally announced January 2020.
-
On mean-field theories of dynamics in supercooled liquids
Authors:
Marco Baity-Jesi,
David R. Reichman
Abstract:
We develop a hybrid numerical approach to extract the exact memory function K(t) of a tagged particle in three-dimensional glass-forming liquids. We compare the behavior of the exact memory kernel to two mean-field approaches, namely the standard mode-coupling theory and a recently proposed ansatz for the memory function that forms the basis of a new derivation of the exact form of K(t) for a flui…
▽ More
We develop a hybrid numerical approach to extract the exact memory function K(t) of a tagged particle in three-dimensional glass-forming liquids. We compare the behavior of the exact memory kernel to two mean-field approaches, namely the standard mode-coupling theory and a recently proposed ansatz for the memory function that forms the basis of a new derivation of the exact form of K(t) for a fluid with short-ranged interactions in infinite dimensions. Each of the mean-field functions qualitatively and quantitatively share traits with the exact K(t), although several important quantitative differences are manifest.
△ Less
Submitted 13 June, 2019;
originally announced June 2019.
-
Maximum-energy records in glassy energy landscapes
Authors:
Ivailo Hartarsky,
Marco Baity-Jesi,
Riccardo Ravasio,
Alain Billoire,
Giulio Biroli
Abstract:
We study the evolution of the maximum energy $E_\max(t)$ reached between time $0$ and time $t$ in the dynamics of simple models with glassy energy landscapes, in instant quenches from infinite temperature to a target temperature $T$. Through a detailed description of the activated dynamics, we are able to describe the evolution of $E_\max(t)$ from short times, through the aging regime, until after…
▽ More
We study the evolution of the maximum energy $E_\max(t)$ reached between time $0$ and time $t$ in the dynamics of simple models with glassy energy landscapes, in instant quenches from infinite temperature to a target temperature $T$. Through a detailed description of the activated dynamics, we are able to describe the evolution of $E_\max(t)$ from short times, through the aging regime, until after equilibrium is reached, thus providing a detailed description of the long-time dynamics. Finally, we compare our findings with numerical simulations of the $p$-spin glass and show how the maximum energy record can be used to identify the threshold energy in this model.
△ Less
Submitted 13 June, 2019; v1 submitted 16 April, 2019;
originally announced April 2019.
-
Precursors of the Spin Glass Transition in Three Dimensions
Authors:
Marco Baity-Jesi,
Victor Martin-Mayor
Abstract:
We study energy landscape and dynamics of the three-dimensional Heisenberg Spin Glass model in the paramagnetic phase, i.e. for temperature $T$ larger than the critical temperature $T_\mathrm{c}$. The landscape is non-trivially related to the equilibrium states even in the high-temperature phase, and reveals an onset of non-trivial behavior at a temperature $T_\mathrm{o}$, which is also seen throu…
▽ More
We study energy landscape and dynamics of the three-dimensional Heisenberg Spin Glass model in the paramagnetic phase, i.e. for temperature $T$ larger than the critical temperature $T_\mathrm{c}$. The landscape is non-trivially related to the equilibrium states even in the high-temperature phase, and reveals an onset of non-trivial behavior at a temperature $T_\mathrm{o}$, which is also seen through the behavior of the thermoremanent magnetization. We also find a power-law growth of the relaxation times far from the spin-glass transition, indicating a dynamical crossover at a temperature $T_\mathrm{d}$, $T_\mathrm{c}<T_\mathrm{d}<T_\mathrm{o}$. The arising picture is reminiscent of the phenomenology of supercooled liquids, and poses questions on which mean-field models can describe qualitatively well the phenomenology in three dimensions. On the technical side, local energy minima are found with the Successive Overrelaxation algorithm, which reveals very efficient for energy minimization in this kind of models.
△ Less
Submitted 16 January, 2019;
originally announced January 2019.
-
The jamming transition as a paradigm to understand the loss landscape of deep neural networks
Authors:
Mario Geiger,
Stefano Spigler,
Stéphane d'Ascoli,
Levent Sagun,
Marco Baity-Jesi,
Giulio Biroli,
Matthieu Wyart
Abstract:
Deep learning has been immensely successful at a variety of tasks, ranging from classification to AI. Learning corresponds to fitting training data, which is implemented by descending a very high-dimensional loss function. Understanding under which conditions neural networks do not get stuck in poor minima of the loss, and how the landscape of that loss evolves as depth is increased remains a chal…
▽ More
Deep learning has been immensely successful at a variety of tasks, ranging from classification to AI. Learning corresponds to fitting training data, which is implemented by descending a very high-dimensional loss function. Understanding under which conditions neural networks do not get stuck in poor minima of the loss, and how the landscape of that loss evolves as depth is increased remains a challenge. Here we predict, and test empirically, an analogy between this landscape and the energy landscape of repulsive ellipses. We argue that in FC networks a phase transition delimits the over- and under-parametrized regimes where fitting can or cannot be achieved. In the vicinity of this transition, properties of the curvature of the minima of the loss are critical. This transition shares direct similarities with the jamming transition by which particles form a disordered solid as the density is increased, which also occurs in certain classes of computational optimization and learning problems such as the perceptron. Our analysis gives a simple explanation as to why poor minima of the loss cannot be encountered in the overparametrized regime, and puts forward the surprising result that the ability of fully connected networks to fit random data is independent of their depth. Our observations suggests that this independence also holds for real data. We also study a quantity $Δ$ which characterizes how well ($Δ<0$) or badly ($Δ>0$) a datum is learned. At the critical point it is power-law distributed, $P_+(Δ)\simΔ^θ$ for $Δ>0$ and $P_-(Δ)\sim(-Δ)^{-γ}$ for $Δ<0$, with $θ\approx0.3$ and $γ\approx0.2$. This observation suggests that near the transition the loss landscape has a hierarchical structure and that the learning dynamics is prone to avalanche-like dynamics, with abrupt changes in the set of patterns that are learned.
△ Less
Submitted 17 June, 2019; v1 submitted 25 September, 2018;
originally announced September 2018.
-
Activated dynamics: an intermediate model between REM and p-spin
Authors:
Marco Baity-Jesi,
Alexandre Achard-de Lustrac,
Giulio Biroli
Abstract:
In order to study the activated dynamics of mean-field glasses, which takes place on times of order exp(N), where N is the system size, we introduce a new model, the Correlated Random Energy Model (CREM), that allows for a smooth interpolation between the REM and the p-spin models. We study numerically and analytically the CREM in the intermediate regime between REM and p-spin. We fully characteri…
▽ More
In order to study the activated dynamics of mean-field glasses, which takes place on times of order exp(N), where N is the system size, we introduce a new model, the Correlated Random Energy Model (CREM), that allows for a smooth interpolation between the REM and the p-spin models. We study numerically and analytically the CREM in the intermediate regime between REM and p-spin. We fully characterize its energy landscape, which is like a golf-course but, at variance with the REM, has metabasins (or holes) containing several configurations. We find that an effective trap-like description for the dynamics emerges, provided that one identifies metabasins in the CREM with configurations in the trap model.
△ Less
Submitted 11 May, 2018;
originally announced May 2018.
-
The Mpemba effect in spin glasses is a persistent memory effect
Authors:
Janus collaboration,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Lasanta,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz-Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
The Mpemba effect occurs when a hot system cools faster than an initially colder one, when both are refrigerated in the same thermal reservoir. Using the custom built supercomputer Janus II, we study the Mpemba effect in spin glasses and show that it is a non-equilibrium process, governed by the coherence length ξof the system. The effect occurs when the bath temperature lies in the glassy phase,…
▽ More
The Mpemba effect occurs when a hot system cools faster than an initially colder one, when both are refrigerated in the same thermal reservoir. Using the custom built supercomputer Janus II, we study the Mpemba effect in spin glasses and show that it is a non-equilibrium process, governed by the coherence length ξof the system. The effect occurs when the bath temperature lies in the glassy phase, but it is not necessary for the thermal protocol to cross the critical temperature. In fact, the Mpemba effect follows from a strong relationship between the internal energy and ξthat turns out to be a sure-tell sign of being in the glassy phase. Thus, the Mpemba effect presents itself as an intriguing new avenue for the experimental study of the coherence length in supercooled liquids and other glass formers.
△ Less
Submitted 5 July, 2019; v1 submitted 20 April, 2018;
originally announced April 2018.
-
Comparing Dynamics: Deep Neural Networks versus Glassy Systems
Authors:
M. Baity-Jesi,
L. Sagun,
M. Geiger,
S. Spigler,
G. Ben Arous,
C. Cammarota,
Y. LeCun,
M. Wyart,
G. Biroli
Abstract:
We analyze numerically the training dynamics of deep neural networks (DNN) by using methods developed in statistical physics of glassy systems. The two main issues we address are (1) the complexity of the loss landscape and of the dynamics within it, and (2) to what extent DNNs share similarities with glassy systems. Our findings, obtained for different architectures and datasets, suggest that dur…
▽ More
We analyze numerically the training dynamics of deep neural networks (DNN) by using methods developed in statistical physics of glassy systems. The two main issues we address are (1) the complexity of the loss landscape and of the dynamics within it, and (2) to what extent DNNs share similarities with glassy systems. Our findings, obtained for different architectures and datasets, suggest that during the training process the dynamics slows down because of an increasingly large number of flat directions. At large times, when the loss is approaching zero, the system diffuses at the bottom of the landscape. Despite some similarities with the dynamics of mean-field glassy systems, in particular, the absence of barrier crossing, we find distinctive dynamical behaviors in the two cases, showing that the statistical properties of the corresponding loss and energy landscapes are different. In contrast, when the network is under-parametrized we observe a typical glassy behavior, thus suggesting the existence of different phases depending on whether the network is under-parametrized or over-parametrized.
△ Less
Submitted 7 June, 2018; v1 submitted 19 March, 2018;
originally announced March 2018.
-
Aging rate of spin glasses from simulations matches experiments
Authors:
Janus Collaboration,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Moreno-Gordo,
A. Muñoz-Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
Experiments on spin glasses can now make precise measurements of the exponent $z(T)$ governing the growth of glassy domains, while our computational capabilities allow us to make quantitative predictions for experimental scales. However, experimental and numerical values for $z(T)$ have differed. We use new simulations on the Janus II computer to resolve this discrepancy, finding a time-dependent…
▽ More
Experiments on spin glasses can now make precise measurements of the exponent $z(T)$ governing the growth of glassy domains, while our computational capabilities allow us to make quantitative predictions for experimental scales. However, experimental and numerical values for $z(T)$ have differed. We use new simulations on the Janus II computer to resolve this discrepancy, finding a time-dependent $z(T, t_w)$, which leads to the experimental value through mild extrapolations. Furthermore, theoretical insight is gained by studying a crossover between the $T = T_c$ and $T = 0$ fixed points.
△ Less
Submitted 18 June, 2018; v1 submitted 6 March, 2018;
originally announced March 2018.
-
Activated Aging Dynamics and Effective Trap Model Description in the Random Energy Model
Authors:
Marco Baity-Jesi,
Giulio Biroli,
Chiara Cammarota
Abstract:
We study the out-of-equilibrium aging dynamics of the Random Energy Model (REM) ruled by a single spin-flip Metropolis dynamics. We focus on the dynamical evolution taking place on time-scales diverging with the system size. Our aim is to show to what extent the activated dynamics displayed by the REM can be described in terms of an effective trap model. We identify two time regimes: the first one…
▽ More
We study the out-of-equilibrium aging dynamics of the Random Energy Model (REM) ruled by a single spin-flip Metropolis dynamics. We focus on the dynamical evolution taking place on time-scales diverging with the system size. Our aim is to show to what extent the activated dynamics displayed by the REM can be described in terms of an effective trap model. We identify two time regimes: the first one corresponds to the process of esca** from a basin in the energy landscape and to the subsequent exploration of high energy configurations, whereas the second one corresponds to the evolution from a deep basin to the other. By combining numerical simulations with analytical arguments we show why the trap model description does not hold in the former but becomes exact in the second.
△ Less
Submitted 29 November, 2017; v1 submitted 10 August, 2017;
originally announced August 2017.
-
Matching microscopic and macroscopic responses in glasses
Authors:
Janus Collaboration,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Muñoz-Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
We first reproduce on the Janus and Janus II computers a milestone experiment that measures the spin-glass coherence length through the lowering of free-energy barriers induced by the Zeeman effect. Secondly we determine the scaling behavior that allows a quantitative analysis of a new experiment reported in the companion Letter [S. Guchhait and R. Orbach, Phys. Rev. Lett. 118, 157203 (2017)]. The…
▽ More
We first reproduce on the Janus and Janus II computers a milestone experiment that measures the spin-glass coherence length through the lowering of free-energy barriers induced by the Zeeman effect. Secondly we determine the scaling behavior that allows a quantitative analysis of a new experiment reported in the companion Letter [S. Guchhait and R. Orbach, Phys. Rev. Lett. 118, 157203 (2017)]. The value of the coherence length estimated through the analysis of microscopic correlation functions turns out to be quantitatively consistent with its measurement through macroscopic response functions. Further, non-linear susceptibilities, recently measured in glass-forming liquids, scale as powers of the same microscopic length.
△ Less
Submitted 25 April, 2017;
originally announced April 2017.
-
A statics-dynamics equivalence through the fluctuation-dissipation ratio provides a window into the spin-glass phase from nonequilibrium measurements
Authors:
Janus Collaboration,
M. Baity-Jesi,
E. Calore,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Muñoz-Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
The unifying feature of glass formers (such as polymers, supercooled liquids, colloids, granulars, spin glasses, superconductors, ...) is a sluggish dynamics at low temperatures. Indeed, their dynamics is so slow that thermal equilibrium is never reached in macroscopic samples: in analogy with living beings, glasses are said to age. Here, we show how to relate experimentally relevant quantities wi…
▽ More
The unifying feature of glass formers (such as polymers, supercooled liquids, colloids, granulars, spin glasses, superconductors, ...) is a sluggish dynamics at low temperatures. Indeed, their dynamics is so slow that thermal equilibrium is never reached in macroscopic samples: in analogy with living beings, glasses are said to age. Here, we show how to relate experimentally relevant quantities with the experimentally unreachable low-temperature equilibrium phase. We have performed a very accurate computation of the non-equilibrium fluctuation-dissipation ratio for the three-dimensional Edwards-Anderson Ising spin glass, by means of large-scale simulations on the special-purpose computers Janus and Janus II. This ratio (computed for finite times on very large, effectively infinite, systems) is compared with the equilibrium probability distribution of the spin overlap for finite sizes. The resulting quantitative statics-dynamics dictionary, based on observables that can be measured with current experimental methods, could allow the experimental exploration of important features of the spin-glass phase without uncontrollable extrapolations to infinite times or system sizes.
△ Less
Submitted 24 April, 2017; v1 submitted 5 October, 2016;
originally announced October 2016.
-
Emergent SO(3) Symmetry of the Frictionless Shear Jamming Transition
Authors:
Marco Baity-Jesi,
Carl P. Goodrich,
Andrea J. Liu,
Sidney R. Nagel,
James P. Sethna
Abstract:
We study the shear jamming of athermal frictionless soft spheres, and find that in the thermodynamic limit, a shear-jammed state exists with different elastic properties from the isotropically-jammed state. For example, shear-jammed states can have a non-zero residual shear stress in the thermodynamic limit that arises from long-range stress-stress correlations. As a result, the ratio of the shear…
▽ More
We study the shear jamming of athermal frictionless soft spheres, and find that in the thermodynamic limit, a shear-jammed state exists with different elastic properties from the isotropically-jammed state. For example, shear-jammed states can have a non-zero residual shear stress in the thermodynamic limit that arises from long-range stress-stress correlations. As a result, the ratio of the shear and bulk moduli, which in isotropically-jammed systems vanishes as the jamming transition is approached from above, instead approaches a constant. Despite these striking differences, we argue that in a deeper sense, the shear jamming and isotropic jamming transitions actually have the same symmetry, and that the differences can be fully understood by rotating the six-dimensional basis of the elastic modulus tensor.
△ Less
Submitted 23 March, 2017; v1 submitted 1 September, 2016;
originally announced September 2016.
-
Criticality and Energy Landscapes in Spin Glasses
Authors:
Marco Baity-Jesi
Abstract:
Despite the extreme simplicity in their definition, spin glasses disclose a wide variety of non-trivial behaviors that are not yet fully understood. In this thesis we try to shed light on some of them, focusing on one hand on the search of phase transitions under perturbations of the Hamiltonian, and on the other hand on the zero-temperature properties and responses to external stimuli. After intr…
▽ More
Despite the extreme simplicity in their definition, spin glasses disclose a wide variety of non-trivial behaviors that are not yet fully understood. In this thesis we try to shed light on some of them, focusing on one hand on the search of phase transitions under perturbations of the Hamiltonian, and on the other hand on the zero-temperature properties and responses to external stimuli. After introducing spin glasses through a historiographical review, and useful concepts on phase transitions and numerics, the results of two massive Monte Carlo campaigns on three-dimensional systems are shown. In the first one the de Almeida-Thouless transition is studied, and a new finite-size scaling ansatz is proposed, that accelerates the convergence to the thermodynamic limit. In the second one the phase diagram of the Heisenberg spin glass with random exchange anisotropy is reconstructed. In the following part of the manuscript, surprising features of zero-temperature statics and dynamics of several spin glass models are found. Among them, correlations between soft spins that arise spontaneously during avalanches, and the discovery of localized states that involve the presence of two-level systems.
△ Less
Submitted 1 March, 2016; v1 submitted 26 February, 2016;
originally announced February 2016.
-
Soft Modes, Localization and Two-Level Systems in Spin Glasses
Authors:
Marco Baity-Jesi,
Victor Martin-Mayor,
Giorgio Parisi,
Sergio Perez-Gaviro
Abstract:
In the three-dimensional Heisenberg spin glass in a random field we study the properties of the inherent structures that are obtained by an instantaneous cooling from infinite temperature. For not too large field the density of states $g(ω)$ develops localized soft {\em plastic} modes and reaches zero as $ω^4$ (for large fiels a gap appears). When we perturb the system adding a force along the sof…
▽ More
In the three-dimensional Heisenberg spin glass in a random field we study the properties of the inherent structures that are obtained by an instantaneous cooling from infinite temperature. For not too large field the density of states $g(ω)$ develops localized soft {\em plastic} modes and reaches zero as $ω^4$ (for large fiels a gap appears). When we perturb the system adding a force along the softest mode one reaches very similar minima of the energy, separated by small barriers, that appear to be good candidates for classical two-level systems.
△ Less
Submitted 30 November, 2015; v1 submitted 16 June, 2015;
originally announced June 2015.
-
Energy landscape in three-dimensional Heisenberg spin glasses
Authors:
Marco Baity-Jesi
Abstract:
Recent work suggests that Heisenberg spin glasses may belong to the same universality class than structural glasses. Indeed, finding a lattice equivalent for supercooled liquids would probably allow easier numerical and analytical studies, that may help to answer long-standing questions on the glass transition. Supercooled liquids have many peculiar behaviors that should be found in the paramagnet…
▽ More
Recent work suggests that Heisenberg spin glasses may belong to the same universality class than structural glasses. Indeed, finding a lattice equivalent for supercooled liquids would probably allow easier numerical and analytical studies, that may help to answer long-standing questions on the glass transition. Supercooled liquids have many peculiar behaviors that should be found in the paramagnetic phase of Heisenberg spin glasses if the analogy between the two systems holds. It is with this motivation that we undertake a study of the paramagnetic phase of Heisenberg spin glasses. We shall emphasize the role of the energy landscape, with a detailed study of the properties of the inherent structures (by analogy with supercooled liquids, we name inherent structure the local minimum of the energy function which is closest to the current spin configuration). Finding inherent structures will require the development of a new search algorithm. We shall investigate as well the existence of a dynamic transition in the paramagnetic phase. As a matter of fact, both the existence of a complex energy landscape, as well as the existence of a dynamic transition, are distinguished features of the Physics of supercooled liquids.
△ Less
Submitted 29 March, 2015;
originally announced March 2015.
-
Dynamics and Correlations among Soft Excitations in Marginally Stable Glasses
Authors:
Le Yan,
Marco Baity-Jesi,
M. Mueller,
Matthieu Wyart
Abstract:
Marginal stability is the notion that stability is achieved, but only barely so. This property constrains the ensemble of configurations explored at low temperature in a variety of systems, including spin, electron and structural glasses. A key feature of marginal states is a (saturated) pseudo-gap in the distribution of soft excitations. We study how such a pseudo-gap appears dynamically in the c…
▽ More
Marginal stability is the notion that stability is achieved, but only barely so. This property constrains the ensemble of configurations explored at low temperature in a variety of systems, including spin, electron and structural glasses. A key feature of marginal states is a (saturated) pseudo-gap in the distribution of soft excitations. We study how such a pseudo-gap appears dynamically in the case of the Sherrington-Kirkpatrick (SK) spin glass. After revisiting and correcting the multi-spin-flip criterion for local stability, we show that stationarity along the hysteresis loop requires that soft spins are frustrated among each other, with a correlation that diverges as $C(λ)\sim 1/λ$, where $λ$ is the larger of two considered local fields. We explain how this arises spontaneously in a marginal system and develop an analogy between the spin dynamics in the SK model and random walks in two dimensions. We discuss the applicability of these findings to hard sphere packings.
△ Less
Submitted 13 January, 2015;
originally announced January 2015.
-
Inherent Structures in m-component Spin Glasses
Authors:
M. Baity-Jesi,
G. Parisi
Abstract:
We observe numerically the properties of the infinite-temperature inherent structures of m-component vector spin glasses in three dimensions. An increase of m implies a decrease of the amount of minima of the free energy, down to the trivial presence of a unique minimum. For little m correlations are small and the dynamics are quickly arrested, while for larger m low-temperature correlations crop…
▽ More
We observe numerically the properties of the infinite-temperature inherent structures of m-component vector spin glasses in three dimensions. An increase of m implies a decrease of the amount of minima of the free energy, down to the trivial presence of a unique minimum. For little m correlations are small and the dynamics are quickly arrested, while for larger m low-temperature correlations crop up and the convergence is slower, to a limit that appears to be related with the system size.
△ Less
Submitted 9 April, 2015; v1 submitted 8 October, 2014;
originally announced October 2014.
-
The three dimensional Ising spin glass in an external magnetic field: the role of the silent majority
Authors:
Janus Collaboration,
M. Baity-Jesi,
R. A. Banos,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
D. Iniguez,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Munoz Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
M. Pivanti,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
We perform equilibrium parallel-tempering simulations of the 3D Ising Edwards-Anderson spin glass in a field. A traditional analysis shows no signs of a phase transition. Yet, we encounter dramatic fluctuations in the behaviour of the model: Averages over all the data only describe the behaviour of a small fraction of it. Therefore we develop a new approach to study the equilibrium behaviour of th…
▽ More
We perform equilibrium parallel-tempering simulations of the 3D Ising Edwards-Anderson spin glass in a field. A traditional analysis shows no signs of a phase transition. Yet, we encounter dramatic fluctuations in the behaviour of the model: Averages over all the data only describe the behaviour of a small fraction of it. Therefore we develop a new approach to study the equilibrium behaviour of the system, by classifying the measurements as a function of a conditioning variate. We propose a finite-size scaling analysis based on the probability distribution function of the conditioning variate, which may accelerate the convergence to the thermodynamic limit. In this way, we find a non-trivial spectrum of behaviours, where a part of the measurements behaves as the average, while the majority of them shows signs of scale invariance. As a result, we can estimate the temperature interval where the phase transition in a field ought to lie, if it exists. Although this would-be critical regime is unreachable with present resources, the numerical challenge is finally well posed.
△ Less
Submitted 2 April, 2014; v1 submitted 11 March, 2014;
originally announced March 2014.
-
Critical parameters of the three-dimensional Ising spin glass
Authors:
Janus Collaboration,
M. Baity-Jesi,
R. A. Baños,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Muñoz Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
M. Pivanti,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
We report a high-precision finite-size scaling study of the critical behavior of the three-dimensional Ising Edwards-Anderson model (the Ising spin glass). We have thermalized lattices up to L=40 using the Janus dedicated computer. Our analysis takes into account leading-order corrections to scaling. We obtain Tc = 1.1019(29) for the critical temperature, ν= 2.562(42) for the thermal exponent, η=…
▽ More
We report a high-precision finite-size scaling study of the critical behavior of the three-dimensional Ising Edwards-Anderson model (the Ising spin glass). We have thermalized lattices up to L=40 using the Janus dedicated computer. Our analysis takes into account leading-order corrections to scaling. We obtain Tc = 1.1019(29) for the critical temperature, ν= 2.562(42) for the thermal exponent, η= -0.3900(36) for the anomalous dimension and ω= 1.12(10) for the exponent of the leading corrections to scaling. Standard (hyper)scaling relations yield α= -5.69(13), β= 0.782(10) and γ= 6.13(11). We also compute several universal quantities at Tc.
△ Less
Submitted 10 October, 2013;
originally announced October 2013.
-
Janus II: a new generation application-driven computer for spin-system simulations
Authors:
Janus Collaboration,
M. Baity-Jesi,
R. A. Baños,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Muñoz Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
M. Pivanti,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
This paper describes the architecture, the development and the implementation of Janus II, a new generation application-driven number cruncher optimized for Monte Carlo simulations of spin systems (mainly spin glasses). This domain of computational physics is a recognized grand challenge of high-performance computing: the resources necessary to study in detail theoretical models that can make cont…
▽ More
This paper describes the architecture, the development and the implementation of Janus II, a new generation application-driven number cruncher optimized for Monte Carlo simulations of spin systems (mainly spin glasses). This domain of computational physics is a recognized grand challenge of high-performance computing: the resources necessary to study in detail theoretical models that can make contact with experimental data are by far beyond those available using commodity computer systems. On the other hand, several specific features of the associated algorithms suggest that unconventional computer architectures, which can be implemented with available electronics technologies, may lead to order of magnitude increases in performance, reducing to acceptable values on human scales the time needed to carry out simulation campaigns that would take centuries on commercially available machines. Janus II is one such machine, recently developed and commissioned, that builds upon and improves on the successful JANUS machine, which has been used for physics since 2008 and is still in operation today. This paper describes in detail the motivations behind the project, the computational requirements, the architecture and the implementation of this new machine and compares its expected performances with those of currently available commercial systems.
△ Less
Submitted 3 October, 2013;
originally announced October 2013.
-
Phase Transition in 3d Heisenberg Spin Glasses with Strong Random Anisotropies, through a Multi-GPU Parallelization
Authors:
M. Baity-Jesi,
L. A. Fernandez,
V. Martin-Mayor,
J. M. Sanz
Abstract:
We characterize the phase diagram of anisotropic Heisenberg spin glasses, finding both the spin and the chiral glass transition. We remark the presence of strong finite-size effects on the chiral sector. We find a unique phase transition for the chiral and spin glass sector, in the Universality class of Ising spin glasses. We focus on kee** finite-size effects under control, and we stress that t…
▽ More
We characterize the phase diagram of anisotropic Heisenberg spin glasses, finding both the spin and the chiral glass transition. We remark the presence of strong finite-size effects on the chiral sector. We find a unique phase transition for the chiral and spin glass sector, in the Universality class of Ising spin glasses. We focus on kee** finite-size effects under control, and we stress that they are important to understand experiments. Thanks to large GPU clusters we have been able to thermalize cubic lattices with up to 64x64x64 spins, over a vast range of temperatures.
△ Less
Submitted 13 January, 2014; v1 submitted 6 September, 2013;
originally announced September 2013.
-
Dynamical transition in the D = 3 Edwards-Anderson spin glass in an external magnetic field
Authors:
Janus Collaboration,
M. Baity-Jesi,
R. Alvarez Baños,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
Gordillo-Guerrero,
D. Iñiguez,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Muñoz Sudupe,
D. Navarro,
G. Parisi,
S. Perez-Gaviro,
M. Pivanti,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
R. Tripiccione,
D. Yllanes
Abstract:
We study the off-equilibrium dynamics of the three-dimensional Ising spin glass in the presence of an external magnetic field. We have performed simulations both at fixed temperature and with an annealing protocol. Thanks to the Janus special-purpose computer, based on FPGAs, we have been able to reach times equivalent to 0.01 seconds in experiments. We have studied the system relaxation both for…
▽ More
We study the off-equilibrium dynamics of the three-dimensional Ising spin glass in the presence of an external magnetic field. We have performed simulations both at fixed temperature and with an annealing protocol. Thanks to the Janus special-purpose computer, based on FPGAs, we have been able to reach times equivalent to 0.01 seconds in experiments. We have studied the system relaxation both for high and for low temperatures, clearly identifying a dynamical transition point. This dynamical temperature is strictly positive and depends on the external applied magnetic field. We discuss different possibilities for the underlying physics, which include a thermodynamical spin-glass transition, a mode-coupling crossover or an interpretation reminiscent of the random first-order picture of structural glasses.
△ Less
Submitted 12 March, 2014; v1 submitted 18 July, 2013;
originally announced July 2013.
-
Reconfigurable computing for Monte Carlo simulations: results and prospects of the Janus project
Authors:
Janus Collaboration,
M. Baity-Jesi,
R. A. Banos,
A. Cruz,
L. A. Fernandez,
J. M. Gil-Narvion,
A. Gordillo-Guerrero,
M. Guidetti,
D. Iniguez,
A. Maiorano,
F. Mantovani,
E. Marinari,
V. Martin-Mayor,
J. Monforte-Garcia,
A. Munoz Sudupe,
D. Navarro,
G. Parisi,
M. Pivanti,
S. Perez-Gaviro,
F. Ricci-Tersenghi,
J. J. Ruiz-Lorenzo,
S. F. Schifano,
B. Seoane,
A. Tarancon,
P. Tellez
, et al. (2 additional authors not shown)
Abstract:
We describe Janus, a massively parallel FPGA-based computer optimized for the simulation of spin glasses, theoretical models for the behavior of glassy materials. FPGAs (as compared to GPUs or many-core processors) provide a complementary approach to massively parallel computing. In particular, our model problem is formulated in terms of binary variables, and floating-point operations can be (almo…
▽ More
We describe Janus, a massively parallel FPGA-based computer optimized for the simulation of spin glasses, theoretical models for the behavior of glassy materials. FPGAs (as compared to GPUs or many-core processors) provide a complementary approach to massively parallel computing. In particular, our model problem is formulated in terms of binary variables, and floating-point operations can be (almost) completely avoided. The FPGA architecture allows us to run many independent threads with almost no latencies in memory access, thus updating up to 1024 spins per cycle. We describe Janus in detail and we summarize the physics results obtained in four years of operation of this machine; we discuss two types of physics applications: long simulations on very large systems (which try to mimic and provide understanding about the experimental non-equilibrium dynamics), and low-temperature equilibrium simulations using an artificial parallel tempering dynamics. The time scale of our non-equilibrium simulations spans eleven orders of magnitude (from picoseconds to a tenth of a second). On the other hand, our equilibrium simulations are unprecedented both because of the low temperatures reached and for the large systems that we have brought to equilibrium. A finite-time scaling ansatz emerges from the detailed comparison of the two sets of simulations. Janus has made it possible to perform spin-glass simulations that would take several decades on more conventional architectures. The paper ends with an assessment of the potential of possible future versions of the Janus architecture, based on state-of-the-art technology.
△ Less
Submitted 18 April, 2012;
originally announced April 2012.
