Showing 1–50 of 50 results for author: Seoane, B

Fast, accurate training and sampling of Restricted Boltzmann Machines

Authors: Nicolas Béreux, Aurélien Decelle, Cyril Furtlehner, Lorenzo Rosset, Beatriz Seoane

Abstract: Thanks to their simple architecture, Restricted Boltzmann Machines (RBMs) are powerful tools for modeling complex systems and extracting interpretable insights from data. However, training RBMs, as other energy-based models, on highly structured data poses a major challenge, as effective training relies on mixing the Markov chain Monte Carlo simulations used to estimate the gradient. This process… ▽ More Thanks to their simple architecture, Restricted Boltzmann Machines (RBMs) are powerful tools for modeling complex systems and extracting interpretable insights from data. However, training RBMs, as other energy-based models, on highly structured data poses a major challenge, as effective training relies on mixing the Markov chain Monte Carlo simulations used to estimate the gradient. This process is often hindered by multiple second-order phase transitions and the associated critical slowdown. In this paper, we present an innovative method in which the principal directions of the dataset are integrated into a low-rank RBM through a convex optimization procedure. This approach enables efficient sampling of the equilibrium measure via a static Monte Carlo process. By starting the standard training process with a model that already accurately represents the main modes of the data, we bypass the initial phase transitions. Our results show that this strategy successfully trains RBMs to capture the full diversity of data in datasets where previous methods fail. Furthermore, we use the training trajectories to propose a new sampling method, {\em parallel trajectory tempering}, which allows us to sample the equilibrium measure of the trained model much faster than previous optimized MCMC approaches and a better estimation of the log-likelihood. We illustrate the success of the training method on several highly structured datasets. △ Less

Submitted 24 May, 2024; originally announced May 2024.

Comments: 18 pages, 8 figures

Cascade of phase transitions in the training of Energy-based models

Authors: Dimitrios Bachtis, Giulio Biroli, Aurélien Decelle, Beatriz Seoane

Abstract: In this paper, we investigate the feature encoding process in a prototypical energy-based generative model, the Restricted Boltzmann Machine (RBM). We start with an analytical investigation using simplified architectures and data structures, and end with numerical analysis of real trainings on real datasets. Our study tracks the evolution of the model's weight matrix through its singular value dec… ▽ More In this paper, we investigate the feature encoding process in a prototypical energy-based generative model, the Restricted Boltzmann Machine (RBM). We start with an analytical investigation using simplified architectures and data structures, and end with numerical analysis of real trainings on real datasets. Our study tracks the evolution of the model's weight matrix through its singular value decomposition, revealing a series of phase transitions associated to a progressive learning of the principal modes of the empirical probability distribution. The model first learns the center of mass of the modes and then progressively resolve all modes through a cascade of phase transitions. We first describe this process analytically in a controlled setup that allows us to study analytically the training dynamics. We then validate our theoretical results by training the Bernoulli-Bernoulli RBM on real data sets. By using data sets of increasing dimension, we show that learning indeed leads to sharp phase transitions in the high-dimensional limit. Moreover, we propose and test a mean-field finite-size scaling hypothesis. This shows that the first phase transition is in the same universality class of the one we studied analytically, and which is reminiscent of the mean-field paramagnetic-to-ferromagnetic phase transition. △ Less

Submitted 29 May, 2024; v1 submitted 23 May, 2024; originally announced May 2024.

Comments: 19 pages, 6 figures

Inferring effective couplings with Restricted Boltzmann Machines

Authors: Aurélien Decelle, Cyril Furtlehner, Alfonso De Jesus Navas Gómez, Beatriz Seoane

Abstract: Generative models offer a direct way of modeling complex data. Energy-based models attempt to encode the statistical correlations observed in the data at the level of the Boltzmann weight associated with an energy function in the form of a neural network. We address here the challenge of understanding the physical interpretation of such models. In this study, we propose a simple solution by implem… ▽ More Generative models offer a direct way of modeling complex data. Energy-based models attempt to encode the statistical correlations observed in the data at the level of the Boltzmann weight associated with an energy function in the form of a neural network. We address here the challenge of understanding the physical interpretation of such models. In this study, we propose a simple solution by implementing a direct map** between the Restricted Boltzmann Machine and an effective Ising spin Hamiltonian. This map** includes interactions of all possible orders, going beyond the conventional pairwise interactions typically considered in the inverse Ising (or Boltzmann Machine) approach, and allowing the description of complex datasets. Earlier works attempted to achieve this goal, but the proposed map**s were inaccurate for inference applications, did not properly treat the complexity of the problem, or did not provide precise prescriptions for practical application. To validate our method, we performed several controlled inverse numerical experiments in which we trained the RBMs using equilibrium samples of predefined models with local external fields, 2-body and 3-body interactions in different sparse topologies. The results demonstrate the effectiveness of our proposed approach in learning the correct interaction network and pave the way for its application in modeling interesting binary variable datasets. We also evaluate the quality of the inferred model based on different training methods. △ Less

Submitted 24 January, 2024; v1 submitted 5 September, 2023; originally announced September 2023.

Comments: 17 figures, 39 pages

Journal ref: SciPost Phys. 16, 095 (2024)

The Copycat Perceptron: Smashing Barriers Through Collective Learning

Authors: Giovanni Catania, Aurélien Decelle, Beatriz Seoane

Abstract: We characterize the equilibrium properties of a model of $y$ coupled binary perceptrons in the teacher-student scenario, subject to a suitable cost function, with an explicit ferromagnetic coupling proportional to the Hamming distance between the students' weights. In contrast to recent works, we analyze a more general setting in which thermal noise is present that affects each student's generaliz… ▽ More We characterize the equilibrium properties of a model of $y$ coupled binary perceptrons in the teacher-student scenario, subject to a suitable cost function, with an explicit ferromagnetic coupling proportional to the Hamming distance between the students' weights. In contrast to recent works, we analyze a more general setting in which thermal noise is present that affects each student's generalization performance. In the nonzero temperature regime, we find that the coupling of replicas leads to a bend of the phase diagram towards smaller values of $α$: This suggests that the free entropy landscape gets smoother around the solution with perfect generalization (i.e., the teacher) at a fixed fraction of examples, allowing standard thermal updating algorithms such as Simulated Annealing to easily reach the teacher solution and avoid getting trapped in metastable states as it happens in the unreplicated case, even in the computationally \textit{easy} regime of the inference phase diagram. These results provide additional analytic and numerical evidence for the recently conjectured Bayes-optimal property of Replicated Simulated Annealing (RSA) for a sufficient number of replicas. From a learning perspective, these results also suggest that multiple students working together (in this case reviewing the same data) are able to learn the same rule both significantly faster and with fewer examples, a property that could be exploited in the context of cooperative and federated learning. △ Less

Submitted 5 June, 2024; v1 submitted 7 August, 2023; originally announced August 2023.

Comments: 2 figures in the main, 5 figures in the appendix

Journal ref: Phys. Rev. E 109, 065313 (2024)

Fast and Functional Structured Data Generators Rooted in Out-of-Equilibrium Physics

Authors: Alessandra Carbone, Aurélien Decelle, Lorenzo Rosset, Beatriz Seoane

Abstract: In this study, we address the challenge of using energy-based models to produce high-quality, label-specific data in complex structured datasets, such as population genetics, RNA or protein sequences data. Traditional training methods encounter difficulties due to inefficient Markov chain Monte Carlo mixing, which affects the diversity of synthetic data and increases generation times. To address t… ▽ More In this study, we address the challenge of using energy-based models to produce high-quality, label-specific data in complex structured datasets, such as population genetics, RNA or protein sequences data. Traditional training methods encounter difficulties due to inefficient Markov chain Monte Carlo mixing, which affects the diversity of synthetic data and increases generation times. To address these issues, we use a novel training algorithm that exploits non-equilibrium effects. This approach, applied on the Restricted Boltzmann Machine, improves the model's ability to correctly classify samples and generate high-quality synthetic data in only a few sampling steps. The effectiveness of this method is demonstrated by its successful application to four different types of data: handwritten digits, mutations of human genomes classified by continental origin, functionally characterized sequences of an enzyme protein family, and homologous RNA sequences from specific taxonomies. △ Less

Submitted 13 July, 2023; originally announced July 2023.

Comments: 15 pages

Quantifying memory in spin glasses

Authors: Janus Collaboration, I. Paga, J. He, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz Sudupe, D. Navarro, R. L. Orbach, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, D. L. Schlagel, B. Seoane , et al. (2 additional authors not shown)

Abstract: Rejuvenation and memory, long considered the distinguishing features of spin glasses, have recently been proven to result from the growth of multiple length scales. This insight, enabled by simulations on the Janus~II supercomputer, has opened the door to a quantitative analysis. We combine numerical simulations with comparable experiments to introduce two coefficients that quantify memory. A thir… ▽ More Rejuvenation and memory, long considered the distinguishing features of spin glasses, have recently been proven to result from the growth of multiple length scales. This insight, enabled by simulations on the Janus~II supercomputer, has opened the door to a quantitative analysis. We combine numerical simulations with comparable experiments to introduce two coefficients that quantify memory. A third coefficient has been recently presented by Freedberg et al. We show that these coefficients are physically equivalent by studying their temperature and waiting-time dependence. △ Less

Submitted 5 July, 2023; originally announced July 2023.

Comments: 10 pages, 8 figures

Multifractality in spin glasses

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz Sudupe, D. Navarro, I. Paga, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, D. Yllanes

Abstract: We unveil the multifractal behavior of Ising spin glasses in their low-temperature phase. Using the Janus II custom-built supercomputer, the spin-glass correlation function is studied locally. Dramatic fluctuations are found when pairs of sites at the same distance are compared. The scaling of these fluctuations, as the spin-glass coherence length grows with time, is characterized through the comp… ▽ More We unveil the multifractal behavior of Ising spin glasses in their low-temperature phase. Using the Janus II custom-built supercomputer, the spin-glass correlation function is studied locally. Dramatic fluctuations are found when pairs of sites at the same distance are compared. The scaling of these fluctuations, as the spin-glass coherence length grows with time, is characterized through the computation of the singularity spectrum and its corresponding Legendre transform. A comparatively small number of site pairs controls the average correlation that governs the response to a magnetic field. We explain how this scenario of dramatic fluctuations (at length scales smaller than the coherence length) can be reconciled with the smooth, self-averaging behavior that has long been considered to describe spin-glass dynamics. △ Less

Submitted 22 January, 2024; v1 submitted 7 June, 2023; originally announced June 2023.

Comments: 15 pages, 15 figures

Journal ref: PNAS 121, e2312880120 (2024)

Unsupervised hierarchical clustering using the learning dynamics of RBMs

Authors: Aurélien Decelle, Lorenzo Rosset, Beatriz Seoane

Abstract: Datasets in the real world are often complex and to some degree hierarchical, with groups and sub-groups of data sharing common characteristics at different levels of abstraction. Understanding and uncovering the hidden structure of these datasets is an important task that has many practical applications. To address this challenge, we present a new and general method for building relational data t… ▽ More Datasets in the real world are often complex and to some degree hierarchical, with groups and sub-groups of data sharing common characteristics at different levels of abstraction. Understanding and uncovering the hidden structure of these datasets is an important task that has many practical applications. To address this challenge, we present a new and general method for building relational data trees by exploiting the learning dynamics of the Restricted Boltzmann Machine (RBM). Our method is based on the mean-field approach, derived from the Plefka expansion, and developed in the context of disordered systems. It is designed to be easily interpretable. We tested our method in an artificially created hierarchical dataset and on three different real-world datasets (images of digits, mutations in the human genome, and a homologous family of proteins). The method is able to automatically identify the hierarchical structure of the data. This could be useful in the study of homologous protein sequences, where the relationships between proteins are critical for understanding their function and evolution. △ Less

Submitted 9 June, 2023; v1 submitted 3 February, 2023; originally announced February 2023.

Comments: Version accepted in Physical Review E

Journal ref: Phys. Rev. E 108, 014110 (2023)

Explaining the effects of non-convergent sampling in the training of Energy-Based Models

Authors: Elisabeth Agoritsas, Giovanni Catania, Aurélien Decelle, Beatriz Seoane

Abstract: In this paper, we quantify the impact of using non-convergent Markov chains to train Energy-Based models (EBMs). In particular, we show analytically that EBMs trained with non-persistent short runs to estimate the gradient can perfectly reproduce a set of empirical statistics of the data, not at the level of the equilibrium measure, but through a precise dynamical process. Our results provide a fi… ▽ More In this paper, we quantify the impact of using non-convergent Markov chains to train Energy-Based models (EBMs). In particular, we show analytically that EBMs trained with non-persistent short runs to estimate the gradient can perfectly reproduce a set of empirical statistics of the data, not at the level of the equilibrium measure, but through a precise dynamical process. Our results provide a first-principles explanation for the observations of recent works proposing the strategy of using short runs starting from random initial conditions as an efficient way to generate high-quality samples in EBMs, and lay the groundwork for using EBMs as diffusion models. After explaining this effect in generic EBMs, we analyze two solvable models in which the effect of the non-convergent sampling in the trained parameters can be described in detail. Finally, we test these predictions numerically on a ConvNet EBM and a Boltzmann machine. △ Less

Submitted 31 May, 2023; v1 submitted 23 January, 2023; originally announced January 2023.

Comments: Accepted at ICML 2023

Thermodynamics of bidirectional associative memories

Authors: Adriano Barra, Giovanni Catania, Aurélien Decelle, Beatriz Seoane

Abstract: In this paper we investigate the equilibrium properties of bidirectional associative memories (BAMs). Introduced by Kosko in 1988 as a generalization of the Hopfield model to a bipartite structure, the simplest architecture is defined by two layers of neurons, with synaptic connections only between units of different layers: even without internal connections within each layer, information storage… ▽ More In this paper we investigate the equilibrium properties of bidirectional associative memories (BAMs). Introduced by Kosko in 1988 as a generalization of the Hopfield model to a bipartite structure, the simplest architecture is defined by two layers of neurons, with synaptic connections only between units of different layers: even without internal connections within each layer, information storage and retrieval are still possible through the reverberation of neural activities passing from one layer to another. We characterize the computational capabilities of a stochastic extension of this model in the thermodynamic limit, by applying rigorous techniques from statistical physics. A detailed picture of the phase diagram at the replica symmetric level is provided, both at finite temperature and in the noiseless regimes. Also for the latter, the critical load is further investigated up to one step of replica symmetry breaking. An analytical and numerical inspection of the transition curves (namely critical lines splitting the various modes of operation of the machine) is carried out as the control parameters - noise, load and asymmetry between the two layer sizes - are tuned. In particular, with a finite asymmetry between the two layers, it is shown how the BAM can store information more efficiently than the Hopfield model by requiring less parameters to encode a fixed number of patterns. Comparisons are made with numerical simulations of neural dynamics. Finally, a low-load analysis is carried out to explain the retrieval mechanism in the BAM by analogy with two interacting Hopfield models. A potential equivalence with two coupled Restricted Boltmzann Machines is also discussed. △ Less

Submitted 27 March, 2023; v1 submitted 17 November, 2022; originally announced November 2022.

Comments: 25 pages, 11 figures

Journal ref: J. Phys. A: Math. Theor. 56 205005 (2023)

On the superposition principle and non-linear response in spin glasses

Authors: I. Paga, Q. Zhai, M. Baity-Jesi, E. Calore, A. Cruz, C. Cummings, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, G. G. Kenning, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, R. L. Orbach, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, D. L. Schlagel , et al. (3 additional authors not shown)

Abstract: The extended principle of superposition has been a touchstone of spin glass dynamics for almost thirty years. The Uppsala group has demonstrated its validity for the metallic spin glass, CuMn, for magnetic fields $H$ up to 10 Oe at the reduced temperature $T_\mathrm{r}=T/T_\mathrm{g} = 0.95$, where $T_\mathrm{g}$ is the spin glass condensation temperature. For $H > 10$ Oe, they observe a departure… ▽ More The extended principle of superposition has been a touchstone of spin glass dynamics for almost thirty years. The Uppsala group has demonstrated its validity for the metallic spin glass, CuMn, for magnetic fields $H$ up to 10 Oe at the reduced temperature $T_\mathrm{r}=T/T_\mathrm{g} = 0.95$, where $T_\mathrm{g}$ is the spin glass condensation temperature. For $H > 10$ Oe, they observe a departure from linear response which they ascribe to the development of non-linear dynamics. The thrust of this paper is to develop a microscopic origin for this behavior by focusing on the time development of the spin glass correlation length, $ξ(t,t_\mathrm{w};H)$. Here, $t$ is the time after $H$ changes, and $t_\mathrm{w}$ is the time from the quench for $T>T_\mathrm{g}$ to the working temperature $T$ until $H$ changes. We connect the growth of $ξ(t,t_\mathrm{w};H)$ to the barrier heights $Δ(t_\mathrm{w})$ that set the dynamics. The effect of $H$ on the magnitude of $Δ(t_\mathrm{w})$ is responsible for affecting differently the two dynamical protocols associated with turning $H$ off (TRM, or thermoremanent magnetization) or on (ZFC, or zero field-cooled magnetization). In this paper, we display the difference between the zero-field cooled $ξ_{\text {ZFC}}(t,t_\mathrm{w};H)$ and the thermoremanent magnetization $ξ_{\text {TRM}}(t,t_\mathrm{w};H)$ correlation lengths as $H$ increases, both experimentally and through numerical simulations, corresponding to the violation of the extended principle of superposition in line with the finding of the Uppsala Group. △ Less

Submitted 26 June, 2023; v1 submitted 21 July, 2022; originally announced July 2022.

Comments: 23 pages and 18 figures

Journal ref: Phys. Rev. B 107, 214436- Published 23 June 2023

Memory and rejuvenation in spin glasses: aging systems are ruled by more than one length scale

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, I. Paga, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: Memory and rejuvenation effects in the magnetic response of off-equilibrium spin glasses have been widely regarded as the doorway into the experimental exploration of ultrametricity and temperature chaos (maybe the most exotic features in glassy free-energy landscapes). Unfortunately, despite more than twenty years of theoretical efforts following the experimental discovery of memory and rejuvenat… ▽ More Memory and rejuvenation effects in the magnetic response of off-equilibrium spin glasses have been widely regarded as the doorway into the experimental exploration of ultrametricity and temperature chaos (maybe the most exotic features in glassy free-energy landscapes). Unfortunately, despite more than twenty years of theoretical efforts following the experimental discovery of memory and rejuvenation, these effects have thus far been impossible to simulate reliably. Yet, three recent developments convinced us to accept this challenge: first, the custom-built Janus II supercomputer makes it possible to carry out "numerical experiments" in which the very same quantities that can be measured in single crystals of CuMn are computed from the simulation, allowing for parallel analysis of the simulation/experiment data. Second, Janus II simulations have taught us how numerical and experimental length scales should be compared. Third, we have recently understood how temperature chaos materializes in aging dynamics. All three aspects have proved crucial for reliably reproducing rejuvenation and memory effects on the computer. Our analysis shows that (at least) three different length scales play a key role in aging dynamics, while essentially all theoretical analyses of the aging dynamics emphasize the presence and the crucial role of a single glassy correlation length. △ Less

Submitted 30 August, 2022; v1 submitted 13 July, 2022; originally announced July 2022.

Comments: Main text:13 pages, 4 figures SM: 7 pages, 8 figures

Journal ref: Nature Physics 19, 978-985 (2023)

Learning a Restricted Boltzmann Machine using biased Monte Carlo sampling

Authors: Nicolas Béreux, Aurélien Decelle, Cyril Furtlehner, Beatriz Seoane

Abstract: Restricted Boltzmann Machines are simple and powerful generative models that can encode any complex dataset. Despite all their advantages, in practice the trainings are often unstable and it is difficult to assess their quality because the dynamics are affected by extremely slow time dependencies. This situation becomes critical when dealing with low-dimensional clustered datasets, where the time… ▽ More Restricted Boltzmann Machines are simple and powerful generative models that can encode any complex dataset. Despite all their advantages, in practice the trainings are often unstable and it is difficult to assess their quality because the dynamics are affected by extremely slow time dependencies. This situation becomes critical when dealing with low-dimensional clustered datasets, where the time required to sample ergodically the trained models becomes computationally prohibitive. In this work, we show that this divergence of Monte Carlo mixing times is related to a phenomenon of phase coexistence, similar to that which occurs in physics near a first-order phase transition. We show that sampling the equilibrium distribution using the Markov chain Monte Carlo method can be dramatically accelerated when using biased sampling techniques, in particular the Tethered Monte Carlo (TMC) method. This sampling technique efficiently solves the problem of evaluating the quality of a given trained model and generating new samples in a reasonable amount of time. Moreover, we show that this sampling technique can also be used to improve the computation of the log-likelihood gradient during training, leading to dramatic improvements in training RBMs with artificial clustered datasets. On real low-dimensional datasets, this new training method fits RBM models with significantly faster relaxation dynamics than those obtained with standard PCD recipes. We also show that TMC sampling can be used to recover the free-energy profile of the RBM. This proves to be extremely useful to compute the probability distribution of a given model and to improve the generation of new decorrelated samples in slow PCD-trained models. △ Less

Submitted 5 October, 2022; v1 submitted 2 June, 2022; originally announced June 2022.

Comments: 24 pages, 12 figures

Journal ref: SciPost Phys. 14, 032 (2023)

Numerical Simulations and Replica Symmetry Breaking

Authors: V. Martin-Mayor, J. J. Ruiz-Lorenzo, B. Seoane, A. P. Young

Abstract: Use of dedicated computers in spin glass simulations allows one to equilibrate very large samples (of size as large as $L=32$) and to carry out "computer experiments" that can be compared to (and analyzed in combination with) laboratory experiments on spin-glass samples. In the absence of a magnetic field, the most economic conclusion of the combined analysis of equilibrium and non-equilibrium sim… ▽ More Use of dedicated computers in spin glass simulations allows one to equilibrate very large samples (of size as large as $L=32$) and to carry out "computer experiments" that can be compared to (and analyzed in combination with) laboratory experiments on spin-glass samples. In the absence of a magnetic field, the most economic conclusion of the combined analysis of equilibrium and non-equilibrium simulations is that an RSB spin glass phase is present in three spatial dimensions. However, in the presence of a field, the lower critical dimension for the de Almeida-Thouless transition seems to be larger than three. △ Less

Submitted 11 October, 2022; v1 submitted 27 May, 2022; originally announced May 2022.

Comments: 28 pages and 11 figures. We have added an additional scenario in Sect. 4. To appear as a contribution to the edited volume "Spin Glass Theory & Far Beyond - Replica Symmetry Breaking after 40 Years", World Scientific

Soft disorder modulates the assembly path of protein complexes

Authors: Beatriz Seoane, Alessandra Carbone

Abstract: The relationship between interactions, flexibility and disorder in proteins has been explored from many angles: folding upon binding, flexibility of the core relative to the periphery, entropy changes, etc. In this work, we provide statistical evidence for the involvement of highly mobile and disordered regions in complex assembly. We ordered the entire set of X-ray crystallographic structures in… ▽ More The relationship between interactions, flexibility and disorder in proteins has been explored from many angles: folding upon binding, flexibility of the core relative to the periphery, entropy changes, etc. In this work, we provide statistical evidence for the involvement of highly mobile and disordered regions in complex assembly. We ordered the entire set of X-ray crystallographic structures in the PDB into hierarchies of progressive interactions involving identical or very similar protein chains, yielding 40205 hierarchies of complexes with increasing numbers of partners. We then examine them as proxies for the assembly pathways. Using this database, we show that upon oligomerisation, new interfaces tend to be observed at residues that were characterised as softly disordered (flexible, amorphous or missing residues) in the complexes preceding them in the hierarchy. We also rule out the possibility that this correlation is just a surface effect by restricting the analysis to residues on the surface. Interestingly, we find that the location of soft disordered residues in the sequence changes as the number of partners increases. Our results show that there is a general mechanism for protein assembly that involves soft disorder and modulates the way protein complexes are assembled. This work highlights the difficulty of predicting the structure of large protein complexes from sequence and emphasises the importance of linking predictors of disorder to the next generation of predictors of complex structure. Finally, we investigate the relationship between the AF2's confidence metric pLDDT for structure prediction in unbound vs. bound structures, and soft disorder. We show a strong correlation between AF2 low confidence residues and the union of all regions of soft disorder observed in the hierarchy. This paves the way for using the pLDDT metric as a proxy for predicting assembly paths. △ Less

Submitted 19 October, 2022; v1 submitted 11 January, 2022; originally announced January 2022.

Comments: 22 pages, 5 figures + 3 supplementary figures

Journal ref: PLoS Comput Biol 18(11): e1010713 (2022)

Equilibrium and non-Equilibrium regimes in the learning of Restricted Boltzmann Machines

Authors: Aurélien Decelle, Cyril Furtlehner, Beatriz Seoane

Abstract: Training Restricted Boltzmann Machines (RBMs) has been challenging for a long time due to the difficulty of computing precisely the log-likelihood gradient. Over the past decades, many works have proposed more or less successful training recipes but without studying the crucial quantity of the problem: the mixing time, i.e. the number of Monte Carlo iterations needed to sample new configurations f… ▽ More Training Restricted Boltzmann Machines (RBMs) has been challenging for a long time due to the difficulty of computing precisely the log-likelihood gradient. Over the past decades, many works have proposed more or less successful training recipes but without studying the crucial quantity of the problem: the mixing time, i.e. the number of Monte Carlo iterations needed to sample new configurations from a model. In this work, we show that this mixing time plays a crucial role in the dynamics and stability of the trained model, and that RBMs operate in two well-defined regimes, namely equilibrium and out-of-equilibrium, depending on the interplay between this mixing time of the model and the number of steps, $k$, used to approximate the gradient. We further show empirically that this mixing time increases with the learning, which often implies a transition from one regime to another as soon as $k$ becomes smaller than this time. In particular, we show that using the popular $k$ (persistent) contrastive divergence approaches, with $k$ small, the dynamics of the learned model are extremely slow and often dominated by strong out-of-equilibrium effects. On the contrary, RBMs trained in equilibrium display faster dynamics, and a smooth convergence to dataset-like configurations during the sampling. Finally we discuss how to exploit in practice both regimes depending on the task one aims to fulfill: (i) short $k$ can be used to generate convincing samples in short learning times, (ii) large $k$ (or increasingly large) is needed to learn the correct equilibrium distribution of the RBM. Finally, the existence of these two operational regimes seems to be a general property of energy based models trained via likelihood maximization. △ Less

Submitted 23 November, 2021; v1 submitted 28 May, 2021; originally announced May 2021.

Comments: 12 page, 4 figures. accepted to Neurips 2021 Supplementary Material

Journal ref: NeurIps 2021

Spin-glass dynamics in the presence of a magnetic field: exploration of microscopic properties

Authors: I. Paga, Q. Zhai, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, R. L. Orbach, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, D. L. Schlagel, B. Seoane, A. Tarancon , et al. (2 additional authors not shown)

Abstract: The synergy between experiment, theory, and simulations enables a microscopic analysis of spin-glass dynamics in a magnetic field in the vicinity of and below the spin-glass transition temperature $T_\mathrm{g}$. The spin-glass correlation length, $ξ(t,t_\mathrm{w};T)$, is analysed both in experiments and in simulations in terms of the waiting time $t_\mathrm{w}$ after the spin glass has been cool… ▽ More The synergy between experiment, theory, and simulations enables a microscopic analysis of spin-glass dynamics in a magnetic field in the vicinity of and below the spin-glass transition temperature $T_\mathrm{g}$. The spin-glass correlation length, $ξ(t,t_\mathrm{w};T)$, is analysed both in experiments and in simulations in terms of the waiting time $t_\mathrm{w}$ after the spin glass has been cooled down to a stabilised measuring temperature $T<T_\mathrm{g}$ and of the time $t$ after the magnetic field is changed. This correlation length is extracted experimentally for a CuMn 6 at. % single crystal, as well as for simulations on the Janus II special-purpose supercomputer, the latter with time and length scales comparable to experiment. The non-linear magnetic susceptibility is reported from experiment and simulations, using $ξ(t,t_\mathrm{w};T)$ as the scaling variable. Previous experiments are reanalysed, and disagreements about the nature of the Zeeman energy are resolved. The growth of the spin-glass magnetisation in zero-field magnetisation experiments, $M_\mathrm{ZFC}(t,t_\mathrm{w};T)$, is measured from simulations, verifying the scaling relationships in the dynamical or non-equilibrium regime. Our preliminary search for the de Almeida-Thouless line in $D=3$ is discussed. △ Less

Submitted 10 March, 2021; v1 submitted 4 January, 2021; originally announced January 2021.

Comments: 49 pages, figures 25

Journal ref: J. Stat. Mech. (2021) 033301

The complexity of protein interactions unravelled from structural disorder

Authors: Beatriz Seoane, Alessandra Carbone

Abstract: The idea that structural disorder might be a novel mechanism of protein interaction is widespread in the Literature, although the number of statistically significant structural studies supporting this is surprisingly low. At variance with previous works, our conclusions rely exclusively on a large-scale analysis of all the 134337 X-ray crystallographic structures of the Protein Data Bank averaged… ▽ More The idea that structural disorder might be a novel mechanism of protein interaction is widespread in the Literature, although the number of statistically significant structural studies supporting this is surprisingly low. At variance with previous works, our conclusions rely exclusively on a large-scale analysis of all the 134337 X-ray crystallographic structures of the Protein Data Bank averaged over clusters of almost identical protein sequences. In this work, we explore the complexity of the organization of all the interaction interfaces observed when a protein lies in alternative complexes, showing that interfaces progressively add up in a hierarchical way. We further investigate the connection of this complexity with different measures of structural disorder: the standard missing residues and a new definition, called "soft disorder", that covers all the flexible and structurally amorphous residues of a protein. We show evidences that both the interaction interfaces and the soft disordered regions tend to involve roughly the same amino-acids of the protein, and preliminary results suggesting that soft disorder spots those surface regions where new interfaces are progressively accommodated by complex formation. Our results suggest that disordered regions not only carry crucial information about the location of alternative interfaces within complexes, but also of the order of the assembly. We verify these hypotheses in several examples. We finally compare our measures of disorder with several disorder predictors, showing that these latter are optimized to predict the residues that are missing in all the alternative structures of a protein, and they are not able to catch the progressive evolution of the disordered regions upon complex formation. Yet, the predicted residues, if not missing, tend to be characterized as soft disordered. △ Less

Submitted 24 November, 2020; originally announced November 2020.

Comments: Version accepted in PLOS Computational Biology. 43 pages including Supplemental Material, 26 figures (where 13 in the main-text)

Journal ref: PLoS Comput Biol 17(1): e1008546 (2021)

Temperature chaos is present in off-equilibrium spin-glass dynamics

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, I. Paga, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We find a dynamic effect in the non-equilibrium dynamics of a spin glass that closely parallels equilibrium temperature chaos. This effect, that we name dynamic temperature chaos, is spatially heterogeneous to a large degree. The key controlling quantity is the time-growing spin-glass coherence length. Our detailed characterization of dynamic temperature chaos paves the way for the analysis of rec… ▽ More We find a dynamic effect in the non-equilibrium dynamics of a spin glass that closely parallels equilibrium temperature chaos. This effect, that we name dynamic temperature chaos, is spatially heterogeneous to a large degree. The key controlling quantity is the time-growing spin-glass coherence length. Our detailed characterization of dynamic temperature chaos paves the way for the analysis of recent and forthcoming experiments. This work has been made possible thanks to the most massive simulation to date of non-equilibrium dynamics, carried out on the Janus~II custom-built supercomputer. △ Less

Submitted 6 July, 2021; v1 submitted 18 November, 2020; originally announced November 2020.

Comments: Version accepted for publication in Communication Physics 10 pages, 9 figures

Journal ref: Communications Physics 4, 74 (2021)

Scaling law describes the spin-glass response in theory, experiments and simulations

Authors: Q. Zhai, I. Paga, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, I. Gonzalez-Adalid Pemartin, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, R. L. Orbach, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, D. L. Schlagel, B. Seoane, A. Tarancon , et al. (2 additional authors not shown)

Abstract: The correlation length $ξ$, a key quantity in glassy dynamics, can now be precisely measured for spin glasses both in experiments and in simulations. However, known analysis methods lead to discrepancies either for large external fields or close to the glass temperature. We solve this problem by introducing a scaling law that takes into account both the magnetic field and the time-dependent spin-g… ▽ More The correlation length $ξ$, a key quantity in glassy dynamics, can now be precisely measured for spin glasses both in experiments and in simulations. However, known analysis methods lead to discrepancies either for large external fields or close to the glass temperature. We solve this problem by introducing a scaling law that takes into account both the magnetic field and the time-dependent spin-glass correlation length. The scaling law is successfully tested against experimental measurements in a CuMn single crystal and against large-scale simulations on the Janus II dedicated computer. △ Less

Submitted 30 November, 2020; v1 submitted 7 July, 2020; originally announced July 2020.

Comments: Revised version, including supplemental material

Journal ref: Phys. Rev. Lett. 125, 237202 (2020)

A scaling approach to estimate the COVID-19 infection fatality ratio from incomplete data

Authors: Beatriz Seoane

Abstract: SARS-CoV-2 has disrupted the life of billions of people around the world since the first outbreak was officially declared in China at the beginning of 2020. Yet, important questions such as how deadly it is or its degree of spread within different countries remain unanswered. In this work, we exploit the `universal' growth of the mortality rate with age observed in different countries since the be… ▽ More SARS-CoV-2 has disrupted the life of billions of people around the world since the first outbreak was officially declared in China at the beginning of 2020. Yet, important questions such as how deadly it is or its degree of spread within different countries remain unanswered. In this work, we exploit the `universal' growth of the mortality rate with age observed in different countries since the beginning of their respective outbreaks, combined with the results of the antibody prevalence tests in the population of Spain, to unveil both unknowns. We validate these results with an analogous antibody rate survey in the canton of Geneva, Switzerland. We also argue that the official number of deaths over 70 years old is importantly underestimated in most of the countries, and we use the comparison between the official records with the number of deaths mentioning COVID-19 in the death certificates to quantify by how much. Using this information, we estimate the fatality infection ratio (IFR) for the different age segments and the fraction of the population infected in different countries assuming a uniform exposure to the virus in all age segments. We also give estimations for the non-uniform IFR using the sero-epidemiological results of Spain, showing a very similar growth of the fatality ratio with age. Only for Spain, we estimate the probability (if infected) of being identified as a case, being hospitalized or admitted in the intensive care units as function of age. In general, we observe a nearly exponential growth of the fatality ratio with age, which anticipates large differences in total IFR in countries with different demographic distributions, with numbers that range from 1.82\% in Italy, to 0.62\% in China or even 0.14\% in middle Africa. △ Less

Submitted 27 January, 2021; v1 submitted 4 June, 2020; originally announced June 2020.

Comments: 28 pages, 10 figures, 3 tables. Version judged scientifically suitable for publication in PLOS ONE

Journal ref: PLoS ONE 16(2): e0246831 (2021)

Learning a Local Symmetry with Neural-Networks

Authors: Aurélien Decelle, Victor Martin-Mayor, Beatriz Seoane

Abstract: We explore the capacity of neural networks to detect a symmetry with complex local and non-local patterns : the gauge symmetry Z 2 . This symmetry is present in physical problems from topological transitions to QCD, and controls the computational hardness of instances of spin-glasses. Here, we show how to design a neural network, and a dataset, able to learn this symmetry and to find compressed la… ▽ More We explore the capacity of neural networks to detect a symmetry with complex local and non-local patterns : the gauge symmetry Z 2 . This symmetry is present in physical problems from topological transitions to QCD, and controls the computational hardness of instances of spin-glasses. Here, we show how to design a neural network, and a dataset, able to learn this symmetry and to find compressed latent representations of the gauge orbits. Our method pays special attention to system-wrap** loops, the so-called Polyakov loops, known to be particularly relevant for computational complexity. △ Less

Submitted 7 June, 2019; v1 submitted 16 April, 2019; originally announced April 2019.

Comments: 4 pages, 4 figures + appendices

Journal ref: Phys. Rev. E 100, 050102 (2019)

The Mpemba effect in spin glasses is a persistent memory effect

Authors: Janus collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, D. Iñiguez, A. Lasanta, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: The Mpemba effect occurs when a hot system cools faster than an initially colder one, when both are refrigerated in the same thermal reservoir. Using the custom built supercomputer Janus II, we study the Mpemba effect in spin glasses and show that it is a non-equilibrium process, governed by the coherence length ξof the system. The effect occurs when the bath temperature lies in the glassy phase,… ▽ More The Mpemba effect occurs when a hot system cools faster than an initially colder one, when both are refrigerated in the same thermal reservoir. Using the custom built supercomputer Janus II, we study the Mpemba effect in spin glasses and show that it is a non-equilibrium process, governed by the coherence length ξof the system. The effect occurs when the bath temperature lies in the glassy phase, but it is not necessary for the thermal protocol to cross the critical temperature. In fact, the Mpemba effect follows from a strong relationship between the internal energy and ξthat turns out to be a sure-tell sign of being in the glassy phase. Thus, the Mpemba effect presents itself as an intriguing new avenue for the experimental study of the coherence length in supercooled liquids and other glass formers. △ Less

Submitted 5 July, 2019; v1 submitted 20 April, 2018; originally announced April 2018.

Comments: Version accepted for publication in PNAS. 6 pages, 7 figures

Journal ref: PNAS 116 (2019), 15350-15355

Spin-glass--like aging in colloidal and granular glasses

Authors: Beatriz Seoane, Francesco Zamponi

Abstract: Motivated by the mean field prediction of a Gardner phase transition between a "normal glass" and a "marginally stable glass", we investigate the off-equilibrium dynamics of three-dimensional polydisperse hard spheres, used as a model for colloidal or granular glasses. Deep inside the glass phase, we find that a sharp crossover pressure $P_{\rm G}$ separates two distinct dynamical regimes. For pre… ▽ More Motivated by the mean field prediction of a Gardner phase transition between a "normal glass" and a "marginally stable glass", we investigate the off-equilibrium dynamics of three-dimensional polydisperse hard spheres, used as a model for colloidal or granular glasses. Deep inside the glass phase, we find that a sharp crossover pressure $P_{\rm G}$ separates two distinct dynamical regimes. For pressure $P < P_{\rm G}$, the glass behaves as a normal solid, displaying fast dynamics that quickly equilibrates within the glass free energy basin. For $P>P_{\rm G}$, instead, the dynamics becomes strongly anomalous, displaying very large equilibration time scales, aging, and a constantly increasing dynamical susceptibility. The crossover at $P_{\rm G}$ is strongly reminiscent of the one observed in three-dimensional spin-glasses in an external field, suggesting that the two systems could be in the same universality class, consistently with theoretical expectations. △ Less

Submitted 25 May, 2018; v1 submitted 13 March, 2018; originally announced March 2018.

Comments: 13 pages, 12 figures (two figures added and one extra Appendix section)

Journal ref: Soft Matter, 2018, 14, 5222 - 5234

Aging rate of spin glasses from simulations matches experiments

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Moreno-Gordo, A. Muñoz-Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: Experiments on spin glasses can now make precise measurements of the exponent $z(T)$ governing the growth of glassy domains, while our computational capabilities allow us to make quantitative predictions for experimental scales. However, experimental and numerical values for $z(T)$ have differed. We use new simulations on the Janus II computer to resolve this discrepancy, finding a time-dependent… ▽ More Experiments on spin glasses can now make precise measurements of the exponent $z(T)$ governing the growth of glassy domains, while our computational capabilities allow us to make quantitative predictions for experimental scales. However, experimental and numerical values for $z(T)$ have differed. We use new simulations on the Janus II computer to resolve this discrepancy, finding a time-dependent $z(T, t_w)$, which leads to the experimental value through mild extrapolations. Furthermore, theoretical insight is gained by studying a crossover between the $T = T_c$ and $T = 0$ fixed points. △ Less

Submitted 18 June, 2018; v1 submitted 6 March, 2018; originally announced March 2018.

Comments: Version accepted for publication in PRL. 12 pages, 9 figures

Journal ref: Phys. Rev. Lett. 120, 267203 (2018)

Low-temperature anomalies of a vapor deposited glass

Authors: Beatriz Seoane, Daniel R. Reid, Juan J. de Pablo, Francesco Zamponi

Abstract: We investigate the low temperature properties of two-dimensional Lennard-Jones glass films, prepared in silico both by liquid cooling and by physical vapor deposition. We identify deep in the solid phase a crossover temperature $T^*$, at which slow dynamics and enhanced heterogeneity emerge. Around $T^*$, localized defects become visible, leading to vibrational anomalies as compared to standard so… ▽ More We investigate the low temperature properties of two-dimensional Lennard-Jones glass films, prepared in silico both by liquid cooling and by physical vapor deposition. We identify deep in the solid phase a crossover temperature $T^*$, at which slow dynamics and enhanced heterogeneity emerge. Around $T^*$, localized defects become visible, leading to vibrational anomalies as compared to standard solids. We find that on average, $T^*$ decreases in samples with lower inherent structure energy, suggesting that such anomalies will be suppressed in ultra-stable glass films, prepared both by very slow liquid cooling and vapor deposition. △ Less

Submitted 12 January, 2018; v1 submitted 14 September, 2017; originally announced September 2017.

Comments: 10 pages including appendices, 8 figures. Version accepted for Physical Review Materials

Journal ref: Phys. Rev. Materials 2, 015602 (2018)

Matching microscopic and macroscopic responses in glasses

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Muñoz-Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We first reproduce on the Janus and Janus II computers a milestone experiment that measures the spin-glass coherence length through the lowering of free-energy barriers induced by the Zeeman effect. Secondly we determine the scaling behavior that allows a quantitative analysis of a new experiment reported in the companion Letter [S. Guchhait and R. Orbach, Phys. Rev. Lett. 118, 157203 (2017)]. The… ▽ More We first reproduce on the Janus and Janus II computers a milestone experiment that measures the spin-glass coherence length through the lowering of free-energy barriers induced by the Zeeman effect. Secondly we determine the scaling behavior that allows a quantitative analysis of a new experiment reported in the companion Letter [S. Guchhait and R. Orbach, Phys. Rev. Lett. 118, 157203 (2017)]. The value of the coherence length estimated through the analysis of microscopic correlation functions turns out to be quantitatively consistent with its measurement through macroscopic response functions. Further, non-linear susceptibilities, recently measured in glass-forming liquids, scale as powers of the same microscopic length. △ Less

Submitted 25 April, 2017; originally announced April 2017.

Comments: 6 pages, 4 figures

Journal ref: Phys. Rev. Lett. 118, 157202 (2017)

An Ising Model for Metal-Organic Frameworks

Authors: Nicolas Höft, Jürgen Horbach, Victor Martin-Mayor, Beatriz Seoane

Abstract: We present a three-dimensional Ising model where lines of equal spins are frozen in such that they form an ordered framework structure. The frame spins impose an external field on the rest of the spins (active spins). We demonstrate that this "porous Ising model" can be seen as a minimal model for condensation transitions of gas molecules in metal-organic frameworks. Using Monte Carlo simulation t… ▽ More We present a three-dimensional Ising model where lines of equal spins are frozen in such that they form an ordered framework structure. The frame spins impose an external field on the rest of the spins (active spins). We demonstrate that this "porous Ising model" can be seen as a minimal model for condensation transitions of gas molecules in metal-organic frameworks. Using Monte Carlo simulation techniques, we compare the phase behavior of a porous Ising model with that of a particle-based model for the condensation of methane (CH$_4$) in the isoreticular metal-organic framework IRMOF-16. For both models, we find a line of first-order phase transitions that end in a critical point. We show that the critical behavior in both cases belongs to the 3D Ising universality class, in contrast to other phase transitions in confinement such as capillary condensation. △ Less

Submitted 11 April, 2017; originally announced April 2017.

Comments: 11 pages, 9 figures

Journal ref: The Journal of Chemical Physics 147 , 084704 (2017)

A statics-dynamics equivalence through the fluctuation-dissipation ratio provides a window into the spin-glass phase from nonequilibrium measurements

Authors: Janus Collaboration, M. Baity-Jesi, E. Calore, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Muñoz-Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: The unifying feature of glass formers (such as polymers, supercooled liquids, colloids, granulars, spin glasses, superconductors, ...) is a sluggish dynamics at low temperatures. Indeed, their dynamics is so slow that thermal equilibrium is never reached in macroscopic samples: in analogy with living beings, glasses are said to age. Here, we show how to relate experimentally relevant quantities wi… ▽ More The unifying feature of glass formers (such as polymers, supercooled liquids, colloids, granulars, spin glasses, superconductors, ...) is a sluggish dynamics at low temperatures. Indeed, their dynamics is so slow that thermal equilibrium is never reached in macroscopic samples: in analogy with living beings, glasses are said to age. Here, we show how to relate experimentally relevant quantities with the experimentally unreachable low-temperature equilibrium phase. We have performed a very accurate computation of the non-equilibrium fluctuation-dissipation ratio for the three-dimensional Edwards-Anderson Ising spin glass, by means of large-scale simulations on the special-purpose computers Janus and Janus II. This ratio (computed for finite times on very large, effectively infinite, systems) is compared with the equilibrium probability distribution of the spin overlap for finite sizes. The resulting quantitative statics-dynamics dictionary, based on observables that can be measured with current experimental methods, could allow the experimental exploration of important features of the spin-glass phase without uncontrollable extrapolations to infinite times or system sizes. △ Less

Submitted 24 April, 2017; v1 submitted 5 October, 2016; originally announced October 2016.

Comments: Version accepted for publication in PNAS. Reuploaded to fix a typo in the list of authors

Journal ref: Proc. Natl. Acad. Sci. USA 114 (2017), 1838-1843

Growing timescales and lengthscales characterizing vibrations of amorphous solids

Authors: Ludovic Berthier, Patrick Charbonneau, Yuliang **, Giorgio Parisi, Beatriz Seoane, Francesco Zamponi

Abstract: Low-temperature properties of crystalline solids can be understood using harmonic perturbations around a perfect lattice, as in Debye's theory. Low-temperature properties of amorphous solids, however, strongly depart from such descriptions, displaying enhanced transport, activated slow dynamics across energy barriers, excess vibrational modes with respect to Debye's theory (i.e., a Boson Peak), an… ▽ More Low-temperature properties of crystalline solids can be understood using harmonic perturbations around a perfect lattice, as in Debye's theory. Low-temperature properties of amorphous solids, however, strongly depart from such descriptions, displaying enhanced transport, activated slow dynamics across energy barriers, excess vibrational modes with respect to Debye's theory (i.e., a Boson Peak), and complex irreversible responses to small mechanical deformations. These experimental observations indirectly suggest that the dynamics of amorphous solids becomes anomalous at low temperatures. Here, we present direct numerical evidence that vibrations change nature at a well-defined location deep inside the glass phase of a simple glass former. We provide a real-space description of this transition and of the rapidly growing time and length scales that accompany it. Our results provide the seed for a universal understanding of low-temperature glass anomalies within the theoretical framework of the recently discovered Gardner phase transition. △ Less

Submitted 13 May, 2016; v1 submitted 13 November, 2015; originally announced November 2015.

Comments: 12 pages, 20 figures. Accepted for publication in PNAS

Journal ref: PNAS 113, 8397-8401 (2016)

Numerical detection of the Gardner transition in a mean-field glass former

Authors: Patrick Charbonneau, Yuliang **, Giorgio Parisi, Corrado Rainone, Beatriz Seoane, Francesco Zamponi

Abstract: Recent theoretical advances predict the existence, deep into the glass phase, of a novel phase transition, the so-called Gardner transition. This transition is associated with the emergence of a complex free energy landscape composed of many marginally stable sub-basins within a glass metabasin. In this study, we explore several methods to detect numerically the Gardner transition in a simple stru… ▽ More Recent theoretical advances predict the existence, deep into the glass phase, of a novel phase transition, the so-called Gardner transition. This transition is associated with the emergence of a complex free energy landscape composed of many marginally stable sub-basins within a glass metabasin. In this study, we explore several methods to detect numerically the Gardner transition in a simple structural glass former, the infinite-range Mari-Kurchan model. The transition point is robustly located from three independent approaches: (i) the divergence of the characteristic relaxation time, (ii) the divergence of the caging susceptibility, and (iii) the abnormal tail in the probability distribution function of cage order parameters. We show that the numerical results are fully consistent with the theoretical expectation. The methods we propose may also be generalized to more realistic numerical models as well as to experimental systems. △ Less

Submitted 3 June, 2015; v1 submitted 28 January, 2015; originally announced January 2015.

Comments: 17 pages, 16 figures

Journal ref: Phys. Rev. E 92, 012316 (2015)

First Principle Computation of Random Pinning Glass Transition, Glass Cooperative Length-Scales and Numerical Comparisons

Authors: Chiara Cammarota, Beatriz Seoane

Abstract: As a guideline for experimental tests of the ideal glass transition (Random Pinning Glass Transition, RPGT) that shall be induced in a system by randomly pinning particles, we performed first-principle computations within the Hypernetted chain approximation and numerical simulations of a Hard Sphere model of glass-former. We obtain confirmation of the expected enhancement of glassy behaviour under… ▽ More As a guideline for experimental tests of the ideal glass transition (Random Pinning Glass Transition, RPGT) that shall be induced in a system by randomly pinning particles, we performed first-principle computations within the Hypernetted chain approximation and numerical simulations of a Hard Sphere model of glass-former. We obtain confirmation of the expected enhancement of glassy behaviour under the procedure of random pinning, which consists in freezing a fraction $c$ of randomly chosen particles in the positions they have in an equilibrium configuration. We present the analytical phase diagram as a function of $c$ and of the packing fraction $φ$, showing a line of RPGT ending in a critical point. We also obtain first microscopic results on cooperative length-scales characterizing medium-range amorphous order in Hard Spere glasses and indirect quantitative information on a key thermodynamic quantity defined in proximity of ideal glass transitions, the amorphous surface tension. Finally, we present numerical results of pair correlation functions able to differentiate the liquid and the glass phases, as predicted by the analytic computations. △ Less

Submitted 12 October, 2015; v1 submitted 27 March, 2014; originally announced March 2014.

Comments: Working draft, comments are welcome

Journal ref: Phys. Rev. B 94, 180201(R) (2016)

The three dimensional Ising spin glass in an external magnetic field: the role of the silent majority

Authors: Janus Collaboration, M. Baity-Jesi, R. A. Banos, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, D. Iniguez, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Munoz Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, M. Pivanti, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We perform equilibrium parallel-tempering simulations of the 3D Ising Edwards-Anderson spin glass in a field. A traditional analysis shows no signs of a phase transition. Yet, we encounter dramatic fluctuations in the behaviour of the model: Averages over all the data only describe the behaviour of a small fraction of it. Therefore we develop a new approach to study the equilibrium behaviour of th… ▽ More We perform equilibrium parallel-tempering simulations of the 3D Ising Edwards-Anderson spin glass in a field. A traditional analysis shows no signs of a phase transition. Yet, we encounter dramatic fluctuations in the behaviour of the model: Averages over all the data only describe the behaviour of a small fraction of it. Therefore we develop a new approach to study the equilibrium behaviour of the system, by classifying the measurements as a function of a conditioning variate. We propose a finite-size scaling analysis based on the probability distribution function of the conditioning variate, which may accelerate the convergence to the thermodynamic limit. In this way, we find a non-trivial spectrum of behaviours, where a part of the measurements behaves as the average, while the majority of them shows signs of scale invariance. As a result, we can estimate the temperature interval where the phase transition in a field ought to lie, if it exists. Although this would-be critical regime is unreachable with present resources, the numerical challenge is finally well posed. △ Less

Submitted 2 April, 2014; v1 submitted 11 March, 2014; originally announced March 2014.

Comments: 42 pages, 19 figures. Minor changes and added figure (results unchanged)

Journal ref: J. Stat. Mech. (2014) P05014

Liquid-glass transition in equilibrium

Authors: G. Parisi, B. Seoane

Abstract: We show in numerical simulations that a system of two coupled replicas of a binary mixture of hard spheres undergoes a phase transition in equilibrium at a density slightly smaller than the glass transition density for an unreplicated system. This result is in agreement with the theories that predict that such a transition is a precursor of the standard ideal glass transition. The critical propert… ▽ More We show in numerical simulations that a system of two coupled replicas of a binary mixture of hard spheres undergoes a phase transition in equilibrium at a density slightly smaller than the glass transition density for an unreplicated system. This result is in agreement with the theories that predict that such a transition is a precursor of the standard ideal glass transition. The critical properties are compatible with those of an Ising system. The relations of this approach to the conventional approach based on configurational entropy are briefly discussed. △ Less

Submitted 24 February, 2014; v1 submitted 6 November, 2013; originally announced November 2013.

Comments: 5 pages, 3 figures, version accepted for publication in the Physical Review E

Journal ref: Phys. Rev. E 89, 022309 (2014)

Critical parameters of the three-dimensional Ising spin glass

Authors: Janus Collaboration, M. Baity-Jesi, R. A. Baños, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Muñoz Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, M. Pivanti, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We report a high-precision finite-size scaling study of the critical behavior of the three-dimensional Ising Edwards-Anderson model (the Ising spin glass). We have thermalized lattices up to L=40 using the Janus dedicated computer. Our analysis takes into account leading-order corrections to scaling. We obtain Tc = 1.1019(29) for the critical temperature, ν= 2.562(42) for the thermal exponent, η=… ▽ More We report a high-precision finite-size scaling study of the critical behavior of the three-dimensional Ising Edwards-Anderson model (the Ising spin glass). We have thermalized lattices up to L=40 using the Janus dedicated computer. Our analysis takes into account leading-order corrections to scaling. We obtain Tc = 1.1019(29) for the critical temperature, ν= 2.562(42) for the thermal exponent, η= -0.3900(36) for the anomalous dimension and ω= 1.12(10) for the exponent of the leading corrections to scaling. Standard (hyper)scaling relations yield α= -5.69(13), β= 0.782(10) and γ= 6.13(11). We also compute several universal quantities at Tc. △ Less

Submitted 10 October, 2013; originally announced October 2013.

Comments: 9 pages, 5 figures

Journal ref: Phys. Rev. B 88, 224416 (2013)

Janus II: a new generation application-driven computer for spin-system simulations

Authors: Janus Collaboration, M. Baity-Jesi, R. A. Baños, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, D. Iñiguez, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Muñoz Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, M. Pivanti, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: This paper describes the architecture, the development and the implementation of Janus II, a new generation application-driven number cruncher optimized for Monte Carlo simulations of spin systems (mainly spin glasses). This domain of computational physics is a recognized grand challenge of high-performance computing: the resources necessary to study in detail theoretical models that can make cont… ▽ More This paper describes the architecture, the development and the implementation of Janus II, a new generation application-driven number cruncher optimized for Monte Carlo simulations of spin systems (mainly spin glasses). This domain of computational physics is a recognized grand challenge of high-performance computing: the resources necessary to study in detail theoretical models that can make contact with experimental data are by far beyond those available using commodity computer systems. On the other hand, several specific features of the associated algorithms suggest that unconventional computer architectures, which can be implemented with available electronics technologies, may lead to order of magnitude increases in performance, reducing to acceptable values on human scales the time needed to carry out simulation campaigns that would take centuries on commercially available machines. Janus II is one such machine, recently developed and commissioned, that builds upon and improves on the successful JANUS machine, which has been used for physics since 2008 and is still in operation today. This paper describes in detail the motivations behind the project, the computational requirements, the architecture and the implementation of this new machine and compares its expected performances with those of currently available commercial systems. △ Less

Submitted 3 October, 2013; originally announced October 2013.

Comments: 28 pages, 6 figures

Journal ref: Computer Physics Communications 185 (2014) 550-559

Spin glasses, the quantum annealing, colloidal glasses and crystals: exploring complex free-energy landscapes

Authors: B. Seoane

Abstract: Glassy behavior is one of the main open problems in condensed matter physics. In this thesis, we approach the problem by studying spin-glasses and colloids, using several complementary strategies. From the point of view of model building, we propose a new model, the hypercube model, which is mean-field but defined in a metric space. We show that, also in Mean Field, the spin-glass non-equilibrium… ▽ More Glassy behavior is one of the main open problems in condensed matter physics. In this thesis, we approach the problem by studying spin-glasses and colloids, using several complementary strategies. From the point of view of model building, we propose a new model, the hypercube model, which is mean-field but defined in a metric space. We show that, also in Mean Field, the spin-glass non-equilibrium dynamics is a domain-growth process very similar to its three-dimensional counterpart. We also consider spin-glasses in three spatial dimensions, focusing on temperature chaos. Thanks to the low-temperature configurations equilibrated with Janus, we show that temperature chaos can be aptly described through a large-deviations functional. The finite-size scaling behavior can be predicted in details from this functional, including the pre-asymptotic regime where chaos is driven by rare events. We also address the problem of finding new, efficient algorithms to study glassy systems. In particular, in the context of the Quantum-Adiabatic algorithm we discuss strategies for bypassing the "first-order bottleneck". Our approach is successfully put to work on the p-spin ferromagnetic model. We also show how to use tethered Monte Carlo (a recent refinement of Umbrella Sampling) to handle problems with more than one order parameter, such as hard-spheres crystallization. We study the crystallization transition equilibrating the largest systems to date, and obtaining very accurate determinations of the coexistence pressure and the interfacial free-energy. We also show our efforts to characterize the solid phase in a system of soft spheres at very high polydispersity. △ Less

Submitted 9 September, 2013; originally announced September 2013.

Comments: PhD Thesis. Defended at the Universidad Complutense de Madrid on January 25, 2013

Dynamical transition in the D = 3 Edwards-Anderson spin glass in an external magnetic field

Authors: Janus Collaboration, M. Baity-Jesi, R. Alvarez Baños, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, Gordillo-Guerrero, D. Iñiguez, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Muñoz Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, M. Pivanti, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We study the off-equilibrium dynamics of the three-dimensional Ising spin glass in the presence of an external magnetic field. We have performed simulations both at fixed temperature and with an annealing protocol. Thanks to the Janus special-purpose computer, based on FPGAs, we have been able to reach times equivalent to 0.01 seconds in experiments. We have studied the system relaxation both for… ▽ More We study the off-equilibrium dynamics of the three-dimensional Ising spin glass in the presence of an external magnetic field. We have performed simulations both at fixed temperature and with an annealing protocol. Thanks to the Janus special-purpose computer, based on FPGAs, we have been able to reach times equivalent to 0.01 seconds in experiments. We have studied the system relaxation both for high and for low temperatures, clearly identifying a dynamical transition point. This dynamical temperature is strictly positive and depends on the external applied magnetic field. We discuss different possibilities for the underlying physics, which include a thermodynamical spin-glass transition, a mode-coupling crossover or an interpretation reminiscent of the random first-order picture of structural glasses. △ Less

Submitted 12 March, 2014; v1 submitted 18 July, 2013; originally announced July 2013.

Comments: Version accepted in PRE. 23 pages, 23 figures

Journal ref: Phys. Rev. E 89, 032140 (2014)

Temperature chaos in 3D Ising Spin Glasses is driven by rare events

Authors: L. A. Fernandez, V. Martin-Mayor, G. Parisi, B. Seoane

Abstract: Temperature chaos has often been reported in literature as a rare-event driven phenomenon. However, this fact has always been ignored in the data analysis, thus erasing the signal of the chaotic behavior (still rare in the sizes achieved) and leading to an overall picture of a weak and gradual phenomenon. On the contrary, our analysis relies on a large-deviations functional that allows to discuss… ▽ More Temperature chaos has often been reported in literature as a rare-event driven phenomenon. However, this fact has always been ignored in the data analysis, thus erasing the signal of the chaotic behavior (still rare in the sizes achieved) and leading to an overall picture of a weak and gradual phenomenon. On the contrary, our analysis relies on a large-deviations functional that allows to discuss the size dependencies. In addition, we had at our disposal unprecedentedly large configurations equilibrated at low temperatures, thanks to the Janus computer. According to our results, when temperature chaos occurs its effects are strong and can be felt even at short distances. △ Less

Submitted 26 November, 2013; v1 submitted 9 July, 2013; originally announced July 2013.

Comments: 5 pages, 5 figures

Journal ref: EPL, 103 (2013) 67003

Many-body transverse interactions in the quantum annealing of the p-spin ferromagnet

Authors: Beatriz Seoane, Hidetoshi Nishimori

Abstract: We study the performance of quantum annealing for the simple $p$-body infinite-range ferromagnetic Ising model. In particular, we generalize the transverse antiferromagnetic interactions proposed by Seki and Nishimori as a quantum driver to many-body transverse interactions to understand if the two-body interactions are essential to allow the system to avoid troublesome first-order quantum phase t… ▽ More We study the performance of quantum annealing for the simple $p$-body infinite-range ferromagnetic Ising model. In particular, we generalize the transverse antiferromagnetic interactions proposed by Seki and Nishimori as a quantum driver to many-body transverse interactions to understand if the two-body interactions are essential to allow the system to avoid troublesome first-order quantum phase transitions. We conclude that the general many-body interactions are effective to let the system evolve only through second-order transitions as long as a few minor conditions are satisfied. It is also discussed whether the overlap of the ground-state wave function of the new driver term with the target ground state is an essential factor for the success. △ Less

Submitted 10 October, 2012; v1 submitted 12 July, 2012; originally announced July 2012.

Comments: 24 pages, 8 figures

Journal ref: J. Phys. A: Math. Theor. 45 435301 (2012)

Reconfigurable computing for Monte Carlo simulations: results and prospects of the Janus project

Authors: Janus Collaboration, M. Baity-Jesi, R. A. Banos, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, M. Guidetti, D. Iniguez, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Munoz Sudupe, D. Navarro, G. Parisi, M. Pivanti, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, P. Tellez , et al. (2 additional authors not shown)

Abstract: We describe Janus, a massively parallel FPGA-based computer optimized for the simulation of spin glasses, theoretical models for the behavior of glassy materials. FPGAs (as compared to GPUs or many-core processors) provide a complementary approach to massively parallel computing. In particular, our model problem is formulated in terms of binary variables, and floating-point operations can be (almo… ▽ More We describe Janus, a massively parallel FPGA-based computer optimized for the simulation of spin glasses, theoretical models for the behavior of glassy materials. FPGAs (as compared to GPUs or many-core processors) provide a complementary approach to massively parallel computing. In particular, our model problem is formulated in terms of binary variables, and floating-point operations can be (almost) completely avoided. The FPGA architecture allows us to run many independent threads with almost no latencies in memory access, thus updating up to 1024 spins per cycle. We describe Janus in detail and we summarize the physics results obtained in four years of operation of this machine; we discuss two types of physics applications: long simulations on very large systems (which try to mimic and provide understanding about the experimental non-equilibrium dynamics), and low-temperature equilibrium simulations using an artificial parallel tempering dynamics. The time scale of our non-equilibrium simulations spans eleven orders of magnitude (from picoseconds to a tenth of a second). On the other hand, our equilibrium simulations are unprecedented both because of the low temperatures reached and for the large systems that we have brought to equilibrium. A finite-time scaling ansatz emerges from the detailed comparison of the two sets of simulations. Janus has made it possible to perform spin-glass simulations that would take several decades on more conventional architectures. The paper ends with an assessment of the potential of possible future versions of the Janus architecture, based on state-of-the-art technology. △ Less

Submitted 18 April, 2012; originally announced April 2012.

Comments: 19 pages, 3 figures

Journal ref: The European Physical Journal - Special Topics 210, 33-51 (2012)

Thermodynamic glass transition in a spin glass without time-reversal symmetry

Authors: Janus Collaboration, R. A. Baños, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, M. Guidetti, D. Iñiguez, A. Maiorano, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Muñoz Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, P. Tellez, R. Tripiccione, D. Yllanes

Abstract: Spin glasses are a longstanding model for the sluggish dynamics that appears at the glass transition. However, spin glasses differ from structural glasses for a crucial feature: they enjoy a time reversal symmetry. This symmetry can be broken by applying an external magnetic field, but embarrassingly little is known about the critical behaviour of a spin glass in a field. In this context, the spac… ▽ More Spin glasses are a longstanding model for the sluggish dynamics that appears at the glass transition. However, spin glasses differ from structural glasses for a crucial feature: they enjoy a time reversal symmetry. This symmetry can be broken by applying an external magnetic field, but embarrassingly little is known about the critical behaviour of a spin glass in a field. In this context, the space dimension is crucial. Simulations are easier to interpret in a large number of dimensions, but one must work below the upper critical dimension (i.e., in d<6) in order for results to have relevance for experiments. Here we show conclusive evidence for the presence of a phase transition in a four-dimensional spin glass in a field. Two ingredients were crucial for this achievement: massive numerical simulations were carried out on the Janus special-purpose computer, and a new and powerful finite-size scaling method. △ Less

Submitted 24 February, 2012; originally announced February 2012.

Comments: 10 pages, 6 figures

Journal ref: Proc. Natl. Acad. Sci. USA (2012) 109, 6452-6456

Sample-to-sample fluctuations of the overlap distributions in the three-dimensional Edwards-Anderson spin glass

Authors: The Janus Collaboration, R. Alvarez Baños, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, M. Guidetti, D. Iñiguez, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Muñoz-Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, F. Ricci-Tersenghi, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We study the sample-to-sample fluctuations of the overlap probability densities from large-scale equilibrium simulations of the three-dimensional Edwards-Anderson spin glass below the critical temperature. Ultrametricity, Stochastic Stability and Overlap Equivalence impose constraints on the moments of the overlap probability densities that can be tested against numerical data. We found small devi… ▽ More We study the sample-to-sample fluctuations of the overlap probability densities from large-scale equilibrium simulations of the three-dimensional Edwards-Anderson spin glass below the critical temperature. Ultrametricity, Stochastic Stability and Overlap Equivalence impose constraints on the moments of the overlap probability densities that can be tested against numerical data. We found small deviations from the Ghirlanda-Guerra predictions, which get smaller as system size increases. We also focus on the shape of the overlap distribution, comparing the numerical data to a mean-field-like prediction in which finite-size effects are taken into account by substituting delta functions with broad peaks △ Less

Submitted 2 November, 2011; v1 submitted 28 July, 2011; originally announced July 2011.

Comments: 11 pages, 8 figures; version accepted for publication on PRB and updated Refs

Journal ref: Phys. Rev. B 84, 174209 (2011)

Tethered Monte Carlo: Managing rugged free-energy landscapes with a Helmholtz-potential formalism

Authors: V. Martin-Mayor, B. Seoane, D. Yllanes

Abstract: Tethering methods allow us to perform Monte Carlo simulations in ensembles with conserved quantities. Specifically, one couples a reservoir to the physical magnitude of interest, and studies the statistical ensemble where the total magnitude (system+reservoir) is conserved. The reservoir is actually integrated out, which leaves us with a fluctuation-dissipation formalism that allows us to recover… ▽ More Tethering methods allow us to perform Monte Carlo simulations in ensembles with conserved quantities. Specifically, one couples a reservoir to the physical magnitude of interest, and studies the statistical ensemble where the total magnitude (system+reservoir) is conserved. The reservoir is actually integrated out, which leaves us with a fluctuation-dissipation formalism that allows us to recover the appropriate Helmholtz effective potential with great accuracy. These methods are demonstrating a remarkable flexibility. In fact, we illustrate two very different applications: hard spheres crystallization and the phase transition of the diluted antiferromagnet in a field (the physical realization of the random field Ising model). The tethered approach holds the promise to transform cartoon drawings of corrugated free-energy landscapes into real computations. Besides, it reduces the algorithmic dynamic slowing-down, probably because the conservation law holds non-locally. △ Less

Submitted 11 July, 2011; originally announced July 2011.

Comments: 44 pages

Journal ref: J. Stat. Phys. 144, 554 (2011)

Equilibrium fluid-solid coexistence of hard spheres

Authors: L. A. Fernandez, V. Martin-Mayor, B. Seoane, P. Verrocchio

Abstract: We present a tethered Monte Carlo simulation of the crystallization of hard spheres. Our method boosts the traditional umbrella sampling to the point of making practical the study of constrained Gibb's free energies depending on several crystalline order-parameters. We obtain high-accuracy estimates of the fluid-crystal coexistence pressure for up to 2916 particles (enough to accommodate fluid-sol… ▽ More We present a tethered Monte Carlo simulation of the crystallization of hard spheres. Our method boosts the traditional umbrella sampling to the point of making practical the study of constrained Gibb's free energies depending on several crystalline order-parameters. We obtain high-accuracy estimates of the fluid-crystal coexistence pressure for up to 2916 particles (enough to accommodate fluid-solid interfaces). We are able to extrapolate to infinite volume the coexistence pressure (p_{co}=11.5727(10) k_B T/σ^3) and the interfacial free energy (γ_{100}=0.636(11) k_B T/σ^2). △ Less

Submitted 12 March, 2012; v1 submitted 14 March, 2011; originally announced March 2011.

Comments: 6 pages, 4 pdf figures. Version to be published in PRL. Appendices contain Supplemental Material

Journal ref: Phys. Rev. Lett. 108, 165701 (2012)

Static versus dynamic heterogeneities in the D = 3 Edwards-Anderson-Ising spin glass

Authors: Janus Collaboration, R. Alvarez Banos, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, M. Guidetti, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Munoz Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We numerically study the aging properties of the dynamical heterogeneities in the Ising spin glass. We find that a phase transition takes place during the aging process. Statics-dynamics correspondence implies that systems of finite size in equilibrium have static heterogeneities that obey Finite-Size Scaling, thus signaling an analogous phase transition in the thermodynamical limit. We compute th… ▽ More We numerically study the aging properties of the dynamical heterogeneities in the Ising spin glass. We find that a phase transition takes place during the aging process. Statics-dynamics correspondence implies that systems of finite size in equilibrium have static heterogeneities that obey Finite-Size Scaling, thus signaling an analogous phase transition in the thermodynamical limit. We compute the critical exponents and the transition point in the equilibrium setting, and use them to show that aging in dynamic heterogeneities can be described by a Finite-Time Scaling Ansatz, with potential implications for experimental work. △ Less

Submitted 24 September, 2010; v1 submitted 15 March, 2010; originally announced March 2010.

Comments: Version accepted for publication in Phys. Rev. Lett. 4 pages, 3 postscript figures

Journal ref: Phys. Rev. Lett. 105, 177202 (2010)

Nature of the spin-glass phase at experimental length scales

Authors: Janus Collaboration, R. Alvarez Banos, A. Cruz, L. A. Fernandez, J. M. Gil-Narvion, A. Gordillo-Guerrero, M. Guidetti, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Munoz Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, J. J. Ruiz-Lorenzo, S. F. Schifano, B. Seoane, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We present a massive equilibrium simulation of the three-dimensional Ising spin glass at low temperatures. The Janus special-purpose computer has allowed us to equilibrate, using parallel tempering, L=32 lattices down to T=0.64 Tc. We demonstrate the relevance of equilibrium finite-size simulations to understand experimental non-equilibrium spin glasses in the thermodynamical limit by establishing… ▽ More We present a massive equilibrium simulation of the three-dimensional Ising spin glass at low temperatures. The Janus special-purpose computer has allowed us to equilibrate, using parallel tempering, L=32 lattices down to T=0.64 Tc. We demonstrate the relevance of equilibrium finite-size simulations to understand experimental non-equilibrium spin glasses in the thermodynamical limit by establishing a time-length dictionary. We conclude that non-equilibrium experiments performed on a time scale of one hour can be matched with equilibrium results on L=110 lattices. A detailed investigation of the probability distribution functions of the spin and link overlap, as well as of their correlation functions, shows that Replica Symmetry Breaking is the appropriate theoretical framework for the physically relevant length scales. Besides, we improve over existing methodologies to ensure equilibration in parallel tempering simulations. △ Less

Submitted 10 June, 2010; v1 submitted 12 March, 2010; originally announced March 2010.

Comments: 48 pages, 19 postscript figures, 9 tables. Version accepted for publication in the Journal of Statistical Mechanics

Journal ref: J. Stat. Mech. (2010) P06026

Critical Behavior of Three-Dimensional Disordered Potts Models with Many States

Authors: R. Alvarez Banos, A. Cruz, L. A. Fernandez, A. Gordillo-Guerrero, J. M. Gil-Narvion, M. Guidetti, A. Maiorano, F. Mantovani, E. Marinari, V. Martin-Mayor, J. Monforte-Garcia, A. Munoz Sudupe, D. Navarro, G. Parisi, S. Perez-Gaviro, J. J. Ruiz-Lorenzo, B. Seoane, S. F. Schifano, A. Tarancon, R. Tripiccione, D. Yllanes

Abstract: We study the 3D Disordered Potts Model with p=5 and p=6. Our numerical simulations (that severely slow down for increasing p) detect a very clear spin glass phase transition. We evaluate the critical exponents and the critical value of the temperature, and we use known results at lower $p$ values to discuss how they evolve for increasing p. We do not find any sign of the presence of a transition… ▽ More We study the 3D Disordered Potts Model with p=5 and p=6. Our numerical simulations (that severely slow down for increasing p) detect a very clear spin glass phase transition. We evaluate the critical exponents and the critical value of the temperature, and we use known results at lower $p$ values to discuss how they evolve for increasing p. We do not find any sign of the presence of a transition to a ferromagnetic regime. △ Less

Submitted 5 May, 2010; v1 submitted 23 February, 2010; originally announced February 2010.

Comments: 9 pages and 9 Postscript figures. Final version published in J. Stat. Mech

Journal ref: J. Stat. Mech. (2010) P05002

Spin Glasses on the Hypercube

Authors: L. A. Fernandez, V. Martin-Mayor, G. Parisi, B. Seoane

Abstract: We present a mean field model for spin glasses with a natural notion of distance built in, namely, the Edwards-Anderson model on the diluted D-dimensional unit hypercube in the limit of large D. We show that finite D effects are strongly dependent on the connectivity, being much smaller for a fixed coordination number. We solve the non trivial problem of generating these lattices. Afterwards, we… ▽ More We present a mean field model for spin glasses with a natural notion of distance built in, namely, the Edwards-Anderson model on the diluted D-dimensional unit hypercube in the limit of large D. We show that finite D effects are strongly dependent on the connectivity, being much smaller for a fixed coordination number. We solve the non trivial problem of generating these lattices. Afterwards, we numerically study the nonequilibrium dynamics of the mean field spin glass. Our three main findings are: (i) the dynamics is ruled by an infinite number of time-sectors, (ii) the aging dynamics consists on the growth of coherent domains with a non vanishing surface-volume ratio, and (iii) the propagator in Fourier space follows the p^4 law. We study as well finite D effects in the nonequilibrium dynamics, finding that a naive finite size scaling ansatz works surprisingly well. △ Less

Submitted 24 November, 2009; originally announced November 2009.

Comments: 14 pages, 22 figures

Journal ref: Phys. Rev. B 81, 134403 (2010)

Separation and fractionation of order and disorder in highly polydisperse systems

Authors: L. A. Fernandez, V. Martin-Mayor, B. Seoane, P. Verrocchio

Abstract: Microcanonical Monte Carlo simulations of a polydisperse soft-spheres model for liquids and colloids have been performed for very large polydispersity, in the region where a phase-separation is known to occur when the system (or part of it) solidifies. By studying samples of different sizes, from N=256 to N=864, we focus on the nature of the two distinct coexisting phases. Measurements of crystall… ▽ More Microcanonical Monte Carlo simulations of a polydisperse soft-spheres model for liquids and colloids have been performed for very large polydispersity, in the region where a phase-separation is known to occur when the system (or part of it) solidifies. By studying samples of different sizes, from N=256 to N=864, we focus on the nature of the two distinct coexisting phases. Measurements of crystalline order in particles of different size reveal that the solid phase segregates between a crystalline solid with cubic symmetry and a disordered phase. This phenomenon is termed fractionation. △ Less

Submitted 9 September, 2010; v1 submitted 26 October, 2009; originally announced October 2009.

Comments: 8 pages, 5 figures

Journal ref: Phys. Rev. E 82, 021501 (2010)