-
Bethe $M$-layer construction for the percolation problem
Authors:
Maria Chiara Angelini,
Saverio Palazzi,
Tommaso Rizzo,
Marco Tarzia
Abstract:
The major difference between percolation and other phase transition models is the absence of an Hamiltonian and of a partition function. For this reason it is not straightforward to identify the corresponding field theory to be used as starting point of Renormalization Group computations. Indeed, it could be identified with the field theory of $n+1$ states Potts model in the limit of $n \to 0$ onl…
▽ More
The major difference between percolation and other phase transition models is the absence of an Hamiltonian and of a partition function. For this reason it is not straightforward to identify the corresponding field theory to be used as starting point of Renormalization Group computations. Indeed, it could be identified with the field theory of $n+1$ states Potts model in the limit of $n \to 0$ only by means of the map** discovered by Kasteleyn and Fortuin for bond percolation. In this paper we show that it is possible to recover the epsilon expansion for critical exponents in finite dimension directly using the $M$-layer expansion, without the need to perform any analytical continuation. Moreover, we also show explicitly that the critical exponents for site and bond percolation are the same. This computation provides a reference for applications of the $M$-layer method to systems where the underlying field theory is unknown or disputed.
△ Less
Submitted 29 June, 2024;
originally announced July 2024.
-
V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestions
Authors:
Luca Podo,
Marco Angelini,
Paola Velardi
Abstract:
NL2VIS (natural language to visualization) is a promising and recent research area that involves interpreting natural language queries and translating them into visualizations that accurately represent the underlying data. As we navigate the era of big data, NL2VIS holds considerable application potential since it greatly facilitates data exploration by non-expert users. Following the increasingly…
▽ More
NL2VIS (natural language to visualization) is a promising and recent research area that involves interpreting natural language queries and translating them into visualizations that accurately represent the underlying data. As we navigate the era of big data, NL2VIS holds considerable application potential since it greatly facilitates data exploration by non-expert users. Following the increasingly widespread usage of generative AI in NL2VIS applications, in this paper we present V-RECS, the first LLM-based Visual Recommender augmented with explanations(E), captioning(C), and suggestions(S) for further data exploration. V-RECS' visualization narratives facilitate both response verification and data exploration by non-expert users. Furthermore, our proposed solution mitigates computational, controllability, and cost issues associated with using powerful LLMs by leveraging a methodology to effectively fine-tune small models. To generate insightful visualization narratives, we use Chain-of-Thoughts (CoT), a prompt engineering technique to help LLM identify and generate the logical steps to produce a correct answer. Since CoT is reported to perform poorly with small LLMs, we adopted a strategy in which a large LLM (GPT-4), acting as a Teacher, generates CoT-based instructions to fine-tune a small model, Llama-2-7B, which plays the role of a Student. Extensive experiments-based on a framework for the quantitative evaluation of AI-based visualizations and on manual assessment by a group of participants-show that V-RECS achieves performance scores comparable to GPT-4, at a much lower cost. The efficacy of the V-RECS teacher-student paradigm is also demonstrated by the fact that the un-tuned Llama fails to perform the task in the vast majority of test cases. We release V-RECS for the visualization community to assist visualization designers throughout the entire visualization generation process.
△ Less
Submitted 21 June, 2024;
originally announced June 2024.
-
Bethe $M$-layer construction on the Ising model
Authors:
Saverio Palazzi,
Maria Chiara Angelini,
Giorgio Parisi,
Tommaso Rizzo
Abstract:
In statistical physics, one of the standard methods to study second order phase transitions is the renormalization group that usually leads to an expansion around the corresponding fully connected solution. Unfortunately, often in disordered models, some important finite dimensional second-order phase transitions are qualitatively different or absent in the corresponding fully connected model: in…
▽ More
In statistical physics, one of the standard methods to study second order phase transitions is the renormalization group that usually leads to an expansion around the corresponding fully connected solution. Unfortunately, often in disordered models, some important finite dimensional second-order phase transitions are qualitatively different or absent in the corresponding fully connected model: in such cases the standard expansion fails. Recently, a new method, the $M$-layer one, has been introduced that performs an expansion around a different soluble mean field model: the Bethe lattice one. This new method has been already used to compute the upper critical dimension $D_U$ of different disordered systems such as the Random Field Ising model or the Spin glass model with field. If then one wants to go beyond and construct an expansion around $D_U$ to understand how critical quantities get renormalized, the actual computation of all the numerical factors is needed. This next step has still not been performed, being technically more involved. In this paper we perform this computation for the ferromagnetic Ising model without quenched disorder, in finite dimensions: we show that, at one-loop order inside the $M$-layer approach, we recover the continuum quartic field theory and we are able to identify the coupling constant $g$ and the other parameters of the theory, as a function of macroscopic and microscopic details of the model such as the lattice spacing, the physical lattice dimension and the temperature. This is a fundamental step that will help in applying in the future the same techniques to more complicated systems, for which the standard field theoretical approach is impracticable.
△ Less
Submitted 22 March, 2024; v1 submitted 2 March, 2024;
originally announced March 2024.
-
Augmenting Security and Privacy in the Virtual Realm: An Analysis of Extended Reality Devices
Authors:
Derin Cayir,
Abbas Acar,
Riccardo Lazzeretti,
Marco Angelini,
Mauro Conti,
Selcuk Uluagac
Abstract:
In this work, we present a device-centric analysis of security and privacy attacks and defenses on Extended Reality (XR) devices, highlighting the need for robust and privacy-aware security mechanisms. Based on our analysis, we present future research directions and propose design considerations to help ensure the security and privacy of XR devices.
In this work, we present a device-centric analysis of security and privacy attacks and defenses on Extended Reality (XR) devices, highlighting the need for robust and privacy-aware security mechanisms. Based on our analysis, we present future research directions and propose design considerations to help ensure the security and privacy of XR devices.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
Vi(E)va LLM! A Conceptual Stack for Evaluating and Interpreting Generative AI-based Visualizations
Authors:
Luca Podo,
Muhammad Ishmal,
Marco Angelini
Abstract:
The automatic generation of visualizations is an old task that, through the years, has shown more and more interest from the research and practitioner communities. Recently, large language models (LLM) have become an interesting option for supporting generative tasks related to visualization, demonstrating initial promising results. At the same time, several pitfalls, like the multiple ways of ins…
▽ More
The automatic generation of visualizations is an old task that, through the years, has shown more and more interest from the research and practitioner communities. Recently, large language models (LLM) have become an interesting option for supporting generative tasks related to visualization, demonstrating initial promising results. At the same time, several pitfalls, like the multiple ways of instructing an LLM to generate the desired result, the different perspectives leading the generation (code-based, image-based, grammar-based), and the presence of hallucinations even for the visualization generation task, make their usage less affordable than expected. Following similar initiatives for benchmarking LLMs, this paper copes with the problem of modeling the evaluation of a generated visualization through an LLM. We propose a theoretical evaluation stack, EvaLLM, that decomposes the evaluation effort in its atomic components, characterizes their nature, and provides an overview of how to implement and interpret them. We also designed and implemented an evaluation platform that provides a benchmarking resource for the visualization generation task. The platform supports automatic and manual scoring conducted by multiple assessors to support a fine-grained and semantic evaluation based on the EvaLLM stack. Two case studies on GPT3.5-turbo with Code Interpreter and Llama2-70-b models show the benefits of EvaLLM and illustrate interesting results on the current state-of-the-art LLM-generated visualizations.
△ Less
Submitted 3 February, 2024;
originally announced February 2024.
-
It Is Time To Steer: A Scalable Framework for Analysis-driven Attack Graph Generation
Authors:
Alessandro Palma,
Marco Angelini
Abstract:
In modern computer networks where sophisticated cyber attacks occur daily, a timely cyber risk assessment becomes paramount. Attack Graph (AG) represents the best-suited solution to model and analyze multi-step attacks on computer networks, although they suffer from poor scalability due to their combinatorial complexity. This paper introduces an analysis-driven framework for AG generation. It enab…
▽ More
In modern computer networks where sophisticated cyber attacks occur daily, a timely cyber risk assessment becomes paramount. Attack Graph (AG) represents the best-suited solution to model and analyze multi-step attacks on computer networks, although they suffer from poor scalability due to their combinatorial complexity. This paper introduces an analysis-driven framework for AG generation. It enables real-time attack path analysis before the completion of the AG generation with a quantifiable statistical significance. We further accelerate the AG generation by steering it with the analysis query and supporting a novel workflow in which the analyst can query the system anytime. To show the capabilities of the proposed framework, we perform an extensive quantitative validation and we present a realistic case study on networks of unprecedented size. It demonstrates the advantages of our approach in terms of scalability and fitting to common attack path analyses.
△ Less
Submitted 27 December, 2023;
originally announced December 2023.
-
Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems
Authors:
Maria Chiara Angelini,
Angelo Giorgio Cavaliere,
Raffaele Marino,
Federico Ricci-Tersenghi
Abstract:
Is Stochastic Gradient Descent (SGD) substantially different from Metropolis Monte Carlo dynamics? This is a fundamental question at the time of understanding the most used training algorithm in the field of Machine Learning, but it received no answer until now. Here we show that in discrete optimization and inference problems, the dynamics of an SGD-like algorithm resemble very closely that of Me…
▽ More
Is Stochastic Gradient Descent (SGD) substantially different from Metropolis Monte Carlo dynamics? This is a fundamental question at the time of understanding the most used training algorithm in the field of Machine Learning, but it received no answer until now. Here we show that in discrete optimization and inference problems, the dynamics of an SGD-like algorithm resemble very closely that of Metropolis Monte Carlo with a properly chosen temperature, which depends on the mini-batch size. This quantitative matching holds both at equilibrium and in the out-of-equilibrium regime, despite the two algorithms having fundamental differences (e.g.\ SGD does not satisfy detailed balance). Such equivalence allows us to use results about performances and limits of Monte Carlo algorithms to optimize the mini-batch size in the SGD-like algorithm and make it efficient at recovering the signal in hard inference problems.
△ Less
Submitted 30 May, 2024; v1 submitted 11 September, 2023;
originally announced September 2023.
-
A Systematization of Cybersecurity Regulations, Standards and Guidelines for the Healthcare Sector
Authors:
Maria Patrizia Carello,
Alberto Marchetti Spaccamela,
Leonardo Querzoni,
Marco Angelini
Abstract:
The growing adoption of IT solutions in the healthcare sector is leading to a steady increase in the number of cybersecurity incidents. As a result, organizations worldwide have introduced regulations, standards, and best practices to address cybersecurity and data protection issues in this sector. However, the application of this large corpus of documents presents operational difficulties, and op…
▽ More
The growing adoption of IT solutions in the healthcare sector is leading to a steady increase in the number of cybersecurity incidents. As a result, organizations worldwide have introduced regulations, standards, and best practices to address cybersecurity and data protection issues in this sector. However, the application of this large corpus of documents presents operational difficulties, and operators continue to lag behind in resilience to cyber attacks. This paper contributes a systematization of the significant cybersecurity documents relevant to the healthcare sector. We collected the 49 most significant documents and used the NIST cybersecurity framework to categorize key information and support the implementation of cybersecurity measures.
△ Less
Submitted 28 April, 2023;
originally announced April 2023.
-
Real-Space Renormalization group for spin glasses
Authors:
Maria Chiara Angelini
Abstract:
While in the fully-connected limit the solution of the spin-glass model is known, with the existence of a complex transition on a critical line in the temperature-external field phase diagram, in finite dimensions we don't know if a transition is present or not and, if present, if its nature is the same as the one in infinite dimensions. This work contains a review of the real-space Renormalizatio…
▽ More
While in the fully-connected limit the solution of the spin-glass model is known, with the existence of a complex transition on a critical line in the temperature-external field phase diagram, in finite dimensions we don't know if a transition is present or not and, if present, if its nature is the same as the one in infinite dimensions. This work contains a review of the real-space Renormalization Group methods that have been applied to Spin Glasses, highlighting both their point of strength and weakness in characterizing the finite dimensional behaviour of the model.
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
The Ising spin glass on random graphs at zero temperature: not all spins are glassy in the glassy phase
Authors:
Gianmarco Perrupato,
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi,
Tommaso Rizzo
Abstract:
We investigate the replica symmetry broken (RSB) phase of spin glass (SG) models in a random field defined on Bethe lattices at zero temperature. From the properties of the RSB solution we deduce a closed equation for the extreme values of the cavity fields. This equation turns out not to depend on the parameters defining the RSB, and it predicts that the spontaneous RSB does not take place homoge…
▽ More
We investigate the replica symmetry broken (RSB) phase of spin glass (SG) models in a random field defined on Bethe lattices at zero temperature. From the properties of the RSB solution we deduce a closed equation for the extreme values of the cavity fields. This equation turns out not to depend on the parameters defining the RSB, and it predicts that the spontaneous RSB does not take place homogeneously on the whole system. Indeed, there exist spins having the same effective local field in all local ground states, exactly as in the replica symmetric (RS) phase, while the spontaneous RSB manifests only on the remaining spins, whose fraction vanishes at criticality. The characterization in terms of spins having fixed or fluctuating local fields can be extended also to the random field Ising model (RFIM), in which case the fluctuating spins are the only responsible for the spontaneous magnetization in the ferromagnetic phase. Close to criticality we are able to connect the statistics of the local fields acting on the spins in the RSB phase with the correlation functions measured in the paramagnetic phase. Identifying the two types of spins on given instances of SG and RFIM, we show that they participate very differently to avalanches produced by flip** a single spin. From the scaling of the number of spins inducing RSB effects close to the critical point and using the $M$-layer expansion we estimate the upper critical dimension $D_U \geq 8$ for SG.
△ Less
Submitted 10 November, 2022; v1 submitted 13 July, 2022;
originally announced July 2022.
-
A Methodology to Support Automatic Cyber Risk Assessment Review
Authors:
Marco Angelini,
Silvia Bonomi,
Alessandro Palma
Abstract:
Cyber risk assessment is a fundamental activity for enhancing the protection of an organization, identifying and evaluating the exposure to cyber threats. Currently, this activity is carried out mainly manually and the identification and correct quantification of risks deeply depend on the experience and confidence of the human assessor. As a consequence, the process is not completely objective an…
▽ More
Cyber risk assessment is a fundamental activity for enhancing the protection of an organization, identifying and evaluating the exposure to cyber threats. Currently, this activity is carried out mainly manually and the identification and correct quantification of risks deeply depend on the experience and confidence of the human assessor. As a consequence, the process is not completely objective and two parallel assessments of the same situation may lead to different results. This paper takes a step in the direction of reducing the degree of subjectivity by proposing a methodology to support risk assessors with an automatic review of the produced assessment. Our methodology starts from a controls-based assessment performed using well-known cybersecurity frameworks (e.g., ISO 27001, NIST) and maps security controls over infrastructural aspects that can be assessed automatically (e.g., ICT devices, organization policies). Exploiting this map**, the methodology suggests how to identify controls needing revision. The approach has been validated through a case study from the healthcare domain and a set of statistical analyses.
△ Less
Submitted 7 July, 2022;
originally announced July 2022.
-
Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent set
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi
Abstract:
The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on sparse graphs. To test the performances of these GNNs, the authors of the work show numerical results for two fundamental problems: maximum cut and maximum inde…
▽ More
The recent work ``Combinatorial Optimization with Physics-Inspired Graph Neural Networks'' [Nat Mach Intell 4 (2022) 367] introduces a physics-inspired unsupervised Graph Neural Network (GNN) to solve combinatorial optimization problems on sparse graphs. To test the performances of these GNNs, the authors of the work show numerical results for two fundamental problems: maximum cut and maximum independent set (MIS). They conclude that "the graph neural network optimizer performs on par or outperforms existing solvers, with the ability to scale beyond the state of the art to problems with millions of variables."
In this comment, we show that a simple greedy algorithm, running in almost linear time, can find solutions for the MIS problem of much better quality than the GNN. The greedy algorithm is faster by a factor of $10^4$ with respect to the GNN for problems with a million variables. We do not see any good reason for solving the MIS with these GNN, as well as for using a sledgehammer to crack nuts.
In general, many claims of superiority of neural networks in solving combinatorial problems are at risk of being not solid enough, since we lack standard benchmarks based on really hard problems. We propose one of such hard benchmarks, and we hope to see future neural network optimizers tested on these problems before any claim of superiority is made.
△ Less
Submitted 2 January, 2023; v1 submitted 27 June, 2022;
originally announced June 2022.
-
Limits and performances of algorithms based on simulated annealing in solving sparse hard inference problems
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi
Abstract:
The planted coloring problem is a prototypical inference problem for which thresholds for Bayes optimal algorithms, like Belief Propagation (BP), can be computed analytically. In this paper, we analyze the limits and performances of the Simulated Annealing (SA), a Monte Carlo-based algorithm that is more general and robust than BP, and thus of broader applicability. We show that SA is sub-optimal…
▽ More
The planted coloring problem is a prototypical inference problem for which thresholds for Bayes optimal algorithms, like Belief Propagation (BP), can be computed analytically. In this paper, we analyze the limits and performances of the Simulated Annealing (SA), a Monte Carlo-based algorithm that is more general and robust than BP, and thus of broader applicability. We show that SA is sub-optimal in the recovery of the planted solution because it gets attracted by glassy states that, instead, do not influence the BP algorithm. At variance with previous conjectures, we propose an analytic estimation for the SA algorithmic threshold by comparing the spinodal point of the paramagnetic phase and the dynamical critical temperature. This is a fundamental connection between thermodynamical phase transitions and out of equilibrium behavior of Glauber dynamics. We also study an improved version of SA, called replicated SA (RSA), where several weakly coupled replicas are cooled down together. We show numerical evidence that the algorithmic threshold for the RSA coincides with the Bayes optimal one. Finally, we develop an approximated analytical theory explaining the optimal performances of RSA and predicting the location of the transition towards the planted solution in the limit of a very large number of replicas. Our results for RSA support the idea that mismatching the parameters in the prior with respect to those of the generative model may produce an algorithm that is optimal and very robust.
△ Less
Submitted 28 June, 2023; v1 submitted 9 June, 2022;
originally announced June 2022.
-
Mismatching as a tool to enhance algorithmic performances of Monte Carlo methods for the planted clique model
Authors:
Maria Chiara Angelini,
Paolo Fachin,
Simone de Feo
Abstract:
Over-parametrization was a crucial ingredient for recent developments in inference and machine-learning fields. However a good theory explaining this success is still lacking. In this paper we study a very simple case of mismatched over-parametrized algorithm applied to one of the most studied inference problem: the planted clique problem. We analyze a Monte Carlo (MC) algorithm in the same class…
▽ More
Over-parametrization was a crucial ingredient for recent developments in inference and machine-learning fields. However a good theory explaining this success is still lacking. In this paper we study a very simple case of mismatched over-parametrized algorithm applied to one of the most studied inference problem: the planted clique problem. We analyze a Monte Carlo (MC) algorithm in the same class of the famous Jerrum algorithm. We show how this MC algorithm is in general suboptimal for the recovery of the planted clique. We show however how to enhance its performances by adding a (mismatched) parameter: the temperature; we numerically find that this over-parametrized version of the algorithm can reach the supposed algorithmic threshold for the planted clique problem.
△ Less
Submitted 19 November, 2021; v1 submitted 10 June, 2021;
originally announced June 2021.
-
Unexpected upper critical dimension for spin glass models in a field predicted by the loop expansion around the Bethe solution at zero temperature
Authors:
Maria Chiara Angelini,
Carlo Lucibello,
Giorgio Parisi,
Gianmarco Perrupato,
Federico Ricci-Tersenghi,
Tommaso Rizzo
Abstract:
The spin-glass transition in a field in finite dimension is analyzed directly at zero temperature using a perturbative loop expansion around the Bethe lattice solution. The loop expansion is generated by the $M$-layer construction whose first diagrams are evaluated numerically and analytically. The generalized Ginzburg criterion reveals that the upper critical dimension below which mean-field theo…
▽ More
The spin-glass transition in a field in finite dimension is analyzed directly at zero temperature using a perturbative loop expansion around the Bethe lattice solution. The loop expansion is generated by the $M$-layer construction whose first diagrams are evaluated numerically and analytically. The generalized Ginzburg criterion reveals that the upper critical dimension below which mean-field theory fails is $D_U \le 8$, at variance with the classical result $D_U = 6$ yielded by finite-temperature replica field theory. Our expansion around the Bethe lattice has two crucial differences with respect to the classical one. The finite connectivity $z$ of the lattice is directly included from the beginning in the Bethe lattice, while in the classical computation the finite connectivity is obtained through an expansion in $1/z$. Moreover, if one is interested in the zero temperature ($T = 0$) transition, one can directly expand around the $T = 0$ Bethe transition. The expansion directly at $T = 0$ is not possible in the classical framework because the fully connected spin glass does not have a transition at $T = 0$, being in the broken phase for any value of the external field.
△ Less
Submitted 16 March, 2022; v1 submitted 31 March, 2021;
originally announced March 2021.
-
Solving the fully-connected spherical $p$-spin model with the cavity method: equivalence with the replica results
Authors:
Giacomo Gradenigo,
Maria Chiara Angelini,
Luca Leuzzi,
Federico Ricci-Tersenghi
Abstract:
The spherical $p$-spin is a fundamental model for glassy physics, thanks to its analytic solution achievable via the replica method. Unfortunately the replica method has some drawbacks: it is very hard to apply to diluted models and the assumptions beyond it are not immediately clear. Both drawbacks can be overcome by the use of the cavity method, which, however, needs to be applied with care to s…
▽ More
The spherical $p$-spin is a fundamental model for glassy physics, thanks to its analytic solution achievable via the replica method. Unfortunately the replica method has some drawbacks: it is very hard to apply to diluted models and the assumptions beyond it are not immediately clear. Both drawbacks can be overcome by the use of the cavity method, which, however, needs to be applied with care to spherical models. Here we show how to write the cavity equations for spherical $p$-spin models on complete graphs, both in the Replica Symmetric (RS) ansatz (corresponding to Belief Propagation) and in the 1-step Replica Symmetry Breaking (1RSB) ansatz (corresponding to Survey Propagation). The cavity equations can be solved by a Gaussian (RS) and multivariate Gaussian (1RSB) ansatz for the distribution of the cavity fields. We compute the free energy in both ansatzes and check that the results are identical to the replica computation, predicting a phase transition to a 1RSB phase at low temperatures. The advantages of solving the model with the cavity method are many. The physical meaning of any ansatz for the cavity marginals is very clear. The cavity method works directly with the distribution of local quantities, which allows to generalize the method to dilute graphs. What we are presenting here is the first step towards the solution of the diluted version of the spherical $p$-spin model, which is a fundamental model in the theory of random lasers and interesting $per~se$ as an easier-to-simulate version of the classical fully-connected $p$-spin model.
△ Less
Submitted 5 February, 2021; v1 submitted 3 July, 2020;
originally announced July 2020.
-
Comment on "Real-space renormalization-group methods for hierarchical spin glasses"
Authors:
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi
Abstract:
In the paper [Angelini M C, Parisi G, and Ricci-Tersenghi F, Ensemble renormalization group for disordered systems, Phys. Rev. B 87 134201 (2013)] we introduced a real-space renormalization group called Ensemble Renormalization Group (ERG) and we applied it to the Edwards-Anderson model, obtaining estimates for the critical exponents in good agreement with those from Monte Carlo simulations. Recen…
▽ More
In the paper [Angelini M C, Parisi G, and Ricci-Tersenghi F, Ensemble renormalization group for disordered systems, Phys. Rev. B 87 134201 (2013)] we introduced a real-space renormalization group called Ensemble Renormalization Group (ERG) and we applied it to the Edwards-Anderson model, obtaining estimates for the critical exponents in good agreement with those from Monte Carlo simulations. Recently the paper [Castellana M, Real-space renormalization-group methods for hierarchical spin glasses, J. Phys. A: Math. Theor. 52 445002 (2019)] re-examined the ERG method from a different perspective, concluding that the previous results were wrong, and claiming that the ERG method predicts trivially wrong critical exponents. In this comment we explain why the conclusions reached by Castellana are wrong, as they are based on a misinterpretation of finite-size effects. We conclude that the ERG method remains a good RG method to obtain critical exponents in strongly disordered models (if properly used).
△ Less
Submitted 6 November, 2019;
originally announced November 2019.
-
New loop expansion for the Random Magnetic Field Ising Ferromagnets at zero temperature
Authors:
Maria Chiara Angelini,
Carlo Lucibello,
Giorgio Parisi,
Federico Ricci-Tersenghi,
Tommaso Rizzo
Abstract:
We apply to the Random Field Ising Model at zero temperature (T= 0) the perturbative loop expansion around the Bethe solution. A comparison with the standard epsilon-expansion is made, highlighting the key differences that make the new expansion much more appropriate to correctly describe strongly disordered systems, especially those controlled by a T = 0 RG fixed point. This new loop expansion pr…
▽ More
We apply to the Random Field Ising Model at zero temperature (T= 0) the perturbative loop expansion around the Bethe solution. A comparison with the standard epsilon-expansion is made, highlighting the key differences that make the new expansion much more appropriate to correctly describe strongly disordered systems, especially those controlled by a T = 0 RG fixed point. This new loop expansion produces an effective theory with cubic vertices. We compute the one-loop corrections due to cubic vertices, finding new terms that are absent in the epsilon-expansion. However, these new terms are subdominant with respect to the standard, supersymmetric ones, therefore dimensional reduction is still valid at this order of the loop expansion.
△ Less
Submitted 11 June, 2019;
originally announced June 2019.
-
Monte Carlo algorithms are very effective in finding the largest independent set in sparse random graphs
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi
Abstract:
The effectiveness of stochastic algorithms based on Monte Carlo dynamics in solving hard optimization problems is mostly unknown. Beyond the basic statement that at a dynamical phase transition the ergodicity breaks and a Monte Carlo dynamics cannot sample correctly the probability distribution in times linear in the system size, there are almost no predictions nor intuitions on the behavior of th…
▽ More
The effectiveness of stochastic algorithms based on Monte Carlo dynamics in solving hard optimization problems is mostly unknown. Beyond the basic statement that at a dynamical phase transition the ergodicity breaks and a Monte Carlo dynamics cannot sample correctly the probability distribution in times linear in the system size, there are almost no predictions nor intuitions on the behavior of this class of stochastic dynamics. The situation is particularly intricate because, when using a Monte Carlo based algorithm as an optimization algorithm, one is usually interested in the out of equilibrium behavior which is very hard to analyse. Here we focus on the use of Parallel Tempering in the search for the largest independent set in a sparse random graph, showing that it can find solutions well beyond the dynamical threshold. Comparison with state-of-the-art message passing algorithms reveals that parallel tempering is definitely the algorithm performing best, although a theory explaining its behavior is still lacking.
△ Less
Submitted 3 April, 2019;
originally announced April 2019.
-
Parallel Tempering for the planted clique problem
Authors:
Maria Chiara Angelini
Abstract:
The theoretical information threshold for the planted clique problem is $2\log_2(N)$, however no polynomial algorithm is known to recover a planted clique of size $O(N^{1/2-ε})$, $ε>0$. In this paper we will apply a standard method for the analysis of disordered models, the Parallel-Tempering (PT) algorithm, to the clique problem, showing numerically that its time-scaling in the hard region is ind…
▽ More
The theoretical information threshold for the planted clique problem is $2\log_2(N)$, however no polynomial algorithm is known to recover a planted clique of size $O(N^{1/2-ε})$, $ε>0$. In this paper we will apply a standard method for the analysis of disordered models, the Parallel-Tempering (PT) algorithm, to the clique problem, showing numerically that its time-scaling in the hard region is indeed polynomial for the analyzed sizes. We also apply PT to a different but connected model, the Sparse Planted Independent Set problem. In this situation thresholds should be sharper and finite size corrections should be less important. Also in this case PT shows a polynomial scaling in the hard region for the recovery.
△ Less
Submitted 8 January, 2019; v1 submitted 16 February, 2018;
originally announced February 2018.
-
One-loop topological expansion for spin glasses in the large connectivity limit
Authors:
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi
Abstract:
We apply for the first time a new one-loop topological expansion around the Bethe solution to the spin-glass model with field in the high connectivity limit, following the methodological scheme proposed in a recent work. The results are completely equivalent to the well known ones, found by standard field theoretical expansion around the fully connected model (Bray and Roberts 1980, and following…
▽ More
We apply for the first time a new one-loop topological expansion around the Bethe solution to the spin-glass model with field in the high connectivity limit, following the methodological scheme proposed in a recent work. The results are completely equivalent to the well known ones, found by standard field theoretical expansion around the fully connected model (Bray and Roberts 1980, and following works). However this method has the advantage that the starting point is the original Hamiltonian of the model, with no need to define an associated field theory, nor to know the initial values of the couplings, and the computations have a clear and simple physical meaning. Moreover this new method can also be applied in the case of zero temperature, when the Bethe model has a transition in field, contrary to the fully connected model that is always in the spin glass phase. Sharing with finite dimensional model the finite connectivity properties, the Bethe lattice is clearly a better starting point for an expansion with respect to the fully connected model. The present work is a first step towards the generalization of this new expansion to more difficult and interesting cases as the zero-temperature limit, where the expansion could lead to different results with respect to the standard one.
△ Less
Submitted 31 January, 2018; v1 submitted 31 August, 2017;
originally announced August 2017.
-
Loop expansion around the Bethe approximation through the $M$-layer construction
Authors:
Ada Altieri,
Maria Chiara Angelini,
Carlo Lucibello,
Giorgio Parisi,
Federico Ricci-Tersenghi,
Tommaso Rizzo
Abstract:
For every physical model defined on a generic graph or factor graph, the Bethe $M$-layer construction allows building a different model for which the Bethe approximation is exact in the large $M$ limit and it coincides with the original model for $M=1$. The $1/M$ perturbative series is then expressed by a diagrammatic loop expansion in terms of so-called fat-diagrams. Our motivation is to study so…
▽ More
For every physical model defined on a generic graph or factor graph, the Bethe $M$-layer construction allows building a different model for which the Bethe approximation is exact in the large $M$ limit and it coincides with the original model for $M=1$. The $1/M$ perturbative series is then expressed by a diagrammatic loop expansion in terms of so-called fat-diagrams. Our motivation is to study some important second-order phase transitions that do exist on the Bethe lattice but are either qualitatively different or absent in the corresponding fully connected case. In this case the standard approach based on a perturbative expansion around the naive mean field theory (essentially a fully connected model) fails. On physical grounds, we expect that when the construction is applied to a lattice in finite dimension there is a small region of the external parameters close to the Bethe critical point where strong deviations from mean-field behavior will be observed. In this region, the $1/M$ expansion for the corrections diverges and it can be the starting point for determining the correct non-mean-field critical exponents using renormalization group arguments. In the end, we will show that the critical series for the generic observable can be expressed as a sum of Feynman diagrams with the same numerical prefactors of field theories. However, the contribution of a given diagram is not evaluated associating Gaussian propagators to its lines as in field theories: one has to consider the graph as a portion of the original lattice, replacing the internal lines with appropriate one-dimensional chains, and attaching to the internal points the appropriate number of infinite-size Bethe trees to restore the correct local connectivity of the original model.
△ Less
Submitted 19 October, 2023; v1 submitted 26 July, 2017;
originally announced July 2017.
-
Real Space Migdal-Kadanoff Renormalisation of Glassy Systems: Recent Results and a Critical Assessment
Authors:
Maria Chiara Angelini,
Giulio Biroli
Abstract:
In this manuscript, in honour of L. Kadanoff, we present recent progress obtained in the description of finite dimensional glassy systems thanks to the Migdal-Kadanoff renormalisation group (MK-RG). We provide a critical assessment of the method, in particular discuss its limitation in describing situations in which an infinite number of pure states might be present, and analyse the MK-RG flow in…
▽ More
In this manuscript, in honour of L. Kadanoff, we present recent progress obtained in the description of finite dimensional glassy systems thanks to the Migdal-Kadanoff renormalisation group (MK-RG). We provide a critical assessment of the method, in particular discuss its limitation in describing situations in which an infinite number of pure states might be present, and analyse the MK-RG flow in the limit of infinite dimensions. MK-RG predicts that the spin-glass transition in a field and the glass transition are governed by zero-temperature fixed points of the renormalization group flow. This implies a typical energy scale that grows, approaching the transition, as a power of the correlation length, thus leading to enormously large time-scales as expected from experiments and simulations. These fixed points exist only in dimensions larger than $d_L>3$ but they nevertheless influence the RG flow below it, in particular in three dimensions. MK-RG thus predicts a similar behavior for spin-glasses in a field and models of glasses and relates it to the presence of avoided critical points.
△ Less
Submitted 10 February, 2017;
originally announced February 2017.
-
Real Space Renormalization Group Theory of Disordered Models of Glasses
Authors:
Maria Chiara Angelini,
Giulio Biroli
Abstract:
We develop a real space renormalisation group analysis of disordered models of glasses, in particular of the spin models at the origin of the Random First Order Transition theory. We find three fixed points respectively associated to the liquid state, to the critical behavior and to the glass state. The latter two are zero-temperature ones; this provides a natural explanation of the growth of effe…
▽ More
We develop a real space renormalisation group analysis of disordered models of glasses, in particular of the spin models at the origin of the Random First Order Transition theory. We find three fixed points respectively associated to the liquid state, to the critical behavior and to the glass state. The latter two are zero-temperature ones; this provides a natural explanation of the growth of effective activation energy scale and the concomitant huge increase of relaxation time approaching the glass transition. The lower critical dimension depends on the nature of the interacting degrees of freedom and is higher than three for all models. This does not prevent three dimensional systems from being glassy. Indeed, we find that their renormalisation group flow is affected by the fixed points existing in higher dimension and in consequence is non-trivial. Within our theoretical framework the glass transition results to be an avoided phase transition.
△ Less
Submitted 13 April, 2016;
originally announced April 2016.
-
Spectral Detection on Sparse Hypergraphs
Authors:
Maria Chiara Angelini,
Francesco Caltagirone,
Florent Krzakala,
Lenka Zdeborová
Abstract:
We consider the problem of the assignment of nodes into communities from a set of hyperedges, where every hyperedge is a noisy observation of the community assignment of the adjacent nodes. We focus in particular on the sparse regime where the number of edges is of the same order as the number of vertices. We propose a spectral method based on a generalization of the non-backtracking Hashimoto mat…
▽ More
We consider the problem of the assignment of nodes into communities from a set of hyperedges, where every hyperedge is a noisy observation of the community assignment of the adjacent nodes. We focus in particular on the sparse regime where the number of edges is of the same order as the number of vertices. We propose a spectral method based on a generalization of the non-backtracking Hashimoto matrix into hypergraphs. We analyze its performance on a planted generative model and compare it with other spectral methods and with Bayesian belief propagation (which was conjectured to be asymptotically optimal for this model). We conclude that the proposed spectral method detects communities whenever belief propagation does, while having the important advantages to be simpler, entirely nonparametric, and to be able to learn the rule according to which the hyperedges were generated without prior information.
△ Less
Submitted 15 July, 2015;
originally announced July 2015.
-
Spin Glass in a Field: a New Zero-Temperature Fixed Point in Finite Dimensions
Authors:
Maria Chiara Angelini,
Giulio Biroli
Abstract:
By using real space renormalisation group (RG) methods we show that spin-glasses in a field display a new kind of transition in high dimensions. The corresponding critical properties and the spin-glass phase are governed by two non-perturbative zero temperature fixed points of the RG flow. We compute the critical exponents, discuss the RG flow and its relevance for three dimensional systems. The n…
▽ More
By using real space renormalisation group (RG) methods we show that spin-glasses in a field display a new kind of transition in high dimensions. The corresponding critical properties and the spin-glass phase are governed by two non-perturbative zero temperature fixed points of the RG flow. We compute the critical exponents, discuss the RG flow and its relevance for three dimensional systems. The new spin-glass phase we discovered has unusual properties, which are intermediate between the ones conjectured by droplet and full replica symmetry breaking theories. These results provide a new perspective on the long-standing debate about the behaviour of spin-glasses in a field.
△ Less
Submitted 16 July, 2015; v1 submitted 3 September, 2014;
originally announced September 2014.
-
The Super-Potts glass: a new disordered model for glass-forming liquids
Authors:
Maria Chiara Angelini,
Giulio Biroli
Abstract:
We introduce a new disordered system, the Super-Potts model, which is a more frustrated version of the Potts glass. Its elementary degrees of freedom are variables that can take M values and are coupled via pair-wise interactions. Its exact solution on a completely connected lattice demonstrates that for large enough M it belongs to the class of mean-field systems solved by a one step replica symm…
▽ More
We introduce a new disordered system, the Super-Potts model, which is a more frustrated version of the Potts glass. Its elementary degrees of freedom are variables that can take M values and are coupled via pair-wise interactions. Its exact solution on a completely connected lattice demonstrates that for large enough M it belongs to the class of mean-field systems solved by a one step replica symmetry breaking Ansatz. Numerical simulations by the parallel tempering technique show that in three dimensions it displays a phenomenological behaviour similar to the one of glass-forming liquids. The Super-Potts glass is therefore the first long-sought disordered model allowing one to perform extensive and detailed studies of the Random First Order Transition in finite dimensions. We also discuss its behaviour for small values of M, which is similar to the one of spin-glasses in a field.
△ Less
Submitted 14 January, 2015; v1 submitted 28 July, 2014;
originally announced July 2014.
-
Relations between Short Range and Long Range Ising models
Authors:
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi
Abstract:
We perform a numerical study of the long range (LR) ferromagnetic Ising model with power law decaying interactions ($J \propto r^{-d-σ}$) both on a one-dimensional chain ($d=1$) and on a square lattice ($d=2$). We use advanced cluster algorithms to avoid the critical slowing down. We first check the validity of the relation connecting the critical behavior of the LR model with parameters $(d,σ)$ t…
▽ More
We perform a numerical study of the long range (LR) ferromagnetic Ising model with power law decaying interactions ($J \propto r^{-d-σ}$) both on a one-dimensional chain ($d=1$) and on a square lattice ($d=2$). We use advanced cluster algorithms to avoid the critical slowing down. We first check the validity of the relation connecting the critical behavior of the LR model with parameters $(d,σ)$ to that of a short range (SR) model in an equivalent dimension $D$. We then study the critical behavior of the $d=2$ LR model close to the lower critical $σ$, uncovering that the spatial correlation function decays with two different power laws: the effect of the subdominant power law is much stronger than finite size effects and actually makes the estimate of critical exponents very subtle. By including this subdominant power law, the numerical data are consistent with the standard renormalization group (RG) prediction by Sak, thus making not necessary (and unlikely, according to Occam's razor) the recent proposal by Picco of having a new set of RG fixed points, in addition to the mean-field one and the SR one.
△ Less
Submitted 30 January, 2014; v1 submitted 27 January, 2014;
originally announced January 2014.
-
Compressed sensing with sparse, structured matrices
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi,
Yoshiyuki Kabashima
Abstract:
In the context of the compressed sensing problem, we propose a new ensemble of sparse random matrices which allow one (i) to acquire and compress a ρ0-sparse signal of length N in a time linear in N and (ii) to perfectly recover the original signal, compressed at a rate α, by using a message passing algorithm (Expectation Maximization Belief Propagation) that runs in a time linear in N. In the lar…
▽ More
In the context of the compressed sensing problem, we propose a new ensemble of sparse random matrices which allow one (i) to acquire and compress a ρ0-sparse signal of length N in a time linear in N and (ii) to perfectly recover the original signal, compressed at a rate α, by using a message passing algorithm (Expectation Maximization Belief Propagation) that runs in a time linear in N. In the large N limit, the scheme proposed here closely approaches the theoretical bound ρ0 = α, and so it is both optimal and efficient (linear time complexity). More generally, we show that several ensembles of dense random matrices can be converted into ensembles of sparse random matrices, having the same thresholds, but much lower computational complexity.
△ Less
Submitted 12 April, 2013; v1 submitted 12 July, 2012;
originally announced July 2012.
-
Ensemble renormalization group for disordered systems
Authors:
Maria Chiara Angelini,
Giorgio Parisi,
Federico Ricci-Tersenghi
Abstract:
We propose and study a renormalization group transformation that can be used also for models with strong quenched disorder, like spin glasses. The method is based on a map** between disorder distributions, chosen such as to keep some physical properties (e.g., the ratio of correlations averaged over the ensemble) invariant under the transformation. We validate this ensemble renormalization group…
▽ More
We propose and study a renormalization group transformation that can be used also for models with strong quenched disorder, like spin glasses. The method is based on a map** between disorder distributions, chosen such as to keep some physical properties (e.g., the ratio of correlations averaged over the ensemble) invariant under the transformation. We validate this ensemble renormalization group by applying it to the hierarchical model (both the diluted ferromagnetic version and the spin glass version), finding results in agreement with Monte Carlo simulations.
△ Less
Submitted 28 April, 2013; v1 submitted 29 November, 2011;
originally announced November 2011.
-
Entropic long range order in a 3D spin glass model
Authors:
Maria Chiara Angelini,
Federico Ricci-Tersenghi
Abstract:
We uncover a new kind of entropic long range order in finite dimensional spin glasses. We study the link-diluted version of the Edwards-Anderson spin glass model with bimodal couplings (J=+/-1) on a 3D lattice. By using exact reduction algorithms, we prove that there exists a region of the phase diagram (at zero temperature and link density low enough), where spins are long range correlated, even…
▽ More
We uncover a new kind of entropic long range order in finite dimensional spin glasses. We study the link-diluted version of the Edwards-Anderson spin glass model with bimodal couplings (J=+/-1) on a 3D lattice. By using exact reduction algorithms, we prove that there exists a region of the phase diagram (at zero temperature and link density low enough), where spins are long range correlated, even if the ground states energy stiffness is null. In other words, in this region twisting the boundary conditions cost no energy, but spins are long range correlated by means of pure entropic effects.
△ Less
Submitted 4 January, 2011; v1 submitted 12 July, 2010;
originally announced July 2010.
