-
Impact of dendritic non-linearities on the computational capabilities of neurons
Authors:
Clarissa Lauditi,
Enrico M. Malatesta,
Fabrizio Pittorino,
Carlo Baldassi,
Nicolas Brunel,
Riccardo Zecchina
Abstract:
Multiple neurophysiological experiments have shown that dendritic non-linearities can have a strong influence on synaptic input integration. In this work we model a single neuron as a two-layer computational unit with non-overlap** sign-constrained synaptic weights and a biologically plausible form of dendritic non-linearity, which is analytically tractable using statistical physics methods. Usi…
▽ More
Multiple neurophysiological experiments have shown that dendritic non-linearities can have a strong influence on synaptic input integration. In this work we model a single neuron as a two-layer computational unit with non-overlap** sign-constrained synaptic weights and a biologically plausible form of dendritic non-linearity, which is analytically tractable using statistical physics methods. Using both analytical and numerical tools, we demonstrate several key computational advantages of non-linear dendritic integration with respect to models with linear synaptic integration. We find that the dendritic non-linearity concurrently enhances the number of possible learned input-output associations and the learning velocity, and we characterize how capacity and learning speed depend on the implemented non-linearity and the levels of dendritic and somatic inhibition. We find that experimentally observed connection probabilities naturally emerge in neurons with sign-constrained synapses as a consequence of non-linear dendritic integration, while in models with linear integration, an additional robustness parameter must be introduced in order to reproduce realistic connection probabilities. Non-linearly induced sparsity comes with a second central advantage for neuronal information processing, i.e. input and synaptic noise robustness. By testing our model on standard real-world benchmark datasets inspired by deep learning practice, we observe empirically that the non-linearity provides an enhancement in generalization performance, showing that it enables to capture more complex input/output relations.
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Random Features Hopfield Networks generalize retrieval to previously unseen examples
Authors:
Silvio Kalaj,
Clarissa Lauditi,
Gabriele Perugini,
Carlo Lucibello,
Enrico M. Malatesta,
Matteo Negri
Abstract:
It has been recently shown that a learning transition happens when a Hopfield Network stores examples generated as superpositions of random features, where new attractors corresponding to such features appear in the model. In this work we reveal that the network also develops attractors corresponding to previously unseen examples generated with the same set of features. We explain this surprising…
▽ More
It has been recently shown that a learning transition happens when a Hopfield Network stores examples generated as superpositions of random features, where new attractors corresponding to such features appear in the model. In this work we reveal that the network also develops attractors corresponding to previously unseen examples generated with the same set of features. We explain this surprising behaviour in terms of spurious states of the learned features: we argue that, increasing the number of stored examples beyond the learning transition, the model also learns to mix the features to represent both stored and previously unseen examples. We support this claim with the computation of the phase diagram of the model.
△ Less
Submitted 8 July, 2024;
originally announced July 2024.
-
Instantons in $φ^4$ Theories: Transseries, Virial Theorems and Numerical Aspects
Authors:
Ludovico T. Giorgini,
Ulrich D. Jentschura,
Enrico M. Malatesta,
Tommaso Rizzo,
Jean Zinn-Justin
Abstract:
We discuss numerical aspects of instantons in two- and three-dimensional $φ^4$ theories with an internal $O(N)$ symmetry group, the so-called $N$-vector model. Combining asymptotic transseries expansions for large argument with convergence acceleration techniques, we obtain high-precision values for certain integrals of the instanton that naturally occur in loop corrections around instanton config…
▽ More
We discuss numerical aspects of instantons in two- and three-dimensional $φ^4$ theories with an internal $O(N)$ symmetry group, the so-called $N$-vector model. Combining asymptotic transseries expansions for large argument with convergence acceleration techniques, we obtain high-precision values for certain integrals of the instanton that naturally occur in loop corrections around instanton configurations. Knowledge of these numerical properties are necessary in order to evaluate corrections to the large-order factorial growth of perturbation theory in $φ^4$ theories. The results contribute to the understanding of the mathematical structures underlying the instanton configurations.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
The twin peaks of learning neural networks
Authors:
Elizaveta Demyanenko,
Christoph Feinauer,
Enrico M. Malatesta,
Luca Saglietti
Abstract:
Recent works demonstrated the existence of a double-descent phenomenon for the generalization error of neural networks, where highly overparameterized models escape overfitting and achieve good test performance, at odds with the standard bias-variance trade-off described by statistical learning theory. In the present work, we explore a link between this phenomenon and the increase of complexity an…
▽ More
Recent works demonstrated the existence of a double-descent phenomenon for the generalization error of neural networks, where highly overparameterized models escape overfitting and achieve good test performance, at odds with the standard bias-variance trade-off described by statistical learning theory. In the present work, we explore a link between this phenomenon and the increase of complexity and sensitivity of the function represented by neural networks. In particular, we study the Boolean mean dimension (BMD), a metric developed in the context of Boolean function analysis. Focusing on a simple teacher-student setting for the random feature model, we derive a theoretical analysis based on the replica method that yields an interpretable expression for the BMD, in the high dimensional regime where the number of data points, the number of features, and the input size grow to infinity. We find that, as the degree of overparameterization of the network is increased, the BMD reaches an evident peak at the interpolation threshold, in correspondence with the generalization error peak, and then slowly approaches a low asymptotic value. The same phenomenology is then traced in numerical experiments with different model classes and training setups. Moreover, we find empirically that adversarially initialized models tend to show higher BMD values, and that models that are more robust to adversarial attacks exhibit a lower BMD.
△ Less
Submitted 1 April, 2024; v1 submitted 23 January, 2024;
originally announced January 2024.
-
High-dimensional manifold of solutions in neural networks: insights from statistical physics
Authors:
Enrico M. Malatesta
Abstract:
In these pedagogic notes I review the statistical mechanics approach to neural networks, focusing on the paradigmatic example of the perceptron architecture with binary an continuous weights, in the classification setting. I will review the Gardner's approach based on replica method and the derivation of the SAT/UNSAT transition in the storage setting. Then, I discuss some recent works that unveil…
▽ More
In these pedagogic notes I review the statistical mechanics approach to neural networks, focusing on the paradigmatic example of the perceptron architecture with binary an continuous weights, in the classification setting. I will review the Gardner's approach based on replica method and the derivation of the SAT/UNSAT transition in the storage setting. Then, I discuss some recent works that unveiled how the zero training error configurations are geometrically arranged, and how this arrangement changes as the size of the training set increases. I also illustrate how different regions of solution space can be explored analytically and how the landscape in the vicinity of a solution can be characterized. I give evidence how, in binary weight models, algorithmic hardness is a consequence of the disappearance of a clustered region of solutions that extends to very large distances. Finally, I demonstrate how the study of linear mode connectivity between solutions can give insights into the average shape of the solution manifold.
△ Less
Submitted 17 September, 2023;
originally announced September 2023.
-
The star-shaped space of solutions of the spherical negative perceptron
Authors:
Brandon Livio Annesi,
Clarissa Lauditi,
Carlo Lucibello,
Enrico M. Malatesta,
Gabriele Perugini,
Fabrizio Pittorino,
Luca Saglietti
Abstract:
Empirical studies on the landscape of neural networks have shown that low-energy configurations are often found in complex connected structures, where zero-energy paths between pairs of distant solutions can be constructed. Here we consider the spherical negative perceptron, a prototypical non-convex neural network model framed as a continuous constraint satisfaction problem. We introduce a genera…
▽ More
Empirical studies on the landscape of neural networks have shown that low-energy configurations are often found in complex connected structures, where zero-energy paths between pairs of distant solutions can be constructed. Here we consider the spherical negative perceptron, a prototypical non-convex neural network model framed as a continuous constraint satisfaction problem. We introduce a general analytical method for computing energy barriers in the simplex with vertex configurations sampled from the equilibrium. We find that in the over-parameterized regime the solution manifold displays simple connectivity properties. There exists a large geodesically convex component that is attractive for a wide range of optimization dynamics. Inside this region we identify a subset of atypical high-margin solutions that are geodesically connected with most other solutions, giving rise to a star-shaped geometry. We analytically characterize the organization of the connected space of solutions and show numerical evidence of a transition, at larger constraint densities, where the aforementioned simple geodesic connectivity breaks down.
△ Less
Submitted 5 September, 2023; v1 submitted 17 May, 2023;
originally announced May 2023.
-
Typical and atypical solutions in non-convex neural networks with discrete and continuous weights
Authors:
Carlo Baldassi,
Enrico M. Malatesta,
Gabriele Perugini,
Riccardo Zecchina
Abstract:
We study the binary and continuous negative-margin perceptrons as simple non-convex neural network models learning random rules and associations. We analyze the geometry of the landscape of solutions in both models and find important similarities and differences. Both models exhibit subdominant minimizers which are extremely flat and wide. These minimizers coexist with a background of dominant sol…
▽ More
We study the binary and continuous negative-margin perceptrons as simple non-convex neural network models learning random rules and associations. We analyze the geometry of the landscape of solutions in both models and find important similarities and differences. Both models exhibit subdominant minimizers which are extremely flat and wide. These minimizers coexist with a background of dominant solutions which are composed by an exponential number of algorithmically inaccessible small clusters for the binary case (the frozen 1-RSB phase) or a hierarchical structure of clusters of different sizes for the spherical case (the full RSB phase). In both cases, when a certain threshold in constraint density is crossed, the local entropy of the wide flat minima becomes non-monotonic, indicating a break-up of the space of robust solutions into disconnected components. This has a strong impact on the behavior of algorithms in binary models, which cannot access the remaining isolated clusters. For the spherical case the behaviour is different, since even beyond the disappearance of the wide flat minima the remaining solutions are shown to always be surrounded by a large number of other solutions at any distance, up to capacity. Indeed, we exhibit numerical evidence that algorithms seem to find solutions up to the SAT/UNSAT transition, that we compute here using an 1RSB approximation. For both models, the generalization performance as a learning device is shown to be greatly improved by the existence of wide flat minimizers even when trained in the highly underconstrained regime of very negative margins.
△ Less
Submitted 24 July, 2023; v1 submitted 26 April, 2023;
originally announced April 2023.
-
Correlation Functions of the Anharmonic Oscillator: Numerical Verification of Two-Loop Corrections to the Large-Order Behavior
Authors:
Ludovico T. Giorgini,
Ulrich D. Jentschura,
Enrico M. Malatesta,
Giorgio Parisi,
Tommaso Rizzo,
Jean Zinn-Justin
Abstract:
Recently, the large-order behavior of correlation functions of the $O(N)$-anharmonic oscillator has been analyzed by us in [L. T. Giorgini et el., Phys. Rev. D 101, 125001 (2020)]. Two-loop corrections about the instanton configurations were obtained for the partition function, and the two-point and four-point functions, and the derivative of the two-point function at zero momentum transfer. Here,…
▽ More
Recently, the large-order behavior of correlation functions of the $O(N)$-anharmonic oscillator has been analyzed by us in [L. T. Giorgini et el., Phys. Rev. D 101, 125001 (2020)]. Two-loop corrections about the instanton configurations were obtained for the partition function, and the two-point and four-point functions, and the derivative of the two-point function at zero momentum transfer. Here, we attempt to verify the obtained analytic results against numerical calculations of higher-order coefficients for the $O(1)$, $O(2)$, and $O(3)$ oscillators, and demonstrate the drastic improvement of the agreement of the large-order asymptotic estimates and perturbation theory upon the inclusion of the two-loop corrections to the large-order behavior.
△ Less
Submitted 1 December, 2021; v1 submitted 24 November, 2021;
originally announced November 2021.
-
Learning through atypical "phase transitions" in overparameterized neural networks
Authors:
Carlo Baldassi,
Clarissa Lauditi,
Enrico M. Malatesta,
Rosalba Pacelli,
Gabriele Perugini,
Riccardo Zecchina
Abstract:
Current deep neural networks are highly overparameterized (up to billions of connection weights) and nonlinear. Yet they can fit data almost perfectly through variants of gradient descent algorithms and achieve unexpected levels of prediction accuracy without overfitting. These are formidable results that defy predictions of statistical learning and pose conceptual challenges for non-convex optimi…
▽ More
Current deep neural networks are highly overparameterized (up to billions of connection weights) and nonlinear. Yet they can fit data almost perfectly through variants of gradient descent algorithms and achieve unexpected levels of prediction accuracy without overfitting. These are formidable results that defy predictions of statistical learning and pose conceptual challenges for non-convex optimization. In this paper, we use methods from statistical physics of disordered systems to analytically study the computational fallout of overparameterization in non-convex binary neural network models, trained on data generated from a structurally simpler but "hidden" network. As the number of connection weights increases, we follow the changes of the geometrical structure of different minima of the error loss function and relate them to learning and generalization performance. A first transition happens at the so-called interpolation point, when solutions begin to exist (perfect fitting becomes possible). This transition reflects the properties of typical solutions, which however are in sharp minima and hard to sample. After a gap, a second transition occurs, with the discontinuous appearance of a different kind of "atypical" structures: wide regions of the weight space that are particularly solution-dense and have good generalization properties. The two kinds of solutions coexist, with the typical ones being exponentially more numerous, but empirically we find that efficient algorithms sample the atypical, rare ones. This suggests that the atypical phase transition is the relevant one for learning. The results of numerical tests with realistic networks on observables suggested by the theory are consistent with this scenario.
△ Less
Submitted 11 June, 2022; v1 submitted 1 October, 2021;
originally announced October 2021.
-
Unveiling the structure of wide flat minima in neural networks
Authors:
Carlo Baldassi,
Clarissa Lauditi,
Enrico M. Malatesta,
Gabriele Perugini,
Riccardo Zecchina
Abstract:
The success of deep learning has revealed the application potential of neural networks across the sciences and opened up fundamental theoretical problems. In particular, the fact that learning algorithms based on simple variants of gradient methods are able to find near-optimal minima of highly nonconvex loss functions is an unexpected feature of neural networks. Moreover, such algorithms are able…
▽ More
The success of deep learning has revealed the application potential of neural networks across the sciences and opened up fundamental theoretical problems. In particular, the fact that learning algorithms based on simple variants of gradient methods are able to find near-optimal minima of highly nonconvex loss functions is an unexpected feature of neural networks. Moreover, such algorithms are able to fit the data even in the presence of noise, and yet they have excellent predictive capabilities. Several empirical results have shown a reproducible correlation between the so-called flatness of the minima achieved by the algorithms and the generalization performance. At the same time, statistical physics results have shown that in nonconvex networks a multitude of narrow minima may coexist with a much smaller number of wide flat minima, which generalize well. Here we show that wide flat minima arise as complex extensive structures, from the coalescence of minima around "high-margin" (i.e., locally robust) configurations. Despite being exponentially rare compared to zero-margin ones, high-margin minima tend to concentrate in particular regions. These minima are in turn surrounded by other solutions of smaller and smaller margin, leading to dense regions of solutions over long distances. Our analysis also provides an alternative analytical method for estimating when flat minima appear and when algorithms begin to find solutions, as the number of model parameters varies.
△ Less
Submitted 14 February, 2022; v1 submitted 2 July, 2021;
originally announced July 2021.
-
Wide flat minima and optimal generalization in classifying high-dimensional Gaussian mixtures
Authors:
Carlo Baldassi,
Enrico M. Malatesta,
Matteo Negri,
Riccardo Zecchina
Abstract:
We analyze the connection between minimizers with good generalizing properties and high local entropy regions of a threshold-linear classifier in Gaussian mixtures with the mean squared error loss function. We show that there exist configurations that achieve the Bayes-optimal generalization error, even in the case of unbalanced clusters. We explore analytically the error-counting loss landscape i…
▽ More
We analyze the connection between minimizers with good generalizing properties and high local entropy regions of a threshold-linear classifier in Gaussian mixtures with the mean squared error loss function. We show that there exist configurations that achieve the Bayes-optimal generalization error, even in the case of unbalanced clusters. We explore analytically the error-counting loss landscape in the vicinity of a Bayes-optimal solution, and show that the closer we get to such configurations, the higher the local entropy, implying that the Bayes-optimal solution lays inside a wide flat region. We also consider the algorithmically relevant case of targeting wide flat minima of the (differentiable) mean squared error loss. Our analytical and numerical results show not only that in the balanced case the dependence on the norm of the weights is mild, but also, in the unbalanced case, that the performances can be improved.
△ Less
Submitted 17 November, 2020; v1 submitted 26 October, 2020;
originally announced October 2020.
-
Two-Loop Corrections to the Large-Order Behavior of Correlation Functions in the One-Dimensional N-Vector Model
Authors:
L. T. Giorgini,
U. D. Jentschura,
E. M. Malatesta,
G. Parisi,
T. Rizzo,
J. Zinn-Justin
Abstract:
For a long time, the predictive limits of perturbative quantum field theory have been limited by our inability to carry out loop calculations to arbitrarily high order, which become increasingly complex as the order of perturbation theory is increased. This problem is exacerbated by the fact that perturbation series derived from loop diagram (Feynman diagram) calculations represent asymptotic (div…
▽ More
For a long time, the predictive limits of perturbative quantum field theory have been limited by our inability to carry out loop calculations to arbitrarily high order, which become increasingly complex as the order of perturbation theory is increased. This problem is exacerbated by the fact that perturbation series derived from loop diagram (Feynman diagram) calculations represent asymptotic (divergent) series which limits the predictive power of perturbative quantum field theory. Here, we discuss an ansatz which could overcome these limits, based on the observations that (i) for many phenomenologically relevant field theories, one can derive dispersion relations which relate the large-order growth (the asymptotic limit of "infinite loop order") with the imaginary part of arbitrary correlation functions, for negative coupling ("unstable vacuum"), and (ii) one can analyze the imaginary part for negative coupling in terms of classical field configurations (instantons). Unfortunately, the perturbation theory around instantons, which could lead to much more accurate predictions for the large-order behavior of Feynman diagrams, poses a number of technical as well as computational difficulties. Here, we study, to further the above mentioned ansatz, correlation functions in a one-dimensional (1D) field theory with a quartic self-interaction and an O(N) internal symmetry group, otherwise known as the 1D N-vector model. Our focus is on corrections to the large-order growth of perturbative coefficients, i.e., the limit of a large number of loops in the Feynman diagram expansion. We evaluate, in momentum space, the two-loop corrections for the two-point correlation function, and its derivative with respect to the momentum, as well as the two-point correlation function with a wigglet insertion. Also, we study the four-point function.
△ Less
Submitted 2 June, 2020; v1 submitted 30 April, 2020;
originally announced May 2020.
-
Properties of the geometry of solutions and capacity of multi-layer neural networks with Rectified Linear Units activations
Authors:
Carlo Baldassi,
Enrico M. Malatesta,
Riccardo Zecchina
Abstract:
Rectified Linear Units (ReLU) have become the main model for the neural units in current deep learning systems. This choice has been originally suggested as a way to compensate for the so called vanishing gradient problem which can undercut stochastic gradient descent (SGD) learning in networks composed of multiple layers. Here we provide analytical results on the effects of ReLUs on the capacity…
▽ More
Rectified Linear Units (ReLU) have become the main model for the neural units in current deep learning systems. This choice has been originally suggested as a way to compensate for the so called vanishing gradient problem which can undercut stochastic gradient descent (SGD) learning in networks composed of multiple layers. Here we provide analytical results on the effects of ReLUs on the capacity and on the geometrical landscape of the solution space in two-layer neural networks with either binary or real-valued weights. We study the problem of storing an extensive number of random patterns and find that, quite unexpectedly, the capacity of the network remains finite as the number of neurons in the hidden layer increases, at odds with the case of threshold units in which the capacity diverges. Possibly more important, a large deviation approach allows us to find that the geometrical landscape of the solution space has a peculiar structure: while the majority of solutions are close in distance but still isolated, there exist rare regions of solutions which are much more dense than the similar ones in the case of threshold units. These solutions are robust to perturbations of the weights and can tolerate large perturbations of the inputs. The analytical results are corroborated by numerical findings.
△ Less
Submitted 3 May, 2024; v1 submitted 17 July, 2019;
originally announced July 2019.
-
Fluctuations in the random-link matching problem
Authors:
Enrico M. Malatesta,
Giorgio Parisi,
Gabriele Sicuro
Abstract:
Using the replica approach and the cavity method, we study the fluctuations of the optimal cost in the random-link matching problem. By means of replica arguments, we derive the exact expression of its variance. Moreover, we study the large deviation function, deriving its expression in two different ways, namely using both the replica method and the cavity method.
Using the replica approach and the cavity method, we study the fluctuations of the optimal cost in the random-link matching problem. By means of replica arguments, we derive the exact expression of its variance. Moreover, we study the large deviation function, deriving its expression in two different ways, namely using both the replica method and the cavity method.
△ Less
Submitted 30 August, 2019; v1 submitted 21 May, 2019;
originally announced May 2019.
-
Random Combinatorial Optimization Problems: Mean Field and Finite-Dimensional Results
Authors:
Enrico M. Malatesta
Abstract:
This PhD thesis is organized as follows. In the first two chapters I will review some basic notions of statistical physics of disordered systems, such as random graph theory, the mean-field approximation, spin glasses and combinatorial optimization. The replica method will also be introduced and applied to the Sherrington-Kirkpatrick model, one of the simplest mean-field models of spin-glasses. Th…
▽ More
This PhD thesis is organized as follows. In the first two chapters I will review some basic notions of statistical physics of disordered systems, such as random graph theory, the mean-field approximation, spin glasses and combinatorial optimization. The replica method will also be introduced and applied to the Sherrington-Kirkpatrick model, one of the simplest mean-field models of spin-glasses. The second part of the thesis deals with mean-field combinatorial optimization problems. The attention will be focused on the study of finite-size corrections of random integer matching problems (chapter 3) and fractional ones (chapter 4). In chapter 5 I will discuss a very general relation connecting multi-overlaps and the moments of the cavity magnetization distribution. In the third part we consider random Euclidean optimization problems. I will start solving the traveling-salesman-problem (TSP) in one dimension both in its bipartite and monopartite version (chapter 6). In chapter 7 I will discuss the possible optimal solutions of the 2-factor problem. In chapter 8 I will solve the bipartite TSP in two dimensions, in the limit of large number of points. Chapter 9 contains some conclusions.
△ Less
Submitted 12 October, 2019; v1 submitted 1 February, 2019;
originally announced February 2019.
-
Average optimal cost for the Euclidean TSP in one dimension
Authors:
Sergio Caracciolo,
Andrea Di Gioacchino,
Enrico M. Malatesta,
Carlo Vanoni
Abstract:
The traveling-salesman problem is one of the most studied combinatorial optimization problems, because of the simplicity in its statement and the difficulty in its solution. We study the traveling salesman problem when the positions of the cities are chosen at random in the unit interval and the cost associated to the travel between two cities is their distance elevated to an arbitrary power…
▽ More
The traveling-salesman problem is one of the most studied combinatorial optimization problems, because of the simplicity in its statement and the difficulty in its solution. We study the traveling salesman problem when the positions of the cities are chosen at random in the unit interval and the cost associated to the travel between two cities is their distance elevated to an arbitrary power $p\in \mathbb{R}$. We characterize the optimal cycle and compute the average optimal cost for every number of cities when the measure used to choose the position of the cities is flat and asymptotically for large number of cities in the other cases. We also show that the optimal cost is a self-averaging quantity, and we test our analytical results with extensive simulations.
△ Less
Submitted 26 February, 2019; v1 submitted 20 November, 2018;
originally announced November 2018.
-
Selberg integrals in 1D random Euclidean optimization problems
Authors:
Sergio Caracciolo,
Andrea Di Gioacchino,
Enrico M. Malatesta,
Luca G. Molinari
Abstract:
We consider a set of Euclidean optimization problems in one dimension, where the cost function associated to the couple of points $x$ and $y$ is the Euclidean distance between them to an arbitrary power $p\ge1$, and the points are chosen at random with flat measure. We derive the exact average cost for the random assignment problem, for any number of points, by using Selberg's integrals. Some vari…
▽ More
We consider a set of Euclidean optimization problems in one dimension, where the cost function associated to the couple of points $x$ and $y$ is the Euclidean distance between them to an arbitrary power $p\ge1$, and the points are chosen at random with flat measure. We derive the exact average cost for the random assignment problem, for any number of points, by using Selberg's integrals. Some variants of these integrals allows to derive also the exact average cost for the bipartite travelling salesman problem.
△ Less
Submitted 6 May, 2019; v1 submitted 1 October, 2018;
originally announced October 2018.
-
Exact value for the average optimal cost of bipartite traveling-salesman and 2-factor problems in two dimensions
Authors:
Riccardo Capelli,
Sergio Caracciolo,
Andrea Di Gioacchino,
Enrico M. Malatesta
Abstract:
We show that the average cost for the traveling-salesman problem in two dimensions, which is the archetypal problem in combinatorial optimization, in the bipartite case, is simply related to the average cost of the assignment problem with the same Euclidean, increasing, convex weights. In this way we extend a result already known in one dimension where exact solutions are avalaible. The recently d…
▽ More
We show that the average cost for the traveling-salesman problem in two dimensions, which is the archetypal problem in combinatorial optimization, in the bipartite case, is simply related to the average cost of the assignment problem with the same Euclidean, increasing, convex weights. In this way we extend a result already known in one dimension where exact solutions are avalaible. The recently determined average cost for the assignment when the cost function is the square of the distance between the points provides therefore an exact prediction $$\overline{E_N} = \frac{1}π\, \log N$$ for large number of points $2N$. As a byproduct of our analysis also the loop covering problem has the same optimal average cost. We also explain why this result cannot be extended at higher dimensions. We numerically check the exact predictions.
△ Less
Submitted 27 September, 2018; v1 submitted 10 July, 2018;
originally announced July 2018.
-
Plastic number and possible optimal solutions for an Euclidean 2-matching in one dimension
Authors:
Sergio Caracciolo,
Andrea Di Gioacchino,
Enrico M. Malatesta
Abstract:
In this work we consider the problem of finding the minimum-weight loop cover of an undirected graph. This combinatorial optimization problem is called 2-matching and can be seen as a relaxation of the traveling salesman problem since one does not have the unique loop condition. We consider this problem both on the complete bipartite and complete graph embedded in a one dimensional interval, the w…
▽ More
In this work we consider the problem of finding the minimum-weight loop cover of an undirected graph. This combinatorial optimization problem is called 2-matching and can be seen as a relaxation of the traveling salesman problem since one does not have the unique loop condition. We consider this problem both on the complete bipartite and complete graph embedded in a one dimensional interval, the weights being chosen as a convex function of the Euclidean distance between each couple of points. Randomness is introduced throwing independently and uniformly the points in space. We derive the average optimal cost in the limit of large number of points. We prove that the possible solutions are characterized by the presence of "shoelace" loops containing 2 or 3 points of each type in the complete bipartite case, and 3, 4 or 5 points in the complete one. This gives rise to an exponential number of possible solutions scaling as p^N , where p is the plastic constant. This is at variance to what happens in the previously studied one-dimensional models such as the matching and the traveling salesman problem, where for every instance of the disorder there is only one possible solution.
△ Less
Submitted 25 August, 2018; v1 submitted 18 May, 2018;
originally announced May 2018.
-
The Random Fractional Matching Problem
Authors:
Carlo Lucibello,
Enrico M. Malatesta,
Giorgio Parisi,
Gabriele Sicuro
Abstract:
We consider two formulations of the random-link fractional matching problem, a relaxed version of the more standard random-link (integer) matching problem. In one formulation, we allow each node to be linked to itself in the optimal matching configuration. In the other one, on the contrary, such a link is forbidden. Both problems have the same asymptotic average optimal cost of the random-link mat…
▽ More
We consider two formulations of the random-link fractional matching problem, a relaxed version of the more standard random-link (integer) matching problem. In one formulation, we allow each node to be linked to itself in the optimal matching configuration. In the other one, on the contrary, such a link is forbidden. Both problems have the same asymptotic average optimal cost of the random-link matching problem on the complete graph. Using a replica approach and previous results of Wästlund [Acta Mathematica 204, 91-150 (2010)], we analytically derive the finite-size corrections to the asymptotic optimal cost. We compare our results with numerical simulations and we discuss the main differences between random-link fractional matching problems and the random-link matching problem.
△ Less
Submitted 4 May, 2018; v1 submitted 8 February, 2018;
originally announced February 2018.
-
Solution for a bipartite Euclidean traveling-salesman problem in one dimension
Authors:
Sergio Caracciolo,
Andrea Di Gioacchino,
Marco Gherardi,
Enrico M. Malatesta
Abstract:
The traveling salesman problem is one of the most studied combinatorial optimization problems, because of the simplicity in its statement and the difficulty in its solution. We characterize the optimal cycle for every convex and increasing cost function when the points are thrown independently and with an identical probability distribution in a compact interval. We compute the average optimal cost…
▽ More
The traveling salesman problem is one of the most studied combinatorial optimization problems, because of the simplicity in its statement and the difficulty in its solution. We characterize the optimal cycle for every convex and increasing cost function when the points are thrown independently and with an identical probability distribution in a compact interval. We compute the average optimal cost for every number of points when the distance function is the square of the Euclidean distance. We also show that the average optimal cost is not a self-averaging quantity by explicitly computing the variance of its distribution in the thermodynamic limit. Moreover, we prove that the cost of the optimal cycle is not smaller than twice the cost of the optimal assignment of the same set of points. Interestingly, this bound is saturated in the thermodynamic limit.
△ Less
Submitted 17 May, 2018; v1 submitted 5 February, 2018;
originally announced February 2018.
-
Two-Loop Corrections to Large Order Behavior of $\varphi^4$ Theory
Authors:
Enrico M. Malatesta,
Giorgio Parisi,
Tommaso Rizzo
Abstract:
We consider the large order behavior of the perturbative expansion of the scalar $\varphi^4$ field theory in terms of a perturbative expansion around an instanton solution. We have computed the series of the free energy up to two-loop order in two and three dimension. Topologically there is only an additional Feynman diagram with respect to the previously known one dimensional case, but a careful…
▽ More
We consider the large order behavior of the perturbative expansion of the scalar $\varphi^4$ field theory in terms of a perturbative expansion around an instanton solution. We have computed the series of the free energy up to two-loop order in two and three dimension. Topologically there is only an additional Feynman diagram with respect to the previously known one dimensional case, but a careful treatment of renormalization is needed. The propagator and Feynman diagrams were expressed in a form suitable for numerical evaluation. We then obtained explicit expressions summing over $O(10^3)$ distinct eigenvalues determined numerically with the corresponding eigenfunctions.
△ Less
Submitted 16 May, 2018; v1 submitted 14 April, 2017;
originally announced April 2017.
-
Finite-size corrections in the random assignment problem
Authors:
Sergio Caracciolo,
Matteo P. D'Achille,
Enrico M. Malatesta,
Gabriele Sicuro
Abstract:
We analytically derive, in the context of the replica formalism, the first finite size corrections to the average optimal cost in the random assignment problem for a quite generic distribution law for the costs. We show that, when moving from a power-law distribution to a $Γ$ distribution, the leading correction changes both in sign and in its scaling properties. We also examine the behavior of th…
▽ More
We analytically derive, in the context of the replica formalism, the first finite size corrections to the average optimal cost in the random assignment problem for a quite generic distribution law for the costs. We show that, when moving from a power-law distribution to a $Γ$ distribution, the leading correction changes both in sign and in its scaling properties. We also examine the behavior of the corrections when approaching a $δ$-function distribution. By using a numerical solution of the saddle-point equations, we provide predictions that are confirmed by numerical simulations.
△ Less
Submitted 17 May, 2017; v1 submitted 20 February, 2017;
originally announced February 2017.
