Showing 1–19 of 19 results for author: Morandin, F

A Systematization of the Wagner Framework: Graph Theory Conjectures and Reinforcement Learning

Authors: Flora Angileri, Giulia Lombardi, Andrea Fois, Renato Faraone, Carlo Metta, Michele Salvi, Luigi Amedeo Bianchi, Marco Fantozzi, Silvia Giulia Galfrè, Daniele Pavesi, Maurizio Parton, Francesco Morandin

Abstract: In 2021, Adam Zsolt Wagner proposed an approach to disprove conjectures in graph theory using Reinforcement Learning (RL). Wagner's idea can be framed as follows: consider a conjecture, such as a certain quantity f(G) < 0 for every graph G; one can then play a single-player graph-building game, where at each turn the player decides whether to add an edge or not. The game ends when all edges have b… ▽ More In 2021, Adam Zsolt Wagner proposed an approach to disprove conjectures in graph theory using Reinforcement Learning (RL). Wagner's idea can be framed as follows: consider a conjecture, such as a certain quantity f(G) < 0 for every graph G; one can then play a single-player graph-building game, where at each turn the player decides whether to add an edge or not. The game ends when all edges have been considered, resulting in a certain graph G_T, and f(G_T) is the final score of the game; RL is then used to maximize this score. This brilliant idea is as simple as innovative, and it lends itself to systematic generalization. Several different single-player graph-building games can be employed, along with various RL algorithms. Moreover, RL maximizes the cumulative reward, allowing for step-by-step rewards instead of a single final score, provided the final cumulative reward represents the quantity of interest f(G_T). In this paper, we discuss these and various other choices that can be significant in Wagner's framework. As a contribution to this systematization, we present four distinct single-player graph-building games. Each game employs both a step-by-step reward system and a single final score. We also propose a principled approach to select the most suitable neural network architecture for any given conjecture, and introduce a new dataset of graphs labeled with their Laplacian spectra. Furthermore, we provide a counterexample for a conjecture regarding the sum of the matching number and the spectral radius, which is simpler than the example provided in Wagner's original paper. The games have been implemented as environments in the Gymnasium framework, and along with the dataset, are available as open-source supplementary materials. △ Less

Submitted 18 June, 2024; originally announced June 2024.

GloNets: Globally Connected Neural Networks

Authors: Antonio Di Cecco, Carlo Metta, Marco Fantozzi, Francesco Morandin, Maurizio Parton

Abstract: Deep learning architectures suffer from depth-related performance degradation, limiting the effective depth of neural networks. Approaches like ResNet are able to mitigate this, but they do not completely eliminate the problem. We introduce Globally Connected Neural Networks (GloNet), a novel architecture overcoming depth-related issues, designed to be superimposed on any model, enhancing its dept… ▽ More Deep learning architectures suffer from depth-related performance degradation, limiting the effective depth of neural networks. Approaches like ResNet are able to mitigate this, but they do not completely eliminate the problem. We introduce Globally Connected Neural Networks (GloNet), a novel architecture overcoming depth-related issues, designed to be superimposed on any model, enhancing its depth without increasing complexity or reducing performance. With GloNet, the network's head uniformly receives information from all parts of the network, regardless of their level of abstraction. This enables GloNet to self-regulate information flow during training, reducing the influence of less effective deeper layers, and allowing for stable training irrespective of network depth. This paper details GloNet's design, its theoretical basis, and a comparison with existing similar architectures. Experiments show GloNet's self-regulation ability and resilience to depth-related learning challenges, like performance degradation. Our findings suggest GloNet as a strong alternative to traditional architectures like ResNets. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Increasing biases can be more efficient than increasing weights

Authors: Carlo Metta, Marco Fantozzi, Andrea Papini, Gianluca Amato, Matteo Bergamaschi, Silvia Giulia Galfrè, Alessandro Marchetti, Michelangelo Vegliò, Maurizio Parton, Francesco Morandin

Abstract: We introduce a novel computational unit for neural networks that features multiple biases, challenging the traditional perceptron structure. This unit emphasizes the importance of preserving uncorrupted information as it is passed from one unit to the next, applying activation functions later in the process with specialized biases for each unit. Through both empirical and theoretical analyses, we… ▽ More We introduce a novel computational unit for neural networks that features multiple biases, challenging the traditional perceptron structure. This unit emphasizes the importance of preserving uncorrupted information as it is passed from one unit to the next, applying activation functions later in the process with specialized biases for each unit. Through both empirical and theoretical analyses, we show that by focusing on increasing biases rather than weights, there is potential for significant enhancement in a neural network model's performance. This approach offers an alternative perspective on optimizing information flow within neural networks. See source code at https://github.com/CuriosAI/dac-dev. △ Less

Submitted 18 January, 2024; v1 submitted 2 January, 2023; originally announced January 2023.

Comments: Major rewriting. Supersedes v1 and v2. Focusing on the fact that not all parameters are born equal: biases can be more important than weights. Accordingly, new title and new abstract, and many more experiments on fully connected architectures. This is the extended version of the paper published at WACV 2024

ACM Class: I.2.6

Score vs. Winrate in Score-Based Games: which Reward for Reinforcement Learning?

Authors: Luca Pasqualini, Gianluca Amato, Marco Fantozzi, Rosa Gini, Alessandro Marchetti, Carlo Metta, Francesco Morandin, Maurizio Parton

Abstract: In the last years, the DeepMind algorithm AlphaZero has become the state of the art to efficiently tackle perfect information two-player zero-sum games with a win/lose outcome. However, when the win/lose outcome is decided by a final score difference, AlphaZero may play score-suboptimal moves because all winning final positions are equivalent from the win/lose outcome perspective. This can be an i… ▽ More In the last years, the DeepMind algorithm AlphaZero has become the state of the art to efficiently tackle perfect information two-player zero-sum games with a win/lose outcome. However, when the win/lose outcome is decided by a final score difference, AlphaZero may play score-suboptimal moves because all winning final positions are equivalent from the win/lose outcome perspective. This can be an issue, for instance when used for teaching, or when trying to understand whether there is a better move. Moreover, there is the theoretical quest for the perfect game. A naive approach would be training an AlphaZero-like agent to predict score differences instead of win/lose outcomes. Since the game of Go is deterministic, this should as well produce an outcome-optimal play. However, it is a folklore belief that "this does not work". In this paper, we first provide empirical evidence for this belief. We then give a theoretical interpretation of this suboptimality in general perfect information two-player zero-sum game where the complexity of a game like Go is replaced by the randomness of the environment. We show that an outcome-optimal policy has a different preference for uncertainty when it is winning or losing. In particular, when in a losing state, an outcome-optimal agent chooses actions leading to a higher score variance. We then posit that when approximation is involved, a deterministic game behaves like a nondeterministic game, where the score variance is modeled by how uncertain the position is. We validate this hypothesis in AlphaZero-like software with a human expert. △ Less

Submitted 9 January, 2023; v1 submitted 31 January, 2022; originally announced January 2022.

Comments: Published at 2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA). This version (v2) is a major revision and superseeds version v1

ACM Class: I.2.6

Linear Stochastic Dyadic model

Authors: Luigi Amedeo Bianchi, Francesco Morandin

Abstract: We discuss a stochastic interacting particles' system connected to dyadic models of turbulence, defining suitable classes of solutions and proving their existence and uniqueness. We investigate the regularity of a particular family of solutions, called moderate, and we conclude with existence and uniqueness of invariant measures associated with such moderate solutions. We discuss a stochastic interacting particles' system connected to dyadic models of turbulence, defining suitable classes of solutions and proving their existence and uniqueness. We investigate the regularity of a particular family of solutions, called moderate, and we conclude with existence and uniqueness of invariant measures associated with such moderate solutions. △ Less

Submitted 27 October, 2020; originally announced October 2020.

A mathematical framework for raw counts of single-cell RNA-seq data analysis

Authors: Silvia Giulia Galfre', Francesco Morandin

Abstract: Single-cell RNA-seq data are challenging because of the sparseness of the read counts, the tiny expression of many relevant genes, and the variability in the efficiency of RNA extraction for different cells. We consider a simple probabilistic model for read counts, based on a negative binomial distribution for each gene, modified by a cell-dependent coefficient interpreted as an extraction efficie… ▽ More Single-cell RNA-seq data are challenging because of the sparseness of the read counts, the tiny expression of many relevant genes, and the variability in the efficiency of RNA extraction for different cells. We consider a simple probabilistic model for read counts, based on a negative binomial distribution for each gene, modified by a cell-dependent coefficient interpreted as an extraction efficiency. We provide two alternative fast methods to estimate the model parameters, together with the probability that a cell results in zero read counts for a gene. This allows to measure genes co-expression and differential expression in a novel way. △ Less

Submitted 7 February, 2020; originally announced February 2020.

Comments: 22 pages, 4 figures

MSC Class: 62P10 (Primary); 92B05 (Secondary

SAI: a Sensible Artificial Intelligence that plays with handicap and targets high scores in 9x9 Go (extended version)

Authors: Francesco Morandin, Gianluca Amato, Marco Fantozzi, Rosa Gini, Carlo Metta, Maurizio Parton

Abstract: We develop a new model that can be applied to any perfect information two-player zero-sum game to target a high score, and thus a perfect play. We integrate this model into the Monte Carlo tree search-policy iteration learning pipeline introduced by Google DeepMind with AlphaGo. Training this model on 9x9 Go produces a superhuman Go player, thus proving that it is stable and robust. We show that t… ▽ More We develop a new model that can be applied to any perfect information two-player zero-sum game to target a high score, and thus a perfect play. We integrate this model into the Monte Carlo tree search-policy iteration learning pipeline introduced by Google DeepMind with AlphaGo. Training this model on 9x9 Go produces a superhuman Go player, thus proving that it is stable and robust. We show that this model can be used to effectively play with both positional and score handicap, and to minimize suboptimal moves. We develop a family of agents that can target high scores against any opponent, and recover from very severe disadvantage against weak opponents. To the best of our knowledge, these are the first effective achievements in this direction. △ Less

Submitted 26 November, 2019; v1 submitted 26 May, 2019; originally announced May 2019.

Comments: Added Section 4.4 on minimization of suboptimal moves. Improved Section 5 on future developments. Minor corrections

MSC Class: I.2.6 ACM Class: I.2.6

SAI, a Sensible Artificial Intelligence that plays Go

Authors: Francesco Morandin, Gianluca Amato, Rosa Gini, Carlo Metta, Maurizio Parton, Gian-Carlo Pascutto

Abstract: We propose a multiple-komi modification of the AlphaGo Zero/Leela Zero paradigm. The winrate as a function of the komi is modeled with a two-parameters sigmoid function, so that the neural network must predict just one more variable to assess the winrate for all komi values. A second novel feature is that training is based on self-play games that occasionally branch -- with changed komi -- when th… ▽ More We propose a multiple-komi modification of the AlphaGo Zero/Leela Zero paradigm. The winrate as a function of the komi is modeled with a two-parameters sigmoid function, so that the neural network must predict just one more variable to assess the winrate for all komi values. A second novel feature is that training is based on self-play games that occasionally branch -- with changed komi -- when the position is uneven. With this setting, reinforcement learning is showed to work on 7x7 Go, obtaining very strong playing agents. As a useful byproduct, the sigmoid parameters given by the network allow to estimate the score difference on the board, and to evaluate how much the game is decided. △ Less

Submitted 1 May, 2019; v1 submitted 11 September, 2018; originally announced September 2018.

Comments: Updated for IJCNN 2019 conference

Journal ref: 2019 International Joint Conference on Neural Networks (IJCNN)

Structure function and fractal dissipation for an intermittent inviscid dyadic model

Authors: Luigi Amedeo Bianchi, Francesco Morandin

Abstract: We study a generalization of the original tree-indexed dyadic model by Katz and Pavlović for the turbulent energy cascade of three-dimensional Euler equation. We allow the coefficients to vary with some restrictions, thus giving the model a realistic spatial intermittency. By introducing a forcing term on the first component, the fixed point of the dynamics is well defined and some explicit comput… ▽ More We study a generalization of the original tree-indexed dyadic model by Katz and Pavlović for the turbulent energy cascade of three-dimensional Euler equation. We allow the coefficients to vary with some restrictions, thus giving the model a realistic spatial intermittency. By introducing a forcing term on the first component, the fixed point of the dynamics is well defined and some explicit computations allow to prove the rich multifractal structure of the solution. In particular the exponent of the structure function is concave in accordance with other theoretical and experimental models. Moreover anomalous energy dissipation happens in a fractal set of dimension strictly less than 3. △ Less

Submitted 15 June, 2017; v1 submitted 5 July, 2016; originally announced July 2016.

Comments: 33 pages, 2 figures

Journal ref: Comm. Math. Phys. 356 (2017), no. 1, 231--260

Global regularity for a slightly supercritical hyperdissipative Navier-Stokes system

Authors: David Barbato, Francesco Morandin, Marco Romito

Abstract: We prove global existence of smooth solutions for a slightly supercritical hyperdissipative Navier--Stokes under the optimal condition on the correction to the dissipation. This proves a conjecture formulated by Tao [Tao2009]. We prove global existence of smooth solutions for a slightly supercritical hyperdissipative Navier--Stokes under the optimal condition on the correction to the dissipation. This proves a conjecture formulated by Tao [Tao2009]. △ Less

Submitted 24 July, 2014; originally announced July 2014.

Journal ref: Anal. PDE 7 (2014) 2009-2027

Global regularity for a logarithmically supercritical hyperdissipative dyadic equation

Authors: David Barbato, Francesco Morandin, Marco Romito

Abstract: We prove global existence of smooth solutions for a slightly supercritical dyadic model. We consider a generalized version of the dyadic model introduced by Katz-Pavlovic [2005] and add a viscosity term with critical exponent and a supercritical correction. This model catches for the dyadic a conjecture that for Navier-Stokes equations was formulated by Tao [2009]. We prove global existence of smooth solutions for a slightly supercritical dyadic model. We consider a generalized version of the dyadic model introduced by Katz-Pavlovic [2005] and add a viscosity term with critical exponent and a supercritical correction. This model catches for the dyadic a conjecture that for Navier-Stokes equations was formulated by Tao [2009]. △ Less

Submitted 18 March, 2014; v1 submitted 12 March, 2014; originally announced March 2014.

MSC Class: Primary 76D03; Secondary 35Q35; 35Q30; 76D05; 35Q31

Stochastic inviscid shell models: well-posedness and anomalous dissipation

Authors: D. Barbato, F. Morandin

Abstract: In this paper we study a stochastic version of an inviscid shell model of turbulence with multiplicative noise. The deterministic counterpart of this model is quite general and includes inviscid GOY and Sabra shell models of turbulence. We prove global weak existence and uniqueness of solutions for any finite energy initial condition. Moreover energy dissipation of the system is proved in spite of… ▽ More In this paper we study a stochastic version of an inviscid shell model of turbulence with multiplicative noise. The deterministic counterpart of this model is quite general and includes inviscid GOY and Sabra shell models of turbulence. We prove global weak existence and uniqueness of solutions for any finite energy initial condition. Moreover energy dissipation of the system is proved in spite of its formal energy conservation. △ Less

Submitted 13 December, 2012; v1 submitted 13 November, 2012; originally announced November 2012.

Comments: v2 has updated introduction

MSC Class: 60H15

A dyadic model on a tree

Authors: David Barbato, Luigi Amedeo Bianchi, Franco Flandoli, Francesco Morandin

Abstract: We study an infinite system of non-linear differential equations coupled in a tree-like structure. This system was previously introduced in the literature and it is the model from which the dyadic shell model of turbulence was derived. It mimics 3d Euler and Navier-Stokes equations in a rough approximation of a wavelet decomposition. We prove existence of finite energy solutions, anomalous dissipa… ▽ More We study an infinite system of non-linear differential equations coupled in a tree-like structure. This system was previously introduced in the literature and it is the model from which the dyadic shell model of turbulence was derived. It mimics 3d Euler and Navier-Stokes equations in a rough approximation of a wavelet decomposition. We prove existence of finite energy solutions, anomalous dissipation in the inviscid unforced case, existence and uniqueness of stationary solutions (either conservative or not) in the forced case. △ Less

Submitted 12 July, 2012; originally announced July 2012.

Journal ref: Journal of Mathematical Physics 54, 021507 (2013)

Positive and non-positive solutions for an inviscid dyadic model. Well-posedness and regularity

Authors: David Barbato, Francesco Morandin

Abstract: We improve regolarity and uniqueness results from the literature for the inviscid dyadic model. We show that positive dyadic is globally well-posed for every rate of growth $β$ of the scaling coefficients k_n = 2^{bn}. Some regularity results are proved for positive solutions, namely \sup_n n^{-a} k_n^{1/3} X_n(t) < \infty for a.e. t and \sup_n k_n^{1/3-1/(3b)} X_n(t) \leq C t^{-1/3}$ for all $t$.… ▽ More We improve regolarity and uniqueness results from the literature for the inviscid dyadic model. We show that positive dyadic is globally well-posed for every rate of growth $β$ of the scaling coefficients k_n = 2^{bn}. Some regularity results are proved for positive solutions, namely \sup_n n^{-a} k_n^{1/3} X_n(t) < \infty for a.e. t and \sup_n k_n^{1/3-1/(3b)} X_n(t) \leq C t^{-1/3}$ for all $t$. Moreover it is shown that under very general hypothesis, solutions become positive after a finite time. △ Less

Submitted 12 January, 2012; originally announced January 2012.

Smooth solutions for the dyadic model

Authors: David Barbato, Francesco Morandin, Marco Romito

Abstract: We consider the dyadic model, which is a toy model to test issues of well-posedness and blow-up for the Navier-Stokes and Euler equations. We prove well-posedness of positive solutions of the viscous problem in the relevant scaling range which corresponds to Navier-Stokes. Likewise we prove well-posedness for the inviscid problem (in a suitable regularity class) when the parameter corresponds to t… ▽ More We consider the dyadic model, which is a toy model to test issues of well-posedness and blow-up for the Navier-Stokes and Euler equations. We prove well-posedness of positive solutions of the viscous problem in the relevant scaling range which corresponds to Navier-Stokes. Likewise we prove well-posedness for the inviscid problem (in a suitable regularity class) when the parameter corresponds to the strongest transport effect of the non-linearity. △ Less

Submitted 20 July, 2010; originally announced July 2010.

MSC Class: Primary 76D03; 76B03; Secondary 35Q35; 35Q30; 76D05; 35Q31

Anomalous dissipation in a stochastic inviscid dyadic model

Authors: David Barbato, Franco Flandoli, Francesco Morandin

Abstract: A stochastic version of an inviscid dyadic model of turbulence, with multiplicative noise, is proved to exhibit energy dissipation in spite of the formal energy conservation. As a consequence, global regular solutions cannot exist. After some reductions, the main tool is the escape bahavior at infinity of a certain birth and death process. A stochastic version of an inviscid dyadic model of turbulence, with multiplicative noise, is proved to exhibit energy dissipation in spite of the formal energy conservation. As a consequence, global regular solutions cannot exist. After some reductions, the main tool is the escape bahavior at infinity of a certain birth and death process. △ Less

Submitted 21 February, 2012; v1 submitted 6 July, 2010; originally announced July 2010.

Comments: Published in at http://dx.doi.org/10.1214/11-AAP768 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP768

Journal ref: Annals of Applied Probability 2011, Vol. 21, No. 6, 2424-2446

Well Posedness for Positive Dyadic Model

Authors: David Barbato, Franco Flandoli, Francesco Morandin

Abstract: We consider the solutions of the Cauchy problem for a dyadic model of Euler equations. We prove global existence and uniqueness of Leray-Hopf solutions in a rather large class K that implies in particular global existence and uniqueness in l^2 for all initial positive conditions in l^2. We consider the solutions of the Cauchy problem for a dyadic model of Euler equations. We prove global existence and uniqueness of Leray-Hopf solutions in a rather large class K that implies in particular global existence and uniqueness in l^2 for all initial positive conditions in l^2. △ Less

Submitted 26 October, 2009; originally announced October 2009.

Comments: 6 pages, no figures. Submitted to Les Comptes Rendus de l'Academie des sciences

MSC Class: 76B03; 35Q31

Uniqueness for a Stochastic Inviscid Dyadic Model

Authors: David Barbato, Franco Flandoli, Francesco Morandin

Abstract: For the deterministic dyadic model of turbulence, there are examples of initial conditions in $l^2$ which have more than one solution. The aim of this paper is to prove that uniqueness, for all $l^2$-initial conditions, is restored when a suitable multiplicative noise is introduced. The noise is formally energy preserving. Uniqueness is understood in the weak probabilistic sense. For the deterministic dyadic model of turbulence, there are examples of initial conditions in $l^2$ which have more than one solution. The aim of this paper is to prove that uniqueness, for all $l^2$-initial conditions, is restored when a suitable multiplicative noise is introduced. The noise is formally energy preserving. Uniqueness is understood in the weak probabilistic sense. △ Less

Submitted 26 October, 2009; originally announced October 2009.

Comments: 13 pages, no figures. Submitted to the Proceedings of the American Mathematical Society

MSC Class: 60H15; 35Q31; 35R60; 76B03; 76M35

Energy dissipation and self-similar solutions for an unforced inviscid dyadic model

Authors: D. Barbato, F. Flandoli, F. Morandin

Abstract: A shell-type model of an inviscid fluid, previously considered in the literature, is investigated in absence of external force. Energy dissipation of positive solutions is proved and decay of energy like $t^{-2}$ is established. Self-similar decaying positive solutions are introduced and proved to exist and classified. Coalescence and blow-up are obtained as a consequence, in the class of arbitr… ▽ More A shell-type model of an inviscid fluid, previously considered in the literature, is investigated in absence of external force. Energy dissipation of positive solutions is proved and decay of energy like $t^{-2}$ is established. Self-similar decaying positive solutions are introduced and proved to exist and classified. Coalescence and blow-up are obtained as a consequence, in the class of arbitrary sign solutions. △ Less

Submitted 11 November, 2008; originally announced November 2008.

Comments: 30 pages, submitted to Trans. Amer. Math. Soc

MSC Class: 35Q30; 35Q35; 76B03