-
Graph Based Semi-supervised Learning Using Spatial Segregation Theory
Authors:
Farid Bozorgnia,
Morteza Fotouhi,
Avetik Arakelyan,
Abderrahim Elmoataz
Abstract:
In this work we address graph based semi-supervised learning using the theory of the spatial segregation of competitive systems. First, we define a discrete counterpart over connected graphs by using direct analogue of the corresponding competitive system. This model turns out doesn't have a unique solution as we expected. Nevertheless, we suggest gradient projected and regularization methods to r…
▽ More
In this work we address graph based semi-supervised learning using the theory of the spatial segregation of competitive systems. First, we define a discrete counterpart over connected graphs by using direct analogue of the corresponding competitive system. This model turns out doesn't have a unique solution as we expected. Nevertheless, we suggest gradient projected and regularization methods to reach some of the solutions. Then we focus on a slightly different model motivated from the recent numerical results on the spatial segregation of reaction-diffusion systems. In this case we show that the model has a unique solution and propose a novel classification algorithm based on it. Finally, we present numerical experiments showing the method is efficient and comparable to other semi-supervised learning algorithms at high and low label rates.
△ Less
Submitted 29 November, 2022;
originally announced November 2022.
-
Variational models for signal processing with Graph Neural Networks
Authors:
Amitoz Azad,
Julien Rabin,
Abderrahim Elmoataz
Abstract:
This paper is devoted to signal processing on point-clouds by means of neural networks. Nowadays, state-of-the-art in image processing and computer vision is mostly based on training deep convolutional neural networks on large datasets. While it is also the case for the processing of point-clouds with Graph Neural Networks (GNN), the focus has been largely given to high-level tasks such as classif…
▽ More
This paper is devoted to signal processing on point-clouds by means of neural networks. Nowadays, state-of-the-art in image processing and computer vision is mostly based on training deep convolutional neural networks on large datasets. While it is also the case for the processing of point-clouds with Graph Neural Networks (GNN), the focus has been largely given to high-level tasks such as classification and segmentation using supervised learning on labeled datasets such as ShapeNet. Yet, such datasets are scarce and time-consuming to build depending on the target application. In this work, we investigate the use of variational models for such GNN to process signals on graphs for unsupervised learning. Our contributions are two-fold. We first show that some existing variational-based algorithms for signals on graphs can be formulated as Message Passing Networks (MPN), a particular instance of GNN, making them computationally efficient in practice when compared to standard gradient-based machine learning algorithms. Secondly, we investigate the unsupervised learning of feed-forward GNN, either by direct optimization of an inverse problem or by model distillation from variational-based MPN.
Keywords:Graph Processing. Neural Network. Total Variation. Variational Methods. Message Passing Network. Unsupervised learning
△ Less
Submitted 3 April, 2021; v1 submitted 30 March, 2021;
originally announced March 2021.
-
Continuum limit of $p$-Laplacian evolution problems on graphs:$L^q$ graphons and sparse graphs
Authors:
Imad El Bouchairi,
Jalal Fadili,
Abderrahim Elmoataz
Abstract:
In this paper we study continuum limits of the discretized $p$-Laplacian evolution problem on sparse graphs with homogeneous Neumann boundary conditions. This extends the results of [24] to a far more general class of kernels, possibly singular, and graph sequences whose limit are the so-called $L^q$-graphons. More precisely, we derive a bound on the distance between two continuous-in-time traject…
▽ More
In this paper we study continuum limits of the discretized $p$-Laplacian evolution problem on sparse graphs with homogeneous Neumann boundary conditions. This extends the results of [24] to a far more general class of kernels, possibly singular, and graph sequences whose limit are the so-called $L^q$-graphons. More precisely, we derive a bound on the distance between two continuous-in-time trajectories defined by two different evolution systems (i.e. with different kernels, second member and initial data). Similarly, we provide a bound in the case that one of the trajectories is discrete-in-time and the other is continuous. In turn, these results lead us to establish error estimates of the full discretization of the $p$-Laplacian problem on sparse random graphs. In particular, we provide rate of convergence of solutions for the discrete models to the solution of the continuous problem as the number of vertices grows.
△ Less
Submitted 16 October, 2020;
originally announced October 2020.
-
Nonlocal $p$-Laplacian Variational problems on graphs
Authors:
Yosra Hafiene,
Jalal Fadili,
Abderrahim Elmoataz
Abstract:
In this paper, we study a nonlocal variational problem which consists of minimizing in $L^2$ the sum of a quadratic data fidelity and a regularization term corresponding to the $L^p$-norm of the nonlocal gradient. In particular, we study convergence of the numerical solution to a discrete version of this nonlocal variational problem to the unique solution of the continuum one. To do so, we derive…
▽ More
In this paper, we study a nonlocal variational problem which consists of minimizing in $L^2$ the sum of a quadratic data fidelity and a regularization term corresponding to the $L^p$-norm of the nonlocal gradient. In particular, we study convergence of the numerical solution to a discrete version of this nonlocal variational problem to the unique solution of the continuum one. To do so, we derive an error bound and highlight the role of the initial data and the kernel governing the nonlocal interactions. When applied to variational problem on graphs, this error bound allows us to show the consistency of the discretized variational problem as the number of vertices goes to infinity. More precisely, for networks in convergent graph sequences (simple and weighted deterministic dense graphs as well as random inhomogeneous graphs), we prove convergence and provide rate of convergence of solutions for the discrete models to the solution of the continuum problem as the number of vertices grows.
△ Less
Submitted 20 August, 2019; v1 submitted 30 October, 2018;
originally announced October 2018.
-
Continuum limit of the nonlocal p-Laplacian evolution problem on random inhomogeneous graphs
Authors:
Yosra Hafiene,
Jalal Fadini,
Christophe Chesneau,
Abderrahim Elmoataz
Abstract:
In this paper we study numerical approximations of the evolution problem for the nonlocal $p$-Laplacian operator with homogeneous Neumann boundary conditions on inhomogeneous random convergent graph sequences. More precisely, for networks on convergent inhomogeneous random graph sequences (generated first by deterministic and then random node sequences), we establish their continuum limits and pro…
▽ More
In this paper we study numerical approximations of the evolution problem for the nonlocal $p$-Laplacian operator with homogeneous Neumann boundary conditions on inhomogeneous random convergent graph sequences. More precisely, for networks on convergent inhomogeneous random graph sequences (generated first by deterministic and then random node sequences), we establish their continuum limits and provide rate of convergence of solutions for the discrete models to their continuum counterparts as the number of vertices grows. Our bounds reveals the role of the different parameters, and in particular that of $p$ and the geometry/regularity of the data.
△ Less
Submitted 4 May, 2018;
originally announced May 2018.
-
Nonlocal $p$-Laplacian evolution problems on graphs
Authors:
Hafiene Yosra,
Jalal Fadili,
Abderrahim Elmoataz
Abstract:
In this paper we study numerical approximations of the evolution problem for the nonlocal $p$-Laplacian with homogeneous Neumann boundary conditions. First, we derive a bound on the distance between two continuous-in-time trajectories defined by two different evolution systems (i.e. with different kernels and initial data). We then provide a similar bound for the case when one of the trajectories…
▽ More
In this paper we study numerical approximations of the evolution problem for the nonlocal $p$-Laplacian with homogeneous Neumann boundary conditions. First, we derive a bound on the distance between two continuous-in-time trajectories defined by two different evolution systems (i.e. with different kernels and initial data). We then provide a similar bound for the case when one of the trajectories is discrete-in-time and the other is continuous. In turn, these results allow us to establish error estimates of the discretized $p$-Laplacian problem on graphs. More precisely, for networks on convergent graph sequences (simple and weighted graphs), we prove convergence and provide rate of convergence of solutions for the discrete models to the solution of the continuous problem as the number of vertices grows. We finally touch on the limit as $p \to \infty$ in these approximations and get uniform convergence results.
△ Less
Submitted 26 April, 2019; v1 submitted 21 December, 2016;
originally announced December 2016.
