-
Learning Multi-Frequency Partial Correlation Graphs
Authors:
Gabriele D'Acunto,
Paolo Di Lorenzo,
Francesco Bonchi,
Stefania Sardellitti,
Sergio Barbarossa
Abstract:
Despite the large research effort devoted to learning dependencies between time series, the state of the art still faces a major limitation: existing methods learn partial correlations but fail to discriminate across distinct frequency bands. Motivated by many applications in which this differentiation is pivotal, we overcome this limitation by learning a block-sparse, frequency-dependent, partial…
▽ More
Despite the large research effort devoted to learning dependencies between time series, the state of the art still faces a major limitation: existing methods learn partial correlations but fail to discriminate across distinct frequency bands. Motivated by many applications in which this differentiation is pivotal, we overcome this limitation by learning a block-sparse, frequency-dependent, partial correlation graph, in which layers correspond to different frequency bands, and partial correlations can occur over just a few layers. To this aim, we formulate and solve two nonconvex learning problems: the first has a closed-form solution and is suitable when there is prior knowledge about the number of partial correlations; the second hinges on an iterative solution based on successive convex approximation, and is effective for the general case where no prior knowledge is available. Numerical results on synthetic data show that the proposed methods outperform the current state of the art. Finally, the analysis of financial time series confirms that partial correlations exist only within a few frequency bands, underscoring how our methods enable the gaining of valuable insights that would be undetected without discriminating along the frequency domain.
△ Less
Submitted 12 May, 2024; v1 submitted 27 November, 2023;
originally announced November 2023.
-
Semantic Communications Based on Adaptive Generative Models and Information Bottleneck
Authors:
S. Barbarossa,
D. Comminiello,
E. Grassucci,
F. Pezone,
S. Sardellitti,
P. Di Lorenzo
Abstract:
Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In semantic communications, the scope of the destination is not to recover a list of symbols symbolically identical to the transmitted ones, but rather to recover a me…
▽ More
Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In semantic communications, the scope of the destination is not to recover a list of symbols symbolically identical to the transmitted ones, but rather to recover a message that is semantically equivalent to the semantic message emitted by the source. This paradigm shift introduces many degrees of freedom to the encoding and decoding rules that can be exploited to make the design of communication systems much more efficient. In this paper, we present an approach to semantic communication building on three fundamental ideas: 1) represent data over a topological space as a formal way to capture semantics, as expressed through relations; 2) use the information bottleneck principle as a way to identify relevant information and adapt the information bottleneck online, as a function of the wireless channel state, in order to strike an optimal trade-off between transmit power, reconstruction accuracy and delay; 3) exploit probabilistic generative models as a general tool to adapt the transmission rate to the wireless channel state and make possible the regeneration of the transmitted images or run classification tasks at the receiver side.
△ Less
Submitted 5 September, 2023;
originally announced September 2023.
-
Topological Signal Processing over Weighted Simplicial Complexes
Authors:
Claudio Battiloro,
Stefania Sardellitti,
Sergio Barbarossa,
Paolo Di Lorenzo
Abstract:
Weighing the topological domain over which data can be represented and analysed is a key strategy in many signal processing and machine learning applications, enabling the extraction and exploitation of meaningful data features and their (higher order) relationships. Our goal in this paper is to present topological signal processing tools for weighted simplicial complexes. Specifically, relying on…
▽ More
Weighing the topological domain over which data can be represented and analysed is a key strategy in many signal processing and machine learning applications, enabling the extraction and exploitation of meaningful data features and their (higher order) relationships. Our goal in this paper is to present topological signal processing tools for weighted simplicial complexes. Specifically, relying on the weighted Hodge Laplacian theory, we propose efficient strategies to jointly learn the weights of the complex and the filters for the solenoidal, irrotational and harmonic components of the signals defined over the complex. We numerically asses the effectiveness of the proposed procedures.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
Topological Signal Processing over Generalized Cell Complexes
Authors:
Stefania Sardellitti,
Sergio Barbarossa
Abstract:
Topological Signal Processing (TSP) over simplicial complexes is a framework that has been recently proposed, as a generalization of graph signal processing (GSP), to extend GSP to analyzing signals defined over sets of any order (i.e., not only vertices of a graph) and to capture multiway relations of any order among the data. However, simplicial complexes are required to satisfy the so-called in…
▽ More
Topological Signal Processing (TSP) over simplicial complexes is a framework that has been recently proposed, as a generalization of graph signal processing (GSP), to extend GSP to analyzing signals defined over sets of any order (i.e., not only vertices of a graph) and to capture multiway relations of any order among the data. However, simplicial complexes are required to satisfy the so-called inclusion property, according to which, if a set belongs to the complex, then all its subsets must also belong to the complex. In some applications, this is a severe limitation. To overcome this limit, in this paper we extend TSP to deal with signals defined over cell complexes and we also generalize the concept of cell complexes to include hollow cells. We show that, even if the algebraic formulation does not change significantly, the extension to the generalized cell complexes considerably broadens the number of applications. Most important, the new representation provides a much better trade-off between the complexity of the representation and its accuracy. In addition, we propose a method to infer the structure of the cell complex from data and we propose distributed filtering strategies, including a method to retrieve the sparsest representation of the harmonic component. We quantify the advantages of using cell complexes instead of simplicial complexes, in terms of the complexity/accuracy trade-off, for different applications such image segmentation and recovering of real flows measured on data traffic and transportation networks.
△ Less
Submitted 8 October, 2023; v1 submitted 22 January, 2022;
originally announced January 2022.
-
Topological Signal Processing over Cell Complexes
Authors:
Stefania Sardellitti,
Sergio Barbarossa,
Lucia Testa
Abstract:
The Topological Signal Processing (TSP) framework has been recently developed to analyze signals defined over simplicial complexes, i.e. topological spaces represented by finite sets of elements that are closed under inclusion of subsets [1]. However, the same inclusion property represents sometimes a too rigid assumption that prevents the application of simplicial complexes to many cases of inter…
▽ More
The Topological Signal Processing (TSP) framework has been recently developed to analyze signals defined over simplicial complexes, i.e. topological spaces represented by finite sets of elements that are closed under inclusion of subsets [1]. However, the same inclusion property represents sometimes a too rigid assumption that prevents the application of simplicial complexes to many cases of interest. The goal of this paper is to extend TSP to the analysis of signals defined over cell complexes, which represent a generalization of simplicial complexes, as they are not restricted to satisfy the inclusion property. In particular, the richer topological structure of cell complexes enables them to reveal cycles of any order, as representative of data features. We propose an efficient method to infer the topology of cell complexes from data by showing how their use enables sparser edge signal representations than simplicial-based methods. Furthermore, we show how to design optimal finite impulse response (FIR) filters operating on solenoidal and irrotational signals in order to minimize the approximation error with respect to the desired spectral masks.
△ Less
Submitted 13 December, 2021;
originally announced December 2021.
-
Topological Signal Processing over Simplicial Complexes
Authors:
Sergio Barbarossa,
Stefania Sardellitti
Abstract:
The goal of this paper is to establish the fundamental tools to analyze signals defined over a topological space, i.e. a set of points along with a set of neighborhood relations. This setup does not require the definition of a metric and then it is especially useful to deal with signals defined over non-metric spaces. We focus on signals defined over simplicial complexes. Graph Signal Processing (…
▽ More
The goal of this paper is to establish the fundamental tools to analyze signals defined over a topological space, i.e. a set of points along with a set of neighborhood relations. This setup does not require the definition of a metric and then it is especially useful to deal with signals defined over non-metric spaces. We focus on signals defined over simplicial complexes. Graph Signal Processing (GSP) represents a special case of Topological Signal Processing (TSP), referring to the situation where the signals are associated only with the vertices of a graph. Even though the theory can be applied to signals of any order, we focus on signals defined over the edges of a graph and show how building a simplicial complex of order two, i.e. including triangles, yields benefits in the analysis of edge signals. After reviewing the basic principles of algebraic topology, we derive a sampling theory for signals of any order and emphasize the interplay between signals of different order. Then we propose a method to infer the topology of a simplicial complex from data. We conclude with applications to real edge signals and to the analysis of discrete vector fields to illustrate the benefits of the proposed methodologies.
△ Less
Submitted 13 March, 2020; v1 submitted 26 July, 2019;
originally announced July 2019.
-
Graph topology inference based on sparsifying transform learning
Authors:
Stefania Sardellitti,
Sergio Barbarossa,
Paolo Di Lorenzo
Abstract:
Graph-based representations play a key role in machine learning. The fundamental step in these representations is the association of a graph structure to a dataset. In this paper, we propose a method that aims at finding a block sparse representation of the graph signal leading to a modular graph whose Laplacian matrix admits the found dictionary as its eigenvectors. The role of sparsity here is t…
▽ More
Graph-based representations play a key role in machine learning. The fundamental step in these representations is the association of a graph structure to a dataset. In this paper, we propose a method that aims at finding a block sparse representation of the graph signal leading to a modular graph whose Laplacian matrix admits the found dictionary as its eigenvectors. The role of sparsity here is to induce a band-limited representation or, equivalently, a modular structure of the graph. The proposed strategy is composed of two optimization steps: i) learning an orthonormal sparsifying transform from the data; ii) recovering the Laplacian, and then topology, from the transform. The first step is achieved through an iterative algorithm whose alternating intermediate solutions are expressed in closed form. The second step recovers the Laplacian matrix from the sparsifying transform through a convex optimization method. Numerical results corroborate the effectiveness of the proposed methods over both synthetic data and real brain data, used for inferring the brain functionality network through experiments conducted over patients affected by epilepsy.
△ Less
Submitted 5 June, 2018;
originally announced June 2018.
-
The edge cloud: A holistic view of communication, computation and caching
Authors:
Sergio Barbarossa,
Stefania Sardellitti,
Elena Ceci,
Mattia Merluzzi
Abstract:
The evolution of communication networks shows a clear shift of focus from just improving the communications aspects to enabling new important services, from Industry 4.0 to automated driving, virtual/augmented reality, Internet of Things (IoT), and so on. This trend is evident in the roadmap planned for the deployment of the fifth generation (5G) communication networks. This ambitious goal require…
▽ More
The evolution of communication networks shows a clear shift of focus from just improving the communications aspects to enabling new important services, from Industry 4.0 to automated driving, virtual/augmented reality, Internet of Things (IoT), and so on. This trend is evident in the roadmap planned for the deployment of the fifth generation (5G) communication networks. This ambitious goal requires a paradigm shift towards a vision that looks at communication, computation and caching (3C) resources as three components of a single holistic system. The further step is to bring these 3C resources closer to the mobile user, at the edge of the network, to enable very low latency and high reliability services. The scope of this chapter is to show that signal processing techniques can play a key role in this new vision. In particular, we motivate the joint optimization of 3C resources. Then we show how graph-based representations can play a key role in building effective learning methods and devising innovative resource allocation techniques.
△ Less
Submitted 2 February, 2018;
originally announced February 2018.
-
Adaptive Least Mean Squares Estimation of Graph Signals
Authors:
Paolo Di Lorenzo,
Sergio Barbarossa,
Paolo Banelli,
Stefania Sardellitti
Abstract:
The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of observations over a subset of vertices. A detailed mean square analysi…
▽ More
The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of observations over a subset of vertices. A detailed mean square analysis provides the performance of the proposed method, and leads to several insights for designing useful sampling strategies for graph signals. Numerical results validate our theoretical findings, and illustrate the performance of the proposed method. Furthermore, to cope with the case where the bandwidth is not known beforehand, we propose a method that performs a sparse online estimation of the signal support in the (graph) frequency domain, which enables online adaptation of the graph sampling strategy. Finally, we apply the proposed method to build the power spatial density cartography of a given operational region in a cognitive network environment.
△ Less
Submitted 11 July, 2016; v1 submitted 18 February, 2016;
originally announced February 2016.
