-
Modeling Sparse Graph Sequences and Signals Using Generalized Graphons
Authors:
Feng Ji,
Xingchao Jian,
Wee Peng Tay
Abstract:
Graphons are limit objects of sequences of graphs and are used to analyze the behavior of large graphs. Recently, graphon signal processing has been developed to study signal processing on large graphs. A major limitation of this approach is that any sparse sequence of graphs inevitably converges to the zero graphon, rendering the resulting signal processing theory trivial and inadequate for spars…
▽ More
Graphons are limit objects of sequences of graphs and are used to analyze the behavior of large graphs. Recently, graphon signal processing has been developed to study signal processing on large graphs. A major limitation of this approach is that any sparse sequence of graphs inevitably converges to the zero graphon, rendering the resulting signal processing theory trivial and inadequate for sparse graph sequences. To overcome this limitation, we propose a new signal processing framework that leverages the concept of generalized graphons and introduces the stretched cut distance as a measure to compare these graphons. Our framework focuses on the sampling of graph sequences from generalized graphons and explores the convergence properties of associated operators, spectra, and signals. Our signal processing framework provides a comprehensive approach to analyzing and processing signals on graph sequences, even if they are sparse. Finally, we discuss the practical implications of our theory for real-world large networks through numerical experiments.
△ Less
Submitted 23 March, 2024; v1 submitted 13 December, 2023;
originally announced December 2023.
-
A sampling construction of graphon 1-norm convergence
Authors:
Xingchao Jian,
Feng Ji,
Wee Peng Tay
Abstract:
In the short note, we describe a sampling construction that yields a sequence of graphons converging to a prescribed limit graphon in 1-norm. This convergence is stronger than the convergence in the cut norm, usually used to study graphon sequences. The note also contains errata of the previous version of the note.
In the short note, we describe a sampling construction that yields a sequence of graphons converging to a prescribed limit graphon in 1-norm. This convergence is stronger than the convergence in the cut norm, usually used to study graphon sequences. The note also contains errata of the previous version of the note.
△ Less
Submitted 30 March, 2024; v1 submitted 23 October, 2023;
originally announced October 2023.
-
Spectral Convergence of Complexon Shift Operators
Authors:
Purui Zhang,
Xingchao Jian,
Feng Ji,
Wee Peng Tay,
Bihan Wen
Abstract:
Topological Signal Processing (TSP) utilizes simplicial complexes to model structures with higher order than vertices and edges. In this paper, we study the transferability of TSP via a generalized higher-order version of graphon, known as complexon. We recall the notion of a complexon as the limit of a simplicial complex sequence [1]. Inspired by the graphon shift operator and message-passing neu…
▽ More
Topological Signal Processing (TSP) utilizes simplicial complexes to model structures with higher order than vertices and edges. In this paper, we study the transferability of TSP via a generalized higher-order version of graphon, known as complexon. We recall the notion of a complexon as the limit of a simplicial complex sequence [1]. Inspired by the graphon shift operator and message-passing neural network, we construct a marginal complexon and complexon shift operator (CSO) according to components of all possible dimensions from the complexon. We investigate the CSO's eigenvalues and eigenvectors and relate them to a new family of weighted adjacency matrices. We prove that when a simplicial complex signal sequence converges to a complexon signal, the eigenvalues, eigenspaces, and Fourier transform of the corresponding CSOs converge to that of the limit complexon signal. This conclusion is further verified by two numerical experiments. These results hint at learning transferability on large simplicial complexes or simplicial complex sequences, which generalize the graphon signal processing framework.
△ Less
Submitted 5 May, 2024; v1 submitted 12 September, 2023;
originally announced September 2023.
-
Generalized Graphon Process: Convergence of Graph Frequencies in Stretched Cut Distance
Authors:
Xingchao Jian,
Feng Ji,
Wee Peng Tay
Abstract:
Graphons have traditionally served as limit objects for dense graph sequences, with the cut distance serving as the metric for convergence. However, sparse graph sequences converge to the trivial graphon under the conventional definition of cut distance, which make this framework inadequate for many practical applications. In this paper, we utilize the concepts of generalized graphons and stretche…
▽ More
Graphons have traditionally served as limit objects for dense graph sequences, with the cut distance serving as the metric for convergence. However, sparse graph sequences converge to the trivial graphon under the conventional definition of cut distance, which make this framework inadequate for many practical applications. In this paper, we utilize the concepts of generalized graphons and stretched cut distance to describe the convergence of sparse graph sequences. Specifically, we consider a random graph process generated from a generalized graphon. This random graph process converges to the generalized graphon in stretched cut distance. We use this random graph process to model the growing sparse graph, and prove the convergence of the adjacency matrices' eigenvalues. We supplement our findings with experimental validation. Our results indicate the possibility of transfer learning between sparse graphs.
△ Less
Submitted 11 September, 2023;
originally announced September 2023.
-
Kernel Based Reconstruction for Generalized Graph Signal Processing
Authors:
Xingchao Jian,
Wee Peng Tay,
Yonina C. Eldar
Abstract:
In generalized graph signal processing (GGSP), the signal associated with each vertex in a graph is an element from a Hilbert space. In this paper, we study GGSP signal reconstruction as a kernel ridge regression (KRR) problem. By devising an appropriate kernel, we show that this problem has a solution that can be evaluated in a distributed way. We interpret the problem and solution using both det…
▽ More
In generalized graph signal processing (GGSP), the signal associated with each vertex in a graph is an element from a Hilbert space. In this paper, we study GGSP signal reconstruction as a kernel ridge regression (KRR) problem. By devising an appropriate kernel, we show that this problem has a solution that can be evaluated in a distributed way. We interpret the problem and solution using both deterministic and Bayesian perspectives and link them to existing graph signal processing and GGSP frameworks. We then provide an online implementation via random Fourier features. Under the Bayesian framework, we investigate the statistical performance under the asymptotic sampling scheme. Finally, we validate our theory and methods on real-world datasets.
△ Less
Submitted 14 August, 2023;
originally announced August 2023.
-
Generalized signals on simplicial complexes
Authors:
Feng Ji,
Xingchao Jian,
Wee Peng Tay,
Maosheng Yang
Abstract:
Topological signal processing (TSP) over simplicial complexes typically assumes observations associated with the simplicial complexes are real scalars. In this paper, we develop TSP theories for the case where observations belong to general abelian groups, including function spaces that are commonly used to represent time-varying signals. Our approach generalizes the Hodge decomposition and allows…
▽ More
Topological signal processing (TSP) over simplicial complexes typically assumes observations associated with the simplicial complexes are real scalars. In this paper, we develop TSP theories for the case where observations belong to general abelian groups, including function spaces that are commonly used to represent time-varying signals. Our approach generalizes the Hodge decomposition and allows for signal processing tasks to be performed on these more complex observations. We propose a unified and flexible framework for TSP that expands its applicability to a wider range of signal processing applications. Numerical results demonstrate the effectiveness of this approach and provide a foundation for future research in this area.
△ Less
Submitted 11 November, 2023; v1 submitted 11 May, 2023;
originally announced May 2023.
-
Graph signal processing with categorical perspective
Authors:
Feng Ji,
Xingchao Jian,
Wee Peng Tay
Abstract:
In this paper, we propose a framework for graph signal processing using category theory. The aim is to generalize a few recent works on probabilistic approaches to graph signal processing, which handle signal and graph uncertainties.
In this paper, we propose a framework for graph signal processing using category theory. The aim is to generalize a few recent works on probabilistic approaches to graph signal processing, which handle signal and graph uncertainties.
△ Less
Submitted 23 February, 2023;
originally announced February 2023.
-
On distributional graph signals
Authors:
Feng Ji,
Xingchao Jian,
Wee Peng Tay
Abstract:
Graph signal processing (GSP) studies graph-structured data, where the central concept is the vector space of graph signals. To study a vector space, we have many useful tools up our sleeves. However, uncertainty is omnipresent in practice, and using a vector to model a real signal can be erroneous in some situations. In this paper, we want to use the Wasserstein space as a replacement for the vec…
▽ More
Graph signal processing (GSP) studies graph-structured data, where the central concept is the vector space of graph signals. To study a vector space, we have many useful tools up our sleeves. However, uncertainty is omnipresent in practice, and using a vector to model a real signal can be erroneous in some situations. In this paper, we want to use the Wasserstein space as a replacement for the vector space of graph signals, to account for signal stochasticity. The Wasserstein is strictly more general in which the classical graph signal space embeds isometrically. An element in the Wasserstein space is called a distributional graph signal. On the other hand, signal processing for a probability space of graphs has been proposed in the literature. In this work, we propose a unified framework that also encompasses existing theories regarding graph uncertainty. We develop signal processing tools to study the new notion of distributional graph signals. We also demonstrate how the theory can be applied by using real datasets.
△ Less
Submitted 21 February, 2023;
originally announced February 2023.
-
Node-wise Domain Adaptation Based on Transferable Attention for Recognizing Road Rage via EEG
Authors:
Gao Xueqi,
Xu Chao,
Song Yihang,
Hu **g,
Xiao Jian,
Meng Zhaopeng
Abstract:
Road rage is a social problem that deserves attention, but little research has been done so far. In this paper, based on the biological topology of multi-channel EEG signals,we propose a model which combines transferable attention (TA) and regularized graph neural network (RGNN). First, topology-aware information aggregation is performed on EEG signals, and complex relationships between channels a…
▽ More
Road rage is a social problem that deserves attention, but little research has been done so far. In this paper, based on the biological topology of multi-channel EEG signals,we propose a model which combines transferable attention (TA) and regularized graph neural network (RGNN). First, topology-aware information aggregation is performed on EEG signals, and complex relationships between channels are dynamically learned. Then, the transferability of each channel is quantified based on the results of the node-wise domain classifier, which is used as attention score. We recruited 10 subjects and collected their EEG signals in pleasure and rage state in simulated driving conditions. We verify the effectiveness of our method on this dataset and compare it with other methods. The results indicate that our method is simple and efficient, with 85.63% accuracy in cross-subject experiments. It can be used to identify road rage. Our data and code are available. https://github.com/1CEc0ffee/dataAndCode.git
△ Less
Submitted 6 November, 2022;
originally announced December 2022.
-
Wide-Sense Stationarity in Generalized Graph Signal Processing
Authors:
Xingchao Jian,
Wee Peng Tay
Abstract:
We consider statistical graph signal processing (GSP) in a generalized framework where each vertex of a graph is associated with an element from a Hilbert space. This general model encompasses various signals such as the traditional scalar-valued graph signal, multichannel graph signal, and discrete- and continuous-time graph signals, allowing us to build a unified theory of graph random processes…
▽ More
We consider statistical graph signal processing (GSP) in a generalized framework where each vertex of a graph is associated with an element from a Hilbert space. This general model encompasses various signals such as the traditional scalar-valued graph signal, multichannel graph signal, and discrete- and continuous-time graph signals, allowing us to build a unified theory of graph random processes. We introduce the notion of joint wide-sense stationarity in this generalized GSP framework, which allows us to characterize a graph random process as a combination of uncorrelated oscillation modes across both the vertex and Hilbert space domains. We elucidate the relationship between the notions of wide-sense stationarity in different domains, and derive the Wiener filters for denoising and signal completion under this framework. Numerical experiments on both real and synthetic datasets demonstrate the utility of our generalized approach in achieving better estimation performance compared to traditional GSP or the time-vertex framework.
△ Less
Submitted 8 September, 2022; v1 submitted 2 December, 2021;
originally announced December 2021.
-
NOMA for Energy-Efficient LiFi-Enabled Bidirectional IoT Communication
Authors:
Chen Chen,
Shu Fu,
Xin Jian,
Min Liu,
Xiong Deng,
Zhiguo Ding
Abstract:
In this paper, we consider a light fidelity (LiFi)-enabled bidirectional Internet of Things (IoT) communication system, where visible light and infrared light are used in the downlink and uplink, respectively. In order to improve the energy efficiency (EE) of the bidirectional LiFi-IoT system, non-orthogonal multiple access (NOMA) with a quality-of-service (QoS)-guaranteed optimal power allocation…
▽ More
In this paper, we consider a light fidelity (LiFi)-enabled bidirectional Internet of Things (IoT) communication system, where visible light and infrared light are used in the downlink and uplink, respectively. In order to improve the energy efficiency (EE) of the bidirectional LiFi-IoT system, non-orthogonal multiple access (NOMA) with a quality-of-service (QoS)-guaranteed optimal power allocation (OPA) strategy is applied to maximize the EE of the system. We derive a closed-form OPA set based on the identification of the optimal decoding orders in both downlink and uplink channels, which can enable low-complexity power allocation. Moreover, we propose an adaptive channel and QoS-based user pairing approach by jointly considering users' channel gains and QoS requirements. We further analyze the EE of the bidirectional LiFi-IoT system and the user outage probabilities (UOPs) of both downlink and uplink channels of the system. Extensive analytical and simulation results demonstrate the superiority of NOMA with OPA in comparison to orthogonal multiple access (OMA) and NOMA with typical channel-based power allocation strategies. It is also shown that the proposed adaptive channel and QoS-based user pairing approach greatly outperforms individual channel/QoS-based approaches, especially when users have diverse QoS requirements.
△ Less
Submitted 24 May, 2020; v1 submitted 20 May, 2020;
originally announced May 2020.
-
A Robust Imbalanced SAR Image Change Detection Approach Based on Deep Difference Image and PCANet
Authors:
Xinzheng Zhang,
Hang Su,
Ce Zhang,
Peter M. Atkinson,
Xiaoheng Tan,
** Zeng,
Xin Jian
Abstract:
In this research, a novel robust change detection approach is presented for imbalanced multi-temporal synthetic aperture radar (SAR) image based on deep learning. Our main contribution is to develop a novel method for generating difference image and a parallel fuzzy c-means (FCM) clustering method. The main steps of our proposed approach are as follows: 1) Inspired by convolution and pooling in de…
▽ More
In this research, a novel robust change detection approach is presented for imbalanced multi-temporal synthetic aperture radar (SAR) image based on deep learning. Our main contribution is to develop a novel method for generating difference image and a parallel fuzzy c-means (FCM) clustering method. The main steps of our proposed approach are as follows: 1) Inspired by convolution and pooling in deep learning, a deep difference image (DDI) is obtained based on parameterized pooling leading to better speckle suppression and feature enhancement than traditional difference images. 2) Two different parameter Sigmoid nonlinear map** are applied to the DDI to get two mapped DDIs. Parallel FCM are utilized on these two mapped DDIs to obtain three types of pseudo-label pixels, namely, changed pixels, unchanged pixels, and intermediate pixels. 3) A PCANet with support vector machine (SVM) are trained to classify intermediate pixels to be changed or unchanged. Three imbalanced multi-temporal SAR image sets are used for change detection experiments. The experimental results demonstrate that the proposed approach is effective and robust for imbalanced SAR data, and achieve up to 99.52% change detection accuracy superior to most state-of-the-art methods.
△ Less
Submitted 3 March, 2020;
originally announced March 2020.
-
Two-Phase Object-Based Deep Learning for Multi-temporal SAR Image Change Detection
Authors:
Xinzheng Zhang,
Guo Liu,
Ce Zhang,
Peter M Atkinson,
Xiaoheng Tan,
Xin Jian,
Xichuan Zhou,
Yongming Li
Abstract:
Change detection is one of the fundamental applications of synthetic aperture radar (SAR) images. However, speckle noise presented in SAR images has a much negative effect on change detection. In this research, a novel two-phase object-based deep learning approach is proposed for multi-temporal SAR image change detection. Compared with traditional methods, the proposed approach brings two main inn…
▽ More
Change detection is one of the fundamental applications of synthetic aperture radar (SAR) images. However, speckle noise presented in SAR images has a much negative effect on change detection. In this research, a novel two-phase object-based deep learning approach is proposed for multi-temporal SAR image change detection. Compared with traditional methods, the proposed approach brings two main innovations. One is to classify all pixels into three categories rather than two categories: unchanged pixels, changed pixels caused by strong speckle (false changes), and changed pixels formed by real terrain variation (real changes). The other is to group neighboring pixels into segmented into superpixel objects (from pixels) such as to exploit local spatial context. Two phases are designed in the methodology: 1) Generate objects based on the simple linear iterative clustering algorithm, and discriminate these objects into changed and unchanged classes using fuzzy c-means (FCM) clustering and a deep PCANet. The prediction of this Phase is the set of changed and unchanged superpixels. 2) Deep learning on the pixel sets over the changed superpixels only, obtained in the first phase, to discriminate real changes from false changes. SLIC is employed again to achieve new superpixels in the second phase. Low rank and sparse decomposition are applied to these new superpixels to suppress speckle noise significantly. A further clustering step is applied to these new superpixels via FCM. A new PCANet is then trained to classify two kinds of changed superpixels to achieve the final change maps. Numerical experiments demonstrate that, compared with benchmark methods, the proposed approach can distinguish real changes from false changes effectively with significantly reduced false alarm rates, and achieve up to 99.71% change detection accuracy using multi-temporal SAR imagery.
△ Less
Submitted 17 January, 2020;
originally announced January 2020.