Showing 1–17 of 17 results for author: Roddenberry, T M

Implicit Neural Representations and the Algebra of Complex Wavelets

Authors: T. Mitchell Roddenberry, Vishwanath Saragadam, Maarten V. de Hoop, Richard G. Baraniuk

Abstract: Implicit neural representations (INRs) have arisen as useful methods for representing signals on Euclidean domains. By parameterizing an image as a multilayer perceptron (MLP) on Euclidean space, INRs effectively represent signals in a way that couples spatial and spectral features of the signal that is not obvious in the usual discrete representation, paving the way for continuous signal processi… ▽ More Implicit neural representations (INRs) have arisen as useful methods for representing signals on Euclidean domains. By parameterizing an image as a multilayer perceptron (MLP) on Euclidean space, INRs effectively represent signals in a way that couples spatial and spectral features of the signal that is not obvious in the usual discrete representation, paving the way for continuous signal processing and machine learning approaches that were not previously possible. Although INRs using sinusoidal activation functions have been studied in terms of Fourier theory, recent works have shown the advantage of using wavelets instead of sinusoids as activation functions, due to their ability to simultaneously localize in both frequency and space. In this work, we approach such INRs and demonstrate how they resolve high-frequency features of signals from coarse approximations done in the first layer of the MLP. This leads to multiple prescriptions for the design of INR architectures, including the use of complex wavelets, decoupling of low and band-pass approximations, and initialization schemes based on the singularities of the desired signal. △ Less

Submitted 30 September, 2023; originally announced October 2023.

Comments: 10 pages, 6 figures. 2 appendix pages, 1 appendix figure

Signal Processing on Product Spaces

Authors: T. Mitchell Roddenberry, Vincent P. Grande, Florian Frantzen, Michael T. Schaub, Santiago Segarra

Abstract: We establish a framework for signal processing on product spaces of simplicial and cellular complexes. For simplicity, we focus on the product of two complexes representing time and space, although our results generalize naturally to products of simplicial complexes of arbitrary dimension. Our framework leverages the structure of the eigenmodes of the Hodge Laplacian of the product space to jointl… ▽ More We establish a framework for signal processing on product spaces of simplicial and cellular complexes. For simplicity, we focus on the product of two complexes representing time and space, although our results generalize naturally to products of simplicial complexes of arbitrary dimension. Our framework leverages the structure of the eigenmodes of the Hodge Laplacian of the product space to jointly filter along time and space. To this end, we provide a decomposition theorem of the Hodge Laplacian of the product space, which highlights how the product structure induces a decomposition of each eigenmode into a spatial and temporal component. Finally, we apply our method to real world data, specifically for interpolating trajectories of buoys in the ocean from a limited set of observed trajectories. △ Less

Submitted 18 March, 2023; originally announced March 2023.

Journal ref: ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 2023, pp. 1-5

Windowed Fourier Analysis for Signal Processing on Graph Bundles

Authors: T. Mitchell Roddenberry, Santiago Segarra

Abstract: We consider the task of representing signals supported on graph bundles, which are generalizations of product graphs that allow for "twists" in the product structure. Leveraging the localized product structure of a graph bundle, we demonstrate how a suitable partition of unity over the base graph can be used to lift the signal on the graph into a space where a product factorization can be readily… ▽ More We consider the task of representing signals supported on graph bundles, which are generalizations of product graphs that allow for "twists" in the product structure. Leveraging the localized product structure of a graph bundle, we demonstrate how a suitable partition of unity over the base graph can be used to lift the signal on the graph into a space where a product factorization can be readily applied. Motivated by the locality of this procedure, we demonstrate that bases for the signal spaces of the components of the graph bundle can be lifted in the same way, yielding a basis for the signal space of the total graph. We demonstrate this construction on synthetic graphs, as well as with an analysis of the energy landscape of conformational manifolds in stereochemistry. △ Less

Submitted 10 February, 2023; originally announced February 2023.

Enhanced graph-learning schemes driven by similar distributions of motifs

Authors: Samuel Rey, T. Mitchell Roddenberry, Santiago Segarra, Antonio G. Marques

Abstract: This paper looks at the task of network topology inference, where the goal is to learn an unknown graph from nodal observations. One of the novelties of the approach put forth is the consideration of prior information about the density of motifs of the unknown graph to enhance the inference of classical Gaussian graphical models. Dealing with the density of motifs directly constitutes a challengin… ▽ More This paper looks at the task of network topology inference, where the goal is to learn an unknown graph from nodal observations. One of the novelties of the approach put forth is the consideration of prior information about the density of motifs of the unknown graph to enhance the inference of classical Gaussian graphical models. Dealing with the density of motifs directly constitutes a challenging combinatorial task. However, we note that if two graphs have similar motif densities, one can show that the expected value of a polynomial applied to their empirical spectral distributions will be similar. Guided by this, we first assume that we have a reference graph that is related to the sought graph (in the sense of having similar motif densities) and then, we exploit this relation by incorporating a similarity constraint and a regularization term in the network topology inference optimization problem. The (non-)convexity of the optimization problem is discussed and a computational efficient alternating majorization-minimization algorithm is designed. We assess the performance of the proposed method through exhaustive numerical experiments where different constraints are considered and compared against popular baselines algorithms on both synthetic and real-world datasets. △ Less

Submitted 11 July, 2022; originally announced July 2022.

On Local Distributions in Graph Signal Processing

Authors: T. Mitchell Roddenberry, Fernando Gama, Richard G. Baraniuk, Santiago Segarra

Abstract: Graph filtering is the cornerstone operation in graph signal processing (GSP). Thus, understanding it is key in develo** potent GSP methods. Graph filters are local and distributed linear operations, whose output depends only on the local neighborhood of each node. Moreover, a graph filter's output can be computed separately at each node by carrying out repeated exchanges with immediate neighbor… ▽ More Graph filtering is the cornerstone operation in graph signal processing (GSP). Thus, understanding it is key in develo** potent GSP methods. Graph filters are local and distributed linear operations, whose output depends only on the local neighborhood of each node. Moreover, a graph filter's output can be computed separately at each node by carrying out repeated exchanges with immediate neighbors. Graph filters can be compactly written as polynomials of a graph shift operator (typically, a sparse matrix description of the graph). This has led to relating the properties of the filters with the spectral properties of the corresponding matrix -- which encodes global structure of the graph. In this work, we propose a framework that relies solely on the local distribution of the neighborhoods of a graph. The crux of this approach is to describe graphs and graph signals in terms of a measurable space of rooted balls. Leveraging this, we are able to seamlessly compare graphs of different sizes and coming from different models, yielding results on the convergence of spectral densities, transferability of filters across arbitrary graphs, and continuity of graph signal properties with respect to the distribution of local substructures. △ Less

Submitted 21 February, 2022; originally announced February 2022.

Signal Processing on Cell Complexes

Authors: T. Mitchell Roddenberry, Michael T. Schaub, Mustafa Hajij

Abstract: The processing of signals supported on non-Euclidean domains has attracted large interest recently. Thus far, such non-Euclidean domains have been abstracted primarily as graphs with signals supported on the nodes, though the processing of signals on more general structures such as simplicial complexes has also been considered. In this paper, we give an introduction to signal processing on (abstra… ▽ More The processing of signals supported on non-Euclidean domains has attracted large interest recently. Thus far, such non-Euclidean domains have been abstracted primarily as graphs with signals supported on the nodes, though the processing of signals on more general structures such as simplicial complexes has also been considered. In this paper, we give an introduction to signal processing on (abstract) regular cell complexes, which provide a unifying framework encompassing graphs, simplicial complexes, cubical complexes and various meshes as special cases. We discuss how appropriate Hodge Laplacians for these cell complexes can be derived. These Hodge Laplacians enable the construction of convolutional filters, which can be employed in linear filtering and non-linear filtering via neural networks defined on cell complexes. △ Less

Submitted 20 February, 2022; v1 submitted 11 October, 2021; originally announced October 2021.

Comments: 5 pages, 3 figures

Journal ref: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Hodgelets: Localized Spectral Representations of Flows on Simplicial Complexes

Authors: T. Mitchell Roddenberry, Florian Frantzen, Michael T. Schaub, Santiago Segarra

Abstract: We develop wavelet representations for edge-flows on simplicial complexes, using ideas rooted in combinatorial Hodge theory and spectral graph wavelets. We first show that the Hodge Laplacian can be used in lieu of the graph Laplacian to construct a family of wavelets for higher-order signals on simplicial complexes. Then, we refine this idea to construct wavelets that respect the Hodge-Helmholtz… ▽ More We develop wavelet representations for edge-flows on simplicial complexes, using ideas rooted in combinatorial Hodge theory and spectral graph wavelets. We first show that the Hodge Laplacian can be used in lieu of the graph Laplacian to construct a family of wavelets for higher-order signals on simplicial complexes. Then, we refine this idea to construct wavelets that respect the Hodge-Helmholtz decomposition. For these Hodgelets, familiar notions of curl-free and divergence-free flows from vector calculus are preserved. We characterize the representational quality of our Hodgelets for edge flows in terms of frame bounds and demonstrate the use of these spectral wavelets for sparse representation of edge flows on real and synthetic data. △ Less

Submitted 17 September, 2021; originally announced September 2021.

Journal ref: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Signal processing on simplicial complexes

Authors: Michael T. Schaub, Jean-Baptiste Seby, Florian Frantzen, T. Mitchell Roddenberry, Yu Zhu, Santiago Segarra

Abstract: Higher-order networks have so far been considered primarily in the context of studying the structure of complex systems, i.e., the higher-order or multi-way relations connecting the constituent entities. More recently, a number of studies have considered dynamical processes that explicitly account for such higher-order dependencies, e.g., in the context of epidemic spreading processes or opinion f… ▽ More Higher-order networks have so far been considered primarily in the context of studying the structure of complex systems, i.e., the higher-order or multi-way relations connecting the constituent entities. More recently, a number of studies have considered dynamical processes that explicitly account for such higher-order dependencies, e.g., in the context of epidemic spreading processes or opinion formation. In this chapter, we focus on a closely related, but distinct third perspective: how can we use higher-order relationships to process signals and data supported on higher-order network structures. In particular, we survey how ideas from signal processing of data supported on regular domains, such as time series or images, can be extended to graphs and simplicial complexes. We discuss Fourier analysis, signal denoising, signal interpolation, and nonlinear processing through neural networks based on simplicial complexes. Key to our developments is the Hodge Laplacian matrix, a multi-relational operator that leverages the special structure of simplicial complexes and generalizes desirable properties of the Laplacian matrix in graph signal processing. △ Less

Submitted 2 February, 2022; v1 submitted 14 June, 2021; originally announced June 2021.

Comments: 29 pages; 5 figures. arXiv admin note: text overlap with arXiv:2101.05510

Sparse Partial Least Squares for Coarse Noisy Graph Alignment

Authors: Michael Weylandt, George Michailidis, T. Mitchell Roddenberry

Abstract: Graph signal processing (GSP) provides a powerful framework for analyzing signals arising in a variety of domains. In many applications of GSP, multiple network structures are available, each of which captures different aspects of the same underlying phenomenon. To integrate these different data sources, graph alignment techniques attempt to find the best correspondence between vertices of two gra… ▽ More Graph signal processing (GSP) provides a powerful framework for analyzing signals arising in a variety of domains. In many applications of GSP, multiple network structures are available, each of which captures different aspects of the same underlying phenomenon. To integrate these different data sources, graph alignment techniques attempt to find the best correspondence between vertices of two graphs. We consider a generalization of this problem, where there is no natural one-to-one map** between vertices, but where there is correspondence between the community structures of each graph. Because we seek to learn structure at this higher community level, we refer to this problem as "coarse" graph alignment. To this end, we propose a novel regularized partial least squares method which both incorporates the observed graph structures and imposes sparsity in order to reflect the underlying block community structure. We provide efficient algorithms for our method and demonstrate its effectiveness in simulations. △ Less

Submitted 6 April, 2021; originally announced April 2021.

Journal ref: SSP 2021: Proceedings of the 2021 IEEE Statistical Signal Processing Workshop 2021, pp.561-565. 2021

Simultaneous Grou** and Denoising via Sparse Convex Wavelet Clustering

Authors: Michael Weylandt, T. Mitchell Roddenberry, Genevera I. Allen

Abstract: Clustering is a ubiquitous problem in data science and signal processing. In many applications where we observe noisy signals, it is common practice to first denoise the data, perhaps using wavelet denoising, and then to apply a clustering algorithm. In this paper, we develop a sparse convex wavelet clustering approach that simultaneously denoises and discovers groups. Our approach utilizes convex… ▽ More Clustering is a ubiquitous problem in data science and signal processing. In many applications where we observe noisy signals, it is common practice to first denoise the data, perhaps using wavelet denoising, and then to apply a clustering algorithm. In this paper, we develop a sparse convex wavelet clustering approach that simultaneously denoises and discovers groups. Our approach utilizes convex fusion penalties to achieve agglomeration and group-sparse penalties to denoise through sparsity in the wavelet domain. In contrast to common practice which denoises then clusters, our method is a unified, convex approach that performs both simultaneously. Our method yields denoised (wavelet-sparse) cluster centroids that both improve interpretability and data compression. We demonstrate our method on synthetic examples and in an application to NMR spectroscopy. △ Less

Submitted 3 March, 2021; v1 submitted 8 December, 2020; originally announced December 2020.

Comments: To appear in IEEE DSLW 2021

Journal ref: DSLW 2021: Proceedings of the IEEE Data Science and Learning Workshop 2021, pp.1-8. 2021

Network topology change-point detection from graph signals with prior spectral signatures

Authors: Chiraag Kaushik, T. Mitchell Roddenberry, Santiago Segarra

Abstract: We consider the problem of sequential graph topology change-point detection from graph signals. We assume that signals on the nodes of the graph are regularized by the underlying graph structure via a graph filtering model, which we then leverage to distill the graph topology change-point detection problem to a subspace detection problem. We demonstrate how prior information on the spectral signat… ▽ More We consider the problem of sequential graph topology change-point detection from graph signals. We assume that signals on the nodes of the graph are regularized by the underlying graph structure via a graph filtering model, which we then leverage to distill the graph topology change-point detection problem to a subspace detection problem. We demonstrate how prior information on the spectral signature of the post-change graph can be incorporated to implicitly denoise the observed sequential data, thus leading to a natural CUSUM-based algorithm for change-point detection. Numerical experiments illustrate the performance of our proposed approach, particularly underscoring the benefits of (potentially noisy) prior information. △ Less

Submitted 21 October, 2020; originally announced October 2020.

Network Topology Inference with Graphon Spectral Penalties

Authors: T. Mitchell Roddenberry, Madeline Navarro, Santiago Segarra

Abstract: We consider the problem of inferring the unobserved edges of a graph from data supported on its nodes. In line with existing approaches, we propose a convex program for recovering a graph Laplacian that is approximately diagonalizable by a set of eigenvectors obtained from the second-order moment of the observed data. Unlike existing work, we incorporate prior knowledge about the distribution from… ▽ More We consider the problem of inferring the unobserved edges of a graph from data supported on its nodes. In line with existing approaches, we propose a convex program for recovering a graph Laplacian that is approximately diagonalizable by a set of eigenvectors obtained from the second-order moment of the observed data. Unlike existing work, we incorporate prior knowledge about the distribution from where the underlying graph was drawn. In particular, we consider the case where the graph was drawn from a graphon model, and we supplement our convex optimization problem with a provably-valid regularizer on the spectrum of the graph to be recovered. We present the cases where the graphon model is assumed to be known and the more practical setting where the relevant features of the model are inferred from auxiliary network observations. Numerical experiments on synthetic and real-world data illustrate the advantage of leveraging the proposed graphon prior, even when the prior is imperfect. △ Less

Submitted 15 October, 2020; originally announced October 2020.

Comments: 5 pages, 1 figure

Blind Inference of Eigenvector Centrality Rankings

Authors: T. Mitchell Roddenberry, Santiago Segarra

Abstract: We consider the problem of estimating a network's eigenvector centrality only from data on the nodes, with no information about network topology. Leveraging the versatility of graph filters to model network processes, data supported on the nodes is modeled as a graph signal obtained via the output of a graph filter applied to white noise. We seek to simplify the downstream task of centrality ranki… ▽ More We consider the problem of estimating a network's eigenvector centrality only from data on the nodes, with no information about network topology. Leveraging the versatility of graph filters to model network processes, data supported on the nodes is modeled as a graph signal obtained via the output of a graph filter applied to white noise. We seek to simplify the downstream task of centrality ranking by bypassing network topology inference methods and, instead, inferring the centrality structure of the graph directly from the graph signals. To this end, we propose two simple algorithms for ranking a set of nodes connected by an unobserved set of edges. We derive asymptotic and non-asymptotic guarantees for these algorithms, revealing key features that determine the complexity of the task at hand. Finally, we illustrate the behavior of the proposed algorithms on synthetic and real-world datasets. △ Less

Submitted 25 August, 2020; originally announced August 2020.

Blind Estimation of Eigenvector Centrality from Graph Signals: Beyond Low-pass Filtering

Authors: T. Mitchell Roddenberry, Santiago Segarra

Abstract: This paper characterizes the difficulty of estimating a network's eigenvector centrality only from data on the nodes, i.e., with no information about the topology of the network. We model this nodal data as graph signals generated by passing white noise through generic (not necessarily low-pass) graph filters. Leveraging the spectral properties of graph filters, we estimate the eigenvectors of the… ▽ More This paper characterizes the difficulty of estimating a network's eigenvector centrality only from data on the nodes, i.e., with no information about the topology of the network. We model this nodal data as graph signals generated by passing white noise through generic (not necessarily low-pass) graph filters. Leveraging the spectral properties of graph filters, we estimate the eigenvectors of the adjacency matrix of the underlying network. To this end, a simple selection algorithm is proposed, which chooses the correct eigenvector of the signal covariance matrix with minimal assumptions on the underlying graph filter. We then present a theoretical characterization of the asymptotic and non-asymptotic performance of this algorithm, thus providing a sample complexity bound for the centrality estimation and revealing key elements driving this complexity. Finally, we illustrate the developed insights through a set of numerical experiments on different random graph models. △ Less

Submitted 1 May, 2020; originally announced May 2020.

Comments: 5 pages, 2 figures

Exact Blind Community Detection from Signals on Multiple Graphs

Authors: T. Mitchell Roddenberry, Michael T. Schaub, Hoi-To Wai, Santiago Segarra

Abstract: Networks and data supported on graphs have become ubiquitous in the sciences and engineering. This paper studies the 'blind' community detection problem, where we seek to infer the community structure of a graph model given the observation of independent graph signals on a set of nodes whose connections are unknown. We model each observation as filtered white noise, where the underlying network st… ▽ More Networks and data supported on graphs have become ubiquitous in the sciences and engineering. This paper studies the 'blind' community detection problem, where we seek to infer the community structure of a graph model given the observation of independent graph signals on a set of nodes whose connections are unknown. We model each observation as filtered white noise, where the underlying network structure varies with every observation. These varying network structures are modeled as independent realizations of a latent planted partition model (PPM), justifying our assumption of a constant underlying community structure over all observations. Under certain conditions on the graph filter and PPM parameters, we propose algorithms for determining (i) the number of latent communities and (ii) the associated partitions of the PPM. We then prove statistical guarantees in the asymptotic and non-asymptotic sampling cases. Numerical experiments on real and synthetic data demonstrate the efficacy of our algorithms. △ Less

Submitted 29 January, 2020; originally announced January 2020.

Comments: 13 pages, 3 figures

HodgeNet: Graph Neural Networks for Edge Data

Authors: T. Mitchell Roddenberry, Santiago Segarra

Abstract: Networks and network processes have emerged as powerful tools for modeling social interactions, disease propagation, and a variety of additional dynamics driven by relational structures. Recently, neural networks have been generalized to process data on graphs, thus being able to learn from the aforementioned network processes achieving cutting-edge performance in traditional tasks such as node cl… ▽ More Networks and network processes have emerged as powerful tools for modeling social interactions, disease propagation, and a variety of additional dynamics driven by relational structures. Recently, neural networks have been generalized to process data on graphs, thus being able to learn from the aforementioned network processes achieving cutting-edge performance in traditional tasks such as node classification and link prediction. However, these methods have all been formulated in a way suited only to data on the nodes of a graph. The application of these techniques to data supported on the edges of a graph, namely flow signals, has not been explored in detail. To bridge this gap, we propose the use of the so-called Hodge Laplacian combined with graph neural network architectures for the analysis of flow data. Specifically, we apply two graph neural network architectures to solve the problems of flow interpolation and source localization. △ Less

Submitted 4 December, 2019; originally announced December 2019.

Comments: 6 pages, 1 figure

Blind Inference of Centrality Rankings from Graph Signals

Authors: T. Mitchell Roddenberry, Santiago Segarra

Abstract: We study the blind centrality ranking problem, where our goal is to infer the eigenvector centrality ranking of nodes solely from nodal observations, i.e., without information about the topology of the network. We formalize these nodal observations as graph signals and model them as the outputs of a network process on the underlying (unobserved) network. A simple spectral algorithm is proposed to… ▽ More We study the blind centrality ranking problem, where our goal is to infer the eigenvector centrality ranking of nodes solely from nodal observations, i.e., without information about the topology of the network. We formalize these nodal observations as graph signals and model them as the outputs of a network process on the underlying (unobserved) network. A simple spectral algorithm is proposed to estimate the leading eigenvector of the associated adjacency matrix, thus serving as a proxy for the centrality ranking. A finite rate performance analysis of the algorithm is provided, where we find a lower bound on the number of graph signals needed to correctly rank (with high probability) two nodes of interest. We then specialize our general analysis for the particular case of dense \ER graphs, where existing graph-theoretical results can be leveraged. Finally, we illustrate the proposed algorithm via numerical experiments in synthetic and real-world networks, making special emphasis on how the network features influence the performance. △ Less

Submitted 23 October, 2019; originally announced October 2019.

Comments: 5 pages, 2 figures