-
Perfectly Secure Key Agreement Over a Full Duplex Wireless Channel
Authors:
Gerhard Wunder,
Axel Flinth,
Daniel Becker,
Benedikt Groß
Abstract:
Secret key generation (SKG) between authenticated devices is a pivotal task for secure communications. Diffie-Hellman (DH) is de-facto standard but not post-quantum secure. In this paper, we shall invent and analyze a new security primitive that is specifically designed for WPAN. For WPAN, wireless channel-based SKG has been proposed but was not widely deployed due to its critical dependence on th…
▽ More
Secret key generation (SKG) between authenticated devices is a pivotal task for secure communications. Diffie-Hellman (DH) is de-facto standard but not post-quantum secure. In this paper, we shall invent and analyze a new security primitive that is specifically designed for WPAN. For WPAN, wireless channel-based SKG has been proposed but was not widely deployed due to its critical dependence on the channel's entropy which is uncontrollable. We formulate a different approach: We still exploit channel properties but mainly hinge on the reciprocity of the wireless channel and not on the channel's entropy. The radio advantage comes from the use of full duplex communication. We show that in this situation both legitimate parties can agree on a common secret key even without ever probing the channel at all. At the core is a new bisparse blind deconvolution scheme for which we prove correctness and information-theoretic, i.e. perfect, security. We show that, ultimately, a secret key can be extracted and give a lower bound for the number of secret key bits which is then verified by experiments.
△ Less
Submitted 23 April, 2024; v1 submitted 10 April, 2024;
originally announced April 2024.
-
Optimization Dynamics of Equivariant and Augmented Neural Networks
Authors:
Axel Flinth,
Fredrik Ohlsson
Abstract:
We investigate the optimization of multilayer perceptrons on symmetric data. We compare the strategy of constraining the architecture to be equivariant to that of using augmentation. We show that, under natural assumptions on the loss and non-linearities, the sets of equivariant stationary points are identical for the two strategies, and that the set of equivariant layers is invariant under the gr…
▽ More
We investigate the optimization of multilayer perceptrons on symmetric data. We compare the strategy of constraining the architecture to be equivariant to that of using augmentation. We show that, under natural assumptions on the loss and non-linearities, the sets of equivariant stationary points are identical for the two strategies, and that the set of equivariant layers is invariant under the gradient flow for augmented models. Finally, we show that stationary points may be unstable for augmented training although they are stable for the equivariant models.
△ Less
Submitted 21 September, 2023; v1 submitted 23 March, 2023;
originally announced March 2023.
-
Bisparse Blind Deconvolution through Hierarchical Sparse Recovery
Authors:
Axel Flinth,
Ingo Roth,
Gerhard Wunder
Abstract:
The bi-sparse blind deconvolution problem is studied -- that is, from the knowledge of $h*(Qb)$, where $Q$ is some linear operator, recovering $h$ and $b$, which are both assumed to be sparse. The approach rests upon lifting the problem to a linear one, and then applying the hierarchical sparsity framework. In particular, the efficient HiHTP algorithm is proposed for performing the recovery. Then,…
▽ More
The bi-sparse blind deconvolution problem is studied -- that is, from the knowledge of $h*(Qb)$, where $Q$ is some linear operator, recovering $h$ and $b$, which are both assumed to be sparse. The approach rests upon lifting the problem to a linear one, and then applying the hierarchical sparsity framework. In particular, the efficient HiHTP algorithm is proposed for performing the recovery. Then, under a random model on the matrix $Q$, it is theoretically shown that an $s$-sparse $h \in \mathbb{K}^μ$ and $σ$-sparse $b \in \mathbb{K}^n$ with high probability can be recovered when $μ\succcurlyeq s\log(s)^2\log(μ)\log(μn) + sσ\log(n)$.
△ Less
Submitted 19 February, 2024; v1 submitted 20 October, 2022;
originally announced October 2022.
-
In Search of Projectively Equivariant Networks
Authors:
Georg Bökman,
Axel Flinth,
Fredrik Kahl
Abstract:
Equivariance of linear neural network layers is well studied. In this work, we relax the equivariance condition to only be true in a projective sense. We propose a way to construct a projectively equivariant neural network through building a standard equivariant network where the linear group representations acting on each intermediate feature space are "multiplicatively modified lifts" of project…
▽ More
Equivariance of linear neural network layers is well studied. In this work, we relax the equivariance condition to only be true in a projective sense. We propose a way to construct a projectively equivariant neural network through building a standard equivariant network where the linear group representations acting on each intermediate feature space are "multiplicatively modified lifts" of projective group representations. By theoretically studying the relation of projectively and linearly equivariant linear layers, we show that our approach is the most general possible when building a network out of linear layers. The theory is showcased in two simple experiments.
△ Less
Submitted 20 December, 2023; v1 submitted 29 September, 2022;
originally announced September 2022.
-
One-Shot Messaging at Any Load Through Random Sub-Channeling in OFDM
Authors:
Gerhard Wunder,
Axel Flinth,
Benedikt Groß
Abstract:
Compressive Sensing has well boosted massive random access protocols over the last decade. In this paper we apply an orthogonal FFT basis as it is used in OFDM, but subdivide its image into so-called sub-channels and let each sub-channel take only a fraction of the load. In a random fashion the subdivision is consecutively applied over a suitable number of time-slots. Within the time-slots the use…
▽ More
Compressive Sensing has well boosted massive random access protocols over the last decade. In this paper we apply an orthogonal FFT basis as it is used in OFDM, but subdivide its image into so-called sub-channels and let each sub-channel take only a fraction of the load. In a random fashion the subdivision is consecutively applied over a suitable number of time-slots. Within the time-slots the users will not change their sub-channel assignment and send in parallel the data. Activity detection is carried out jointly across time-slots in each of the sub-channels. For such system design we derive three rather fundamental results: i) First, we prove that the subdivision can be driven to the extent that the activity in each sub-channel is sparse by design. An effect that we call sparsity capture effect. ii) Second, we prove that effectively the system can sustain any overload situation relative to the FFT dimension, i.e. detection failure of active and non-active users can be kept below any desired threshold regardless of the number of users. The only price to pay is delay, i.e. the number of time-slots over which cross-detection is performed. We achieve this by jointly exploring the effect of measure concentration in time and frequency and careful system parameter scaling. iii) Third, we prove that parallel to activity detection active users can carry one symbol per pilot resource and time-slot so it supports so-called one-shot messaging.
The key to proving these results are new concentration results for sequences of randomly sub-sampled FFTs detecting the sparse vectors "en bloc". Eventually, we show by simulations that the system is scalable resulting in a coarsely 20-fold capacity increase compared to standard OFDM.
△ Less
Submitted 13 July, 2023; v1 submitted 22 September, 2022;
originally announced September 2022.
-
Rigidity Preserving Image Transformations and Equivariance in Perspective
Authors:
Lucas Brynte,
Georg Bökman,
Axel Flinth,
Fredrik Kahl
Abstract:
We characterize the class of image plane transformations which realize rigid camera motions and call these transformations `rigidity preserving'. In particular, 2D translations of pinhole images are not rigidity preserving. Hence, when using CNNs for 3D inference tasks, it can be beneficial to modify the inductive bias from equivariance towards translations to equivariance towards rigidity preserv…
▽ More
We characterize the class of image plane transformations which realize rigid camera motions and call these transformations `rigidity preserving'. In particular, 2D translations of pinhole images are not rigidity preserving. Hence, when using CNNs for 3D inference tasks, it can be beneficial to modify the inductive bias from equivariance towards translations to equivariance towards rigidity preserving transformations. We investigate how equivariance with respect to rigidity preserving transformations can be approximated in CNNs, and test our ideas on both 6D object pose estimation and visual localization. Experimentally, we improve on several competitive baselines.
△ Less
Submitted 13 October, 2022; v1 submitted 31 January, 2022;
originally announced January 2022.
-
ZZ-Net: A Universal Rotation Equivariant Architecture for 2D Point Clouds
Authors:
Georg Bökman,
Fredrik Kahl,
Axel Flinth
Abstract:
In this paper, we are concerned with rotation equivariance on 2D point cloud data. We describe a particular set of functions able to approximate any continuous rotation equivariant and permutation invariant function. Based on this result, we propose a novel neural network architecture for processing 2D point clouds and we prove its universality for approximating functions exhibiting these symmetri…
▽ More
In this paper, we are concerned with rotation equivariance on 2D point cloud data. We describe a particular set of functions able to approximate any continuous rotation equivariant and permutation invariant function. Based on this result, we propose a novel neural network architecture for processing 2D point clouds and we prove its universality for approximating functions exhibiting these symmetries.
We also show how to extend the architecture to accept a set of 2D-2D correspondences as indata, while maintaining similar equivariance properties. Experiments are presented on the estimation of essential matrices in stereo vision.
△ Less
Submitted 28 March, 2022; v1 submitted 30 November, 2021;
originally announced November 2021.
-
Guaranteed blind deconvolution and demixing via hierarchically sparse reconstruction
Authors:
Axel Flinth,
Ingo Roth,
Benedikt Groß,
Jens Eisert,
Gerhard Wunder
Abstract:
The blind deconvolution problem amounts to reconstructing both a signal and a filter from the convolution of these two. It constitutes a prominent topic in mathematical and engineering literature. In this work, we analyze a sparse version of the problem: The filter $h\in \mathbb{R}^μ$ is assumed to be $s$-sparse, and the signal $b \in \mathbb{R}^n$ is taken to be $σ$-sparse, both supports being un…
▽ More
The blind deconvolution problem amounts to reconstructing both a signal and a filter from the convolution of these two. It constitutes a prominent topic in mathematical and engineering literature. In this work, we analyze a sparse version of the problem: The filter $h\in \mathbb{R}^μ$ is assumed to be $s$-sparse, and the signal $b \in \mathbb{R}^n$ is taken to be $σ$-sparse, both supports being unknown. We observe a convolution between the filter and a linear transformation of the signal. Motivated by practically important multi-user communication applications, we derive a recovery guarantee for the simultaneous demixing and deconvolution setting. We achieve efficient recovery by relaxing the problem to a hierarchical sparse recovery for which we can build on a flexible framework. At the same time, for this we pay the price of some sub-optimal guarantees compared to the number of free parameters of the problem. The signal model we consider is sufficiently general to capture many applications in a number of engineering fields. Despite their practical importance, we provide first rigorous performance guarantees for efficient and simple algorithms for the bi-sparse and generalized demixing setting. We complement our analytical results by presenting results of numerical simulations. We find evidence that the sub-optimal scaling $s^2σ\log(μ)\log(n)$ of our derived sufficient condition is likely overly pessimistic and that the observed performance is better described by a scaling proportional to $ sσ$ up to log-factors.
△ Less
Submitted 5 November, 2021;
originally announced November 2021.
-
Measure Concentration on the OFDM-based Random Access Channel
Authors:
Gerhard Wunder,
Axel Flinth,
Benedikt Groß
Abstract:
It is well known that CS can boost massive random access protocols. Usually, the protocols operate in some overloaded regime where the sparsity can be exploited. In this paper, we consider a different approach by taking an orthogonal FFT base, subdivide its image into appropriate sub-channels and let each subchannel take only a fraction of the load. To show that this approach can actually achieve…
▽ More
It is well known that CS can boost massive random access protocols. Usually, the protocols operate in some overloaded regime where the sparsity can be exploited. In this paper, we consider a different approach by taking an orthogonal FFT base, subdivide its image into appropriate sub-channels and let each subchannel take only a fraction of the load. To show that this approach can actually achieve the full capacity we provide i) new concentration inequalities, and ii) devise a sparsity capture effect, i.e where the sub-division can be driven such that the activity in each each sub-channel is sparse by design. We show by simulations that the system is scalable resulting in a coarsely 30-fold capacity increase.
△ Less
Submitted 21 May, 2021;
originally announced May 2021.
-
Hierarchical sparse recovery from hierarchically structured measurements with application to massive random access
Authors:
Benedikt Groß,
Axel Flinth,
Ingo Roth,
Jens Eisert,
Gerhard Wunder
Abstract:
A new family of operators, coined hierarchical measurement operators, is introduced and discussed within the well-known hierarchical sparse recovery framework. Such operator is a composition of block and mixing operations and notably contains the Kronecker product as a special case. Results on their hierarchical restricted isometry property (HiRIP) are derived, generalizing prior work on recovery…
▽ More
A new family of operators, coined hierarchical measurement operators, is introduced and discussed within the well-known hierarchical sparse recovery framework. Such operator is a composition of block and mixing operations and notably contains the Kronecker product as a special case. Results on their hierarchical restricted isometry property (HiRIP) are derived, generalizing prior work on recovery of hierarchically sparse signals from Kronecker-structured linear measurements. Specifically, these results show that, very surprisingly, sparsity properties of the block and mixing part can be traded against each other. The measurement structure is well-motivated by a massive random access channel design in communication engineering. Numerical evaluation of user detection rates demonstrate the huge benefit of the theoretical framework.
△ Less
Submitted 7 May, 2021;
originally announced May 2021.
-
Hierarchical compressed sensing
Authors:
Jens Eisert,
Axel Flinth,
Benedikt Groß,
Ingo Roth,
Gerhard Wunder
Abstract:
Compressed sensing is a paradigm within signal processing that provides the means for recovering structured signals from linear measurements in a highly efficient manner. Originally devised for the recovery of sparse signals, it has become clear that a similar methodology would also carry over to a wealth of other classes of structured signals. In this work, we provide an overview over the theory…
▽ More
Compressed sensing is a paradigm within signal processing that provides the means for recovering structured signals from linear measurements in a highly efficient manner. Originally devised for the recovery of sparse signals, it has become clear that a similar methodology would also carry over to a wealth of other classes of structured signals. In this work, we provide an overview over the theory of compressed sensing for a particularly rich family of such signals, namely those of hierarchically structured signals. Examples of such signals are constituted by blocked vectors, with only few non-vanishing sparse blocks. We present recovery algorithms based on efficient hierarchical hard-thresholding. The algorithms are guaranteed to converge, in a stable fashion both with respect to measurement noise as well as to model mismatches, to the correct solution provided the measurement map acts isometrically restricted to the signal class. We then provide a series of results establishing the required condition for large classes of measurement ensembles. Building upon this machinery, we sketch practical applications of this framework in machine-type communications and quantum tomography.
△ Less
Submitted 8 December, 2021; v1 submitted 6 April, 2021;
originally announced April 2021.
-
Hierarchical Isometry Properties of Hierarchical Measurements
Authors:
Axel Flinth,
Benedikt Groß,
Ingo Roth,
Jens Eisert,
Gerhard Wunder
Abstract:
A new class of measurement operators, coined hierarchical measurement operators, and prove results guaranteeing the efficient, stable and robust recovery of hierarchically structured signals from such measurements. We derive bounds on their hierarchical restricted isometry properties based on the restricted isometry constants of their constituent matrices, generalizing and extending prior work on…
▽ More
A new class of measurement operators, coined hierarchical measurement operators, and prove results guaranteeing the efficient, stable and robust recovery of hierarchically structured signals from such measurements. We derive bounds on their hierarchical restricted isometry properties based on the restricted isometry constants of their constituent matrices, generalizing and extending prior work on Kronecker-product measurements. As an exemplary application, we apply the theory to two communication scenarios. The fast and scalable HiHTP algorithm is shown to be suitable for solving these types of problems and its performance is evaluated numerically in terms of sparse signal recovery and block detection capability.
△ Less
Submitted 14 December, 2021; v1 submitted 20 May, 2020;
originally announced May 2020.
-
Low-Overhead Hierarchically-Sparse Channel Estimation for Multiuser Wideband Massive MIMO
Authors:
Gerhard Wunder,
Stelios Stefanatos,
Axel Flinth,
Ingo Roth,
Giuseppe Caire
Abstract:
The problem of excessive pilot overhead required for uplink massive MIMO channel estimation is well known, let alone when it is considered along with wideband (OFDM) transmissions. Towards channel estimators that are both efficient and require low-training overhead, compressive sensing (CS) approaches have been increasingly popular, exploiting the sparse nature of the physical channel. However, no…
▽ More
The problem of excessive pilot overhead required for uplink massive MIMO channel estimation is well known, let alone when it is considered along with wideband (OFDM) transmissions. Towards channel estimators that are both efficient and require low-training overhead, compressive sensing (CS) approaches have been increasingly popular, exploiting the sparse nature of the physical channel. However, no analytical insights regarding the overhead required for reliable channel estimation in wideband massive MIMO are available. By observing that the wideband massive MIMO channel can be represented by a vector that is not simply sparse but has well defined structural properties, referred to as hierarchical sparsity, we propose low complexity channel estimators for the multiuser scenario that take this property into account. By employing the framework of the hierarchical restricted isometry property, rigorous performance guarantees for these algorithms are provided suggesting concrete design goals for the user pilot sequences. For a specific design, we analytically characterize the scaling of the required pilot overhead with increasing number of antennas and bandwidth, revealing that, as long as the number of antennas is sufficiently large, it is independent of the per user channel sparsity level as well as the number of active users. Hence, surprisingly, in contrast to the classical setting, pilot overhead can be shifted into spatial dimensions not affecting crucial bandwidth constraints thereby increasing the overall system capacity. These analytical insights are verified by simulation results demonstrating also the superiority of the proposed algorithm over conventional CS algorithms that ignore the hierarchical sparsity property.
△ Less
Submitted 10 December, 2018; v1 submitted 3 June, 2018;
originally announced June 2018.
-
Hierarchical Sparse Channel Estimation for Massive MIMO
Authors:
Gerhard Wunder,
Ingo Roth,
Axel Flinth,
Mahdi Barzegar,
Saeid Haghighatshoar,
Giuseppe Caire,
Gitta Kutyniok
Abstract:
The problem of wideband massive MIMO channel estimation is considered. Targeting for low complexity algorithms as well as small training overhead, a compressive sensing (CS) approach is pursued. Unfortunately, due to the Kronecker-type sensing (measurement) matrix corresponding to this setup, application of standard CS algorithms and analysis methodology does not apply. By recognizing that the cha…
▽ More
The problem of wideband massive MIMO channel estimation is considered. Targeting for low complexity algorithms as well as small training overhead, a compressive sensing (CS) approach is pursued. Unfortunately, due to the Kronecker-type sensing (measurement) matrix corresponding to this setup, application of standard CS algorithms and analysis methodology does not apply. By recognizing that the channel possesses a special structure, termed hierarchical sparsity, we propose an efficient algorithm that explicitly takes into account this property. In addition, by extending the standard CS analysis methodology to hierarchical sparse vectors, we provide a rigorous analysis of the algorithm performance in terms of estimation error as well as number of pilot subcarriers required to achieve it. Small training overhead, in turn, means higher number of supported users in a cell and potentially improved pilot decontamination. We believe, that this is the first paper that draws a rigorous connection between the hierarchical framework and Kronecker measurements. Numerical results verify the advantage of employing the proposed approach in this setting instead of standard CS algorithms.
△ Less
Submitted 29 March, 2018;
originally announced March 2018.
-
Hierarchical restricted isometry property for Kronecker product measurements
Authors:
I. Roth,
A. Flinth,
R. Kueng,
J. Eisert,
G. Wunder
Abstract:
Hierarchically sparse signals and Kronecker product structured measurements arise naturally in a variety of applications. The simplest example of a hierarchical sparsity structure is two-level $(s,σ)$-hierarchical sparsity which features $s$-block-sparse signals with $σ$-sparse blocks. For a large class of algorithms recovery guarantees can be derived based on the restricted isometry property (RIP…
▽ More
Hierarchically sparse signals and Kronecker product structured measurements arise naturally in a variety of applications. The simplest example of a hierarchical sparsity structure is two-level $(s,σ)$-hierarchical sparsity which features $s$-block-sparse signals with $σ$-sparse blocks. For a large class of algorithms recovery guarantees can be derived based on the restricted isometry property (RIP) of the measurement matrix and model-based variants thereof. We show that given two matrices $\mathbf{A}$ and $\mathbf{B}$ having the standard $s$-sparse and $σ$-sparse RIP their Kronecker product $\mathbf{A}\otimes\mathbf{B}$ has two-level $(s,σ)$-hierarchically sparse RIP (HiRIP). This result can be recursively generalized to signals with multiple hierarchical sparsity levels and measurements with multiple Kronecker product factors. As a corollary we establish the efficient reconstruction of hierarchical sparse signals from Kronecker product measurements using the HiHTP algorithm. We argue that Kronecker product measurement matrices allow to design large practical compressed sensing systems that are deterministically certified to reliably recover signals in a stable fashion. We elaborate on their motivation from the perspective of applications.
△ Less
Submitted 31 January, 2018;
originally announced January 2018.
-
Reliable recovery of hierarchically sparse signals for Gaussian and Kronecker product measurements
Authors:
Ingo Roth,
Martin Kliesch,
Axel Flinth,
Gerhard Wunder,
Jens Eisert
Abstract:
We propose and analyze a solution to the problem of recovering a block sparse signal with sparse blocks from linear measurements. Such problems naturally emerge inter alia in the context of mobile communication, in order to meet the scalability and low complexity requirements of massive antenna systems and massive machine-type communication. We introduce a new variant of the Hard Thresholding Purs…
▽ More
We propose and analyze a solution to the problem of recovering a block sparse signal with sparse blocks from linear measurements. Such problems naturally emerge inter alia in the context of mobile communication, in order to meet the scalability and low complexity requirements of massive antenna systems and massive machine-type communication. We introduce a new variant of the Hard Thresholding Pursuit (HTP) algorithm referred to as HiHTP. We provide both a proof of convergence and a recovery guarantee for noisy Gaussian measurements that exhibit an improved asymptotic scaling in terms of the sampling complexity in comparison with the usual HTP algorithm. Furthermore, hierarchically sparse signals and Kronecker product structured measurements naturally arise together in a variety of applications. We establish the efficient reconstruction of hierarchically sparse signals from Kronecker product measurements using the HiHTP algorithm. Additionally, we provide analytical results that connect our recovery conditions to generalized coherence measures. Again, our recovery results exhibit substantial improvement in the asymptotic sampling complexity scaling over the standard setting. Finally, we validate in numerical experiments that for hierarchically sparse signals, HiHTP performs significantly better compared to HTP.
△ Less
Submitted 22 May, 2020; v1 submitted 22 December, 2016;
originally announced December 2016.
