-
Entropy Inequalities and Gaussian Comparisons
Authors:
Efe Aras,
Thomas A. Courtade
Abstract:
We establish a general class of entropy inequalities that take the concise form of Gaussian comparisons. The main result unifies many classical and recent results, including the Shannon-Stam inequality, the Brunn-Minkowski inequality, the Zamir-Feder inequality, the Brascamp-Lieb and Barthe inequalities, the Anantharam-Jog-Nair inequality, and others.
We establish a general class of entropy inequalities that take the concise form of Gaussian comparisons. The main result unifies many classical and recent results, including the Shannon-Stam inequality, the Brunn-Minkowski inequality, the Zamir-Feder inequality, the Brascamp-Lieb and Barthe inequalities, the Anantharam-Jog-Nair inequality, and others.
△ Less
Submitted 28 June, 2022;
originally announced June 2022.
-
Equality cases in the Anantharam-Jog-Nair inequality
Authors:
Efe Aras,
Thomas A. Courtade,
Albert Zhang
Abstract:
Anantharam, Jog and Nair recently unified the Shannon-Stam inequality and the entropic form of the Brascamp-Lieb inequalities under a common inequality. They left open the problems of extremizability and characterization of extremizers. Both questions are resolved in the present paper.
Anantharam, Jog and Nair recently unified the Shannon-Stam inequality and the entropic form of the Brascamp-Lieb inequalities under a common inequality. They left open the problems of extremizability and characterization of extremizers. Both questions are resolved in the present paper.
△ Less
Submitted 23 June, 2022;
originally announced June 2022.
-
Optimal Robust Linear Regression in Nearly Linear Time
Authors:
Yeshwanth Cherapanamjeri,
Efe Aras,
Nilesh Tripuraneni,
Michael I. Jordan,
Nicolas Flammarion,
Peter L. Bartlett
Abstract:
We study the problem of high-dimensional robust linear regression where a learner is given access to $n$ samples from the generative model $Y = \langle X,w^* \rangle + ε$ (with $X \in \mathbb{R}^d$ and $ε$ independent), in which an $η$ fraction of the samples have been adversarially corrupted. We propose estimators for this problem under two settings: (i) $X$ is L4-L2 hypercontractive,…
▽ More
We study the problem of high-dimensional robust linear regression where a learner is given access to $n$ samples from the generative model $Y = \langle X,w^* \rangle + ε$ (with $X \in \mathbb{R}^d$ and $ε$ independent), in which an $η$ fraction of the samples have been adversarially corrupted. We propose estimators for this problem under two settings: (i) $X$ is L4-L2 hypercontractive, $\mathbb{E} [XX^\top]$ has bounded condition number and $ε$ has bounded variance and (ii) $X$ is sub-Gaussian with identity second moment and $ε$ is sub-Gaussian. In both settings, our estimators: (a) Achieve optimal sample complexities and recovery guarantees up to log factors and (b) Run in near linear time ($\tilde{O}(nd / η^6)$). Prior to our work, polynomial time algorithms achieving near optimal sample complexities were only known in the setting where $X$ is Gaussian with identity covariance and $ε$ is Gaussian, and no linear time estimators were known for robust linear regression in any setting. Our estimators and their analysis leverage recent developments in the construction of faster algorithms for robust mean estimation to improve runtimes, and refined concentration of measure arguments alongside Gaussian rounding techniques to improve statistical sample complexities.
△ Less
Submitted 16 July, 2020;
originally announced July 2020.
-
A Family of Bayesian Cramér-Rao Bounds, and Consequences for Log-Concave Priors
Authors:
Efe Aras,
Kuan-Yun Lee,
Ashwin Pananjady,
Thomas A. Courtade
Abstract:
Under minimal regularity assumptions, we establish a family of information-theoretic Bayesian Cramér-Rao bounds, indexed by probability measures that satisfy a logarithmic Sobolev inequality. This family includes as a special case the known Bayesian Cramér-Rao bound (or van Trees inequality), and its less widely known entropic improvement due to Efroimovich. For the setting of a log-concave prior,…
▽ More
Under minimal regularity assumptions, we establish a family of information-theoretic Bayesian Cramér-Rao bounds, indexed by probability measures that satisfy a logarithmic Sobolev inequality. This family includes as a special case the known Bayesian Cramér-Rao bound (or van Trees inequality), and its less widely known entropic improvement due to Efroimovich. For the setting of a log-concave prior, we obtain a Bayesian Cramér-Rao bound which holds for any (possibly biased) estimator and, unlike the van Trees inequality, does not depend on the Fisher information of the prior.
△ Less
Submitted 22 February, 2019;
originally announced February 2019.
-
Tackling Contention Through Cooperation: A Distributed Federation in LoRaWAN Space
Authors:
Stéphane Delbruel,
Nicolas Small,
Emekcan Aras,
Jonathan Oostvogels,
Danny Hughes
Abstract:
Low-Power Wide Area Networks (LPWAN) play a key role in the IoT marketplace wherein LoRaWAN is considered a leading solution. Despite the traction of LoRaWAN, research shows that the current contention management mechanisms of LoRaWAN do not scale. This paper tackles contention on LoRaWAN by introducing FLIP, a fully distributed and open architecture for LoRaWAN that fundamentally rethinks how LoR…
▽ More
Low-Power Wide Area Networks (LPWAN) play a key role in the IoT marketplace wherein LoRaWAN is considered a leading solution. Despite the traction of LoRaWAN, research shows that the current contention management mechanisms of LoRaWAN do not scale. This paper tackles contention on LoRaWAN by introducing FLIP, a fully distributed and open architecture for LoRaWAN that fundamentally rethinks how LoRa gateways should be managed and coordinated. FLIP transforms LoRa gateways into a federated network that provides inherent support for roaming while tackling contention using consensus-driven load balancing. FLIP offers identical security guarantees to LoRaWAN, is compatible with existing gateway hardware and requires no updates to end-device hardware or firmware. These features ensure the practicality of FLIP and provide a path to its adoption. We evaluate the performance of FLIP in a large-scale real-world deployment and demonstrate that FLIP delivers scalable roaming and improved contention management in comparison to LoRaWAN. FLIP achieves these benefits within the resource constraints of conventional LoRa gateways and requires no server hardware.
△ Less
Submitted 18 February, 2020; v1 submitted 21 December, 2017;
originally announced December 2017.
-
Selective Jamming of LoRaWAN using Commodity Hardware
Authors:
Emekcan Aras,
Nicolas Small,
Gowri Sankar Ramachandran,
Stéphane Delbruel,
Wouter Joosen,
Danny Hughes
Abstract:
Long range, low power networks are rapidly gaining acceptance in the Internet of Things (IoT) due to their ability to economically support long-range sensing and control applications while providing multi-year battery life. LoRa is a key example of this new class of network and is being deployed at large scale in several countries worldwide. As these networks move out of the lab and into the real…
▽ More
Long range, low power networks are rapidly gaining acceptance in the Internet of Things (IoT) due to their ability to economically support long-range sensing and control applications while providing multi-year battery life. LoRa is a key example of this new class of network and is being deployed at large scale in several countries worldwide. As these networks move out of the lab and into the real world, they expose a large cyber-physical attack surface. Securing these networks is therefore both critical and urgent. This paper highlights security issues in LoRa and LoRaWAN that arise due to the choice of a robust but slow modulation type in the protocol. We exploit these issues to develop a suite of practical attacks based around selective jamming. These attacks are conducted and evaluated using commodity hardware. The paper concludes by suggesting a range of countermeasures that can be used to mitigate the attacks.
△ Less
Submitted 6 December, 2017;
originally announced December 2017.
