Skip to main content

Showing 1–35 of 35 results for author: Courtade, T A

.
  1. arXiv:2407.09465  [pdf, ps, other

    math.PR math.FA

    Stochastic proof of the sharp symmetrized Talagrand inequality

    Authors: Thomas A. Courtade, Max Fathi, Dan Mikulincer

    Abstract: We give a new proof of the sharp symmetrized form of Talagrand's transport-entropy inequality. Compared to stochastic proofs of other Gaussian functional inequalities, the new idea here is a certain coupling induced by time-reversed martingale representations.

    Submitted 12 July, 2024; originally announced July 2024.

  2. arXiv:2405.01441  [pdf, ps, other

    math.AP math.FA math.PR

    Stability of the Poincaré-Korn inequality

    Authors: Thomas A. Courtade, Max Fathi

    Abstract: We resolve a question of Carrapatoso et al. on Gaussian optimality for the sharp constant in Poincaré-Korn inequalities, under a moment constraint. We also prove stability, showing that measures with near-optimal constant are quantitatively close to standard Gaussian.

    Submitted 2 May, 2024; originally announced May 2024.

  3. arXiv:2404.12277  [pdf, ps, other

    math.FA math.MG math.PR

    Stability of Klartag's improved Lichnerowicz inequality

    Authors: Thomas A. Courtade, Max Fathi

    Abstract: In a recent work, Klartag gave an improved version of Lichnerowicz' spectral gap bound for uniformly log-concave measures, which improves on the classical estimate by taking into account the covariance matrix. We analyze the equality cases in Klartag's bound, showing that it can be further improved whenever the measure has no Gaussian factor. Additionally, we give a quantitative improvement for lo… ▽ More

    Submitted 18 April, 2024; originally announced April 2024.

  4. arXiv:2403.06615  [pdf, ps, other

    math.PR cs.IT

    Rigid characterizations of probability measures through independence, with applications

    Authors: Thomas A. Courtade

    Abstract: Three equivalent characterizations of probability measures through independence criteria are given. These characterizations lead to a family of Brascamp--Lieb-type inequalities for relative entropy, determine equilibrium states and sharp rates of convergence for certain linear Boltzmann-type dynamics, and unify an assortment of $L^2$ inequalities in probability.

    Submitted 11 March, 2024; originally announced March 2024.

    Comments: Comments welcome!

  5. arXiv:2312.01368  [pdf, ps, other

    math.PR math.FA

    HWI inequalities in discrete spaces via couplings

    Authors: Thomas A. Courtade, Max Fathi

    Abstract: HWI inequalities are interpolation inequalities relating entropy, Fisher information and optimal transport distances. We adapt an argument of Y. Wu for proving the Gaussian HWI inequality via a coupling argument to the discrete setting, establishing new interpolation inequalities for the discrete hypercube and the discrete torus. In particular, we obtain an improvement of the modified logarithmic… ▽ More

    Submitted 3 December, 2023; originally announced December 2023.

    Comments: 11 pages, comments welcome

  6. arXiv:2310.13137  [pdf, other

    cs.CR cs.DS cs.LG stat.ML

    Mean Estimation Under Heterogeneous Privacy Demands

    Authors: Syomantak Chaudhuri, Konstantin Miagkov, Thomas A. Courtade

    Abstract: Differential Privacy (DP) is a well-established framework to quantify privacy loss incurred by any algorithm. Traditional formulations impose a uniform privacy requirement for all users, which is often inconsistent with real-world scenarios in which users dictate their privacy preferences individually. This work considers the problem of mean estimation, where each user can impose their own distinc… ▽ More

    Submitted 19 October, 2023; originally announced October 2023.

    Comments: A preliminary conference version was published at ISIT 2023 and uploaded to arxiv (arXiv:2305.09668). This version significantly expands on the previous article and is being submitted to a journal

  7. arXiv:2305.09668  [pdf, other

    cs.CR cs.DS cs.LG stat.ML

    Mean Estimation Under Heterogeneous Privacy: Some Privacy Can Be Free

    Authors: Syomantak Chaudhuri, Thomas A. Courtade

    Abstract: Differential Privacy (DP) is a well-established framework to quantify privacy loss incurred by any algorithm. Traditional DP formulations impose a uniform privacy requirement for all users, which is often inconsistent with real-world scenarios in which users dictate their privacy preferences individually. This work considers the problem of mean estimation under heterogeneous DP constraints, where… ▽ More

    Submitted 27 April, 2023; originally announced May 2023.

    Comments: To appear at ISIT 2023

  8. arXiv:2206.14182  [pdf, ps, other

    cs.IT

    Entropy Inequalities and Gaussian Comparisons

    Authors: Efe Aras, Thomas A. Courtade

    Abstract: We establish a general class of entropy inequalities that take the concise form of Gaussian comparisons. The main result unifies many classical and recent results, including the Shannon-Stam inequality, the Brunn-Minkowski inequality, the Zamir-Feder inequality, the Brascamp-Lieb and Barthe inequalities, the Anantharam-Jog-Nair inequality, and others.

    Submitted 28 June, 2022; originally announced June 2022.

    Comments: 23 pages. Comments welcome

  9. arXiv:2206.11809  [pdf, ps, other

    cs.IT

    Equality cases in the Anantharam-Jog-Nair inequality

    Authors: Efe Aras, Thomas A. Courtade, Albert Zhang

    Abstract: Anantharam, Jog and Nair recently unified the Shannon-Stam inequality and the entropic form of the Brascamp-Lieb inequalities under a common inequality. They left open the problems of extremizability and characterization of extremizers. Both questions are resolved in the present paper.

    Submitted 23 June, 2022; originally announced June 2022.

    Comments: 21 pages. Comments welcome

  10. arXiv:2006.05492  [pdf, ps, other

    math.ST cs.IT

    Linear Models are Most Favorable among Generalized Linear Models

    Authors: Kuan-Yun Lee, Thomas A. Courtade

    Abstract: We establish a nonasymptotic lower bound on the $L_2$ minimax risk for a class of generalized linear models. It is further shown that the minimax risk for the canonical linear model matches this lower bound up to a universal constant. Therefore, the canonical linear model may be regarded as most favorable among the considered class of generalized linear models (in terms of minimax risk). The proof… ▽ More

    Submitted 9 June, 2020; originally announced June 2020.

    Comments: To appear in the 2020 IEEE International Symposium on Information Theory

  11. arXiv:1907.12723  [pdf, ps, other

    math.FA cs.IT math.CA

    Euclidean Forward-Reverse Brascamp-Lieb Inequalities: Finiteness, Structure and Extremals

    Authors: Thomas A. Courtade, **gbo Liu

    Abstract: A new proof is given for the fact that centered gaussian functions saturate the Euclidean forward-reverse Brascamp-Lieb inequalities, extending the Brascamp-Lieb and Barthe theorems. A duality principle for best constants is also developed, which generalizes the fact that the best constants in the Brascamp-Lieb and Barthe inequalities are equal. Finally, as the title hints, the main results concer… ▽ More

    Submitted 29 August, 2019; v1 submitted 29 July, 2019; originally announced July 2019.

    Comments: 37 pages, no figures. v2 includes added examples and minor updates to simplify presentation. Comments welcome

  12. arXiv:1902.08582  [pdf, ps, other

    cs.IT

    A Family of Bayesian Cramér-Rao Bounds, and Consequences for Log-Concave Priors

    Authors: Efe Aras, Kuan-Yun Lee, Ashwin Pananjady, Thomas A. Courtade

    Abstract: Under minimal regularity assumptions, we establish a family of information-theoretic Bayesian Cramér-Rao bounds, indexed by probability measures that satisfy a logarithmic Sobolev inequality. This family includes as a special case the known Bayesian Cramér-Rao bound (or van Trees inequality), and its less widely known entropic improvement due to Efroimovich. For the setting of a log-concave prior,… ▽ More

    Submitted 22 February, 2019; originally announced February 2019.

    Comments: 15 pages, no figures. Comments welcome

  13. arXiv:1901.10893  [pdf, ps, other

    cs.IT math.FA math.PR

    Transportation Proof of an inequality by Anantharam, Jog and Nair

    Authors: Thomas A. Courtade

    Abstract: Anantharam, Jog and Nair recently put forth an entropic inequality which simultaneously generalizes the Shannon-Stam entropy power inequality and the Brascamp-Lieb inequality in entropic form. We give a brief proof of their result based on optimal transport.

    Submitted 31 January, 2019; v1 submitted 30 January, 2019; originally announced January 2019.

    Comments: 4 pages; no figures

  14. arXiv:1807.09845  [pdf, ps, other

    math.FA math.AP math.PR

    Stability of the Bakry-Emery theorem on $\mathbb{R}^n$

    Authors: Thomas A. Courtade, Max Fathi

    Abstract: We prove stability estimates for the Bakry-Emery bound on Poincaré and logarithmic Sobolev constants of uniformly log-concave measures. In particular, we improve the quantitative bound in a result of De Philippis and Figalli asserting that if a $1$-uniformly log-concave measure has almost the same Poincaré constant as the standard Gaussian measure, then it almost splits off a Gaussian factor, and… ▽ More

    Submitted 14 September, 2018; v1 submitted 25 July, 2018; originally announced July 2018.

    Comments: 25 pages. V2 includes new results on logarithmic Sobolev inequalities and Gaussian concentration. Comments are welcome

  15. arXiv:1807.00027  [pdf, ps, other

    math.PR cs.IT math.FA

    Bounds on the Poincaré constant for convolution measures

    Authors: Thomas A. Courtade

    Abstract: We establish a Shearer-type inequality for the Poincaré constant, showing that the Poincaré constant corresponding to the convolution of a collection of measures can be nontrivially controlled by the Poincaré constants corresponding to convolutions of subsets of measures. This implies, for example, that the Poincaré constant is non-increasing along the central limit theorem. We also establish a di… ▽ More

    Submitted 29 June, 2018; originally announced July 2018.

    Comments: comments welcome

  16. arXiv:1707.06217  [pdf, other

    cs.LG cs.AI cs.IT stat.ML

    Worst-case vs Average-case Design for Estimation from Fixed Pairwise Comparisons

    Authors: Ashwin Pananjady, Cheng Mao, Vidya Muthukumar, Martin J. Wainwright, Thomas A. Courtade

    Abstract: Pairwise comparison data arises in many domains, including tournament rankings, web search, and preference elicitation. Given noisy comparisons of a fixed subset of pairs of items, we study the problem of estimating the underlying comparison probabilities under the assumption of strong stochastic transitivity (SST). We also consider the noisy sorting subclass of the SST model. We show that when th… ▽ More

    Submitted 19 July, 2017; originally announced July 2017.

  17. arXiv:1704.07461  [pdf, other

    stat.ML cs.IT math.ST

    Denoising Linear Models with Permuted Data

    Authors: Ashwin Pananjady, Martin J. Wainwright, Thomas A. Courtade

    Abstract: The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the minimax error rate that is sharp up to logarithmic factors. We also analyze the performance of two versions of a computationally efficient estimator, and establi… ▽ More

    Submitted 24 April, 2017; originally announced April 2017.

    Comments: To appear in part at ISIT 2017, Aachen

  18. arXiv:1704.06164  [pdf, ps, other

    cs.IT

    A Counterexample to the Vector Generalization of Costa's EPI, and Partial Resolution

    Authors: Thomas A. Courtade, Guangyue Han, Yaochen Wu

    Abstract: We give a counterexample to the vector generalization of Costa's entropy power inequality (EPI) due to Liu, Liu, Poor and Shamai. In particular, the claimed inequality can fail if the matix-valued parameter in the convex combination does not commute with the covariance of the additive Gaussian noise. Conversely, the inequality holds if these two matrices commute.

    Submitted 20 April, 2017; originally announced April 2017.

    Comments: 3 pages

  19. arXiv:1703.07707  [pdf, ps, other

    math.PR cs.IT math.FA

    Existence of Stein Kernels under a Spectral Gap, and Discrepancy Bound

    Authors: Thomas A. Courtade, Max Fathi, Ashwin Pananjady

    Abstract: We establish existence of Stein kernels for probability measures on $\mathbb{R}^d$ satisfying a Poincaré inequality, and obtain bounds on the Stein discrepancy of such measures. Applications to quantitative central limit theorems are discussed, including a new CLT in Wasserstein distance $W_2$ with optimal rate and dependence on the dimension. As a byproduct, we obtain a stability version of an es… ▽ More

    Submitted 8 March, 2018; v1 submitted 22 March, 2017; originally announced March 2017.

    Comments: revised version, comments are welcome

  20. arXiv:1702.06260  [pdf, ps, other

    cs.IT

    Information-Theoretic Perspectives on Brascamp-Lieb Inequality and Its Reverse

    Authors: **gbo Liu, Thomas A. Courtade, Paul Cuff, Sergio Verdu

    Abstract: We introduce an inequality which may be viewed as a generalization of both the Brascamp-Lieb inequality and its reverse (Barthe's inequality), and prove its information-theoretic (i.e.\ entropic) formulation. This result leads to a unified approach to functional inequalities such as the variational formula of Rényi entropy, hypercontractivity and its reverse, strong data processing inequalities, a… ▽ More

    Submitted 3 December, 2017; v1 submitted 20 February, 2017; originally announced February 2017.

    Comments: Corrected some typos in the previous version

  21. arXiv:1610.07969  [pdf, ps, other

    cs.IT math.FA math.PR

    Wasserstein Stability of the Entropy Power Inequality for Log-Concave Densities

    Authors: Thomas A. Courtade, Max Fathi, Ashwin Pananjady

    Abstract: We establish quantitative stability results for the entropy power inequality (EPI). Specifically, we show that if uniformly log-concave densities nearly saturate the EPI, then they must be close to Gaussian densities in the quadratic Wasserstein distance. Further, if one of the densities is log-concave and the other is Gaussian, then the deficit in the EPI can be controlled in terms of the $L^1$-W… ▽ More

    Submitted 25 October, 2016; originally announced October 2016.

    Comments: 19 pages

  22. arXiv:1610.07306  [pdf, other

    q-bio.PE stat.ME

    Novel probabilistic models of spatial genetic ancestry with applications to stratification correction in genome-wide association studies

    Authors: Anand Bhaskar, Adel Javanmard, Thomas A. Courtade, David Tse

    Abstract: Genetic variation in human populations is influenced by geographic ancestry due to spatial locality in historical mating and migration patterns. Spatial population structure in genetic datasets has been traditionally analyzed using either model-free algorithms, such as principal components analysis (PCA) and multidimensional scaling, or using explicit spatial probabilistic models of allele frequen… ▽ More

    Submitted 25 October, 2016; v1 submitted 24 October, 2016; originally announced October 2016.

    Comments: Supplementary information included to the main text

  23. arXiv:1610.04174  [pdf, ps, other

    cs.IT math.PR

    Monotonicity of Entropy and Fisher Information: A Quick Proof via Maximal Correlation

    Authors: Thomas A. Courtade

    Abstract: A simple proof is given for the monotonicity of entropy and Fisher information associated to sums of i.i.d. random variables. The proof relies on a characterization of maximal correlation for partial sums due to Dembo, Kagan and Shepp.

    Submitted 13 October, 2016; originally announced October 2016.

    Comments: To appear, Communications on Information and Systems

  24. arXiv:1608.05431  [pdf, ps, other

    cs.IT

    Links between the Logarithmic Sobolev Inequality and the convolution inequalities for Entropy and Fisher Information

    Authors: Thomas A. Courtade

    Abstract: Relative to the Gaussian measure on $\mathbb{R}^d$, entropy and Fisher information are famously related via Gross' logarithmic Sobolev inequality (LSI). These same functionals also separately satisfy convolution inequalities, as proved by Stam. We establish a dimension-free inequality that interpolates among these relations. Several interesting corollaries follow: (i) the deficit in the LSI satisf… ▽ More

    Submitted 18 August, 2016; originally announced August 2016.

  25. arXiv:1608.05430  [pdf, ps, other

    cs.IT math.PR

    Entropy Jumps for Radially Symmetric Random Vectors

    Authors: Thomas A. Courtade

    Abstract: We establish a quantitative bound on the entropy jump associated to the sum of independent, identically distributed (IID) radially symmetric random vectors having dimension greater than one. Following the usual approach, we first consider the analogous problem of Fisher information dissipation, and then integrate along the Ornstein-Uhlenbeck semigroup to obtain an entropic inequality. In a departu… ▽ More

    Submitted 3 November, 2016; v1 submitted 18 August, 2016; originally announced August 2016.

    Comments: 19 pages. Updates relative to v1: Fixed a reference and added another

  26. arXiv:1608.02902  [pdf, other

    math.ST cs.IT stat.ML

    Linear Regression with an Unknown Permutation: Statistical and Computational Limits

    Authors: Ashwin Pananjady, Martin J. Wainwright, Thomas A. Courtade

    Abstract: Consider a noisy linear observation model with an unknown permutation, based on observing $y = Π^* A x^* + w$, where $x^* \in \mathbb{R}^d$ is an unknown vector, $Π^*$ is an unknown $n \times n$ permutation matrix, and $w \in \mathbb{R}^n$ is additive Gaussian noise. We analyze the problem of permutation recovery in a random design setting in which the entries of the matrix $A$ are drawn i.i.d. fr… ▽ More

    Submitted 9 August, 2016; originally announced August 2016.

    Comments: To appear in part at the 2016 Allerton Conference on Control, Communication and Computing

  27. arXiv:1605.02818  [pdf, ps, other

    cs.IT

    Brascamp-Lieb Inequality and Its Reverse: An Information Theoretic View

    Authors: **gbo Liu, Thomas A. Courtade, Paul Cuff, Sergio Verdu

    Abstract: We generalize a result by Carlen and Cordero-Erausquin on the equivalence between the Brascamp-Lieb inequality and the subadditivity of relative entropy by allowing for random transformations (a broadcast channel). This leads to a unified perspective on several functional inequalities that have been gaining popularity in the context of proving impossibility results. We demonstrate that the informa… ▽ More

    Submitted 9 May, 2016; originally announced May 2016.

    Comments: 5 pages; to be presented at ISIT 2016

  28. arXiv:1605.01941  [pdf, other

    cs.IT q-bio.GN

    Partial DNA Assembly: A Rate-Distortion Perspective

    Authors: Ilan Shomorony, Govinda M. Kamath, Fei Xia, Thomas A. Courtade, David N. Tse

    Abstract: Earlier formulations of the DNA assembly problem were all in the context of perfect assembly; i.e., given a set of reads from a long genome sequence, is it possible to perfectly reconstruct the original sequence? In practice, however, it is very often the case that the read data is not sufficiently rich to permit unambiguous reconstruction of the original sequence. While a natural generalization o… ▽ More

    Submitted 6 May, 2016; originally announced May 2016.

    Comments: To be published at ISIT-2016. 11 pages, 10 figures

  29. arXiv:1602.03033  [pdf, ps, other

    cs.IT

    Strengthening the Entropy Power Inequality

    Authors: Thomas A. Courtade

    Abstract: We tighten the Entropy Power Inequality (EPI) when one of the random summands is Gaussian. Our strengthening is closely connected to the concept of strong data processing for Gaussian channels and generalizes the (vector extension of) Costa's EPI. This leads to a new reverse entropy power inequality and, as a corollary, sharpens Stam's inequality relating entropy power and Fisher information. Appl… ▽ More

    Submitted 9 February, 2016; originally announced February 2016.

    Comments: 23 pages. Full version of submission to 2016 International Symposium on Information Theory. Presented in part at Institut Henri Poincaré Feb 10, 2016

  30. arXiv:1602.02216  [pdf, ps, other

    cs.IT

    Smoothing Brascamp-Lieb Inequalities and Strong Converses for Common Randomness Generation

    Authors: **gbo Liu, Thomas A. Courtade, Paul Cuff, Sergio Verdu

    Abstract: We study the infimum of the best constant in a functional inequality, the Brascamp-Lieb-like inequality, over auxiliary measures within a neighborhood of a product distribution. In the finite alphabet and the Gaussian cases, such an infimum converges to the best constant in a mutual information inequality. Implications for strong converse properties of two common randomness (CR) generation problem… ▽ More

    Submitted 6 February, 2016; originally announced February 2016.

    Comments: 7 pages; first 5 pages submitted to ISIT 2016

  31. arXiv:1504.02063  [pdf, ps, other

    cs.IT cs.DS

    Compressing Sparse Sequences under Local Decodability Constraints

    Authors: Ashwin Pananjady, Thomas A. Courtade

    Abstract: We consider a variable-length source coding problem subject to local decodability constraints. In particular, we investigate the blocklength scaling behavior attainable by encodings of $r$-sparse binary sequences, under the constraint that any source bit can be correctly decoded upon probing at most $d$ codeword bits. We consider both adaptive and non-adaptive access models, and derive upper and l… ▽ More

    Submitted 8 April, 2015; originally announced April 2015.

    Comments: 8 pages, 1 figure. First five pages to appear in 2015 International Symposium on Information Theory. This version contains supplementary material

  32. arXiv:1407.0333  [pdf, other

    cs.IT cs.CR

    Coded Cooperative Data Exchange for a Secret Key

    Authors: Thomas A. Courtade, Thomas R. Halford

    Abstract: We consider a coded cooperative data exchange problem with the goal of generating a secret key. Specifically, we investigate the number of public transmissions required for a set of clients to agree on a secret key with probability one, subject to the constraint that it remains private from an eavesdropper. Although the problems are closely related, we prove that secret key generation with fewes… ▽ More

    Submitted 1 July, 2014; originally announced July 2014.

    Comments: Full version of a paper that appeared at ISIT 2014. 19 pages, 2 figures

  33. arXiv:1302.3492  [pdf, ps, other

    cs.IT

    Outer Bounds for Multiterminal Source Coding via a Strong Data Processing Inequality

    Authors: Thomas A. Courtade

    Abstract: An intuitive outer bound for the multiterminal source coding problem is given. The proposed bound explicitly couples the rate distortion functions for each source and correlation measures which derive from a "strong" data processing inequality. Unlike many standard outer bounds, the proposed bound is not parameterized by a continuous family of auxiliary random variables, but instead only requires… ▽ More

    Submitted 15 July, 2013; v1 submitted 14 February, 2013; originally announced February 2013.

    Comments: 5 pages, 2 figures. Presented at ISIT 2013 in Istanbul, Turkey. (NOTE: v2 corrects an error in v1 due to its use of the Erkip-Cover strong data processing inequality. This inequality has recently been corrected by Anantharam et al. in arxiv/1304.6133v1 [cs.IT])

  34. arXiv:1302.2512  [pdf, ps, other

    cs.IT

    Which Boolean Functions are Most Informative?

    Authors: Gowtham R. Kumar, Thomas A. Courtade

    Abstract: We introduce a simply stated conjecture regarding the maximum mutual information a Boolean function can reveal about noisy inputs. Specifically, let $X^n$ be i.i.d. Bernoulli(1/2), and let $Y^n$ be the result of passing $X^n$ through a memoryless binary symmetric channel with crossover probability $α$. For any Boolean function $b:\{0,1\}^n\rightarrow \{0,1\}$, we conjecture that… ▽ More

    Submitted 15 July, 2013; v1 submitted 11 February, 2013; originally announced February 2013.

    Comments: 5 pages, 1 figure. Presented at ISIT 2013 in Istanbul, Turkey. (v2 corrects minor typos present in v1)

  35. arXiv:1203.3445  [pdf, other

    cs.IT

    Coded Cooperative Data Exchange in Multihop Networks

    Authors: Thomas A. Courtade, Richard D. Wesel

    Abstract: Consider a connected network of n nodes that all wish to recover k desired packets. Each node begins with a subset of the desired packets and exchanges coded packets with its neighbors. This paper provides necessary and sufficient conditions which characterize the set of all transmission schemes that permit every node to ultimately learn (recover) all k packets. When the network satisfies certain… ▽ More

    Submitted 15 March, 2012; originally announced March 2012.

    Comments: 49 pages, 6 figures, submitted to Transactions on Information Theory