-
Tightening continuity bounds on entropies and bounds on quantum capacities
Authors:
Michael G. Jabbour,
Nilanjana Datta
Abstract:
Uniform continuity bounds on entropies are generally expressed in terms of a single distance measure between a pair of probability distributions or quantum states, typically, the total variation distance or trace distance. However, if an additional distance measure between the probability distributions or states is known, then the continuity bounds can be significantly strengthened. Here, we prove…
▽ More
Uniform continuity bounds on entropies are generally expressed in terms of a single distance measure between a pair of probability distributions or quantum states, typically, the total variation distance or trace distance. However, if an additional distance measure between the probability distributions or states is known, then the continuity bounds can be significantly strengthened. Here, we prove a tight uniform continuity bound for the Shannon entropy in terms of both the local- and total variation distances, sharpening an inequality proven in [I. Sason, IEEE Trans. Inf. Th., 59, 7118 (2013)]. We also obtain a uniform continuity bound for the von Neumann entropy in terms of both the operator norm- and trace distances. The bound is tight when the quotient of the trace distance by the operator norm distance is an integer. We then apply our results to compute upper bounds on the quantum- and private classical capacities of channels. We begin by refining the concept of approximate degradable channels, namely, $\varepsilon$-degradable channels, which are, by definition, $\varepsilon$-close in diamond norm to their complementary channel when composed with a degrading channel. To this end, we introduce the notion of $(\varepsilon,ν)$-degradable channels; these are $\varepsilon$-degradable channels that are, in addition, $ν$-close in completely bounded spectral norm to their complementary channel, when composed with the same degrading channel. This allows us to derive improved upper bounds to the quantum- and private classical capacities of such channels. Moreover, these bounds can be further improved by considering certain unstabilized versions of the above norms. We show that upper bounds on the latter can be efficiently expressed as semidefinite programs. We illustrate our results by obtaining a new upper bound on the quantum capacity of the qubit depolarizing channel.
△ Less
Submitted 2 November, 2023; v1 submitted 26 October, 2023;
originally announced October 2023.
-
From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions
Authors:
Simon Becker,
Nilanjana Datta,
Michael G. Jabbour
Abstract:
We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion o…
▽ More
We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion of maximal coupling of random variables. We then employ this classical result to derive the first tight energy-constrained continuity bound for the von Neumann entropy of states of infinite-dimensional quantum systems, when the Hamiltonian is the number operator, which is arguably the most relevant Hamiltonian in the study of infinite-dimensional quantum systems in the context of quantum information theory.
The above scheme works only for Shannon- and von Neumann entropies. Hence, to deal with more general entropies, e.g. $α$-Rényi and $α$-Tsallis entropies, with $α\in (0,1)$, for which continuity bounds are known only for finite-dimensional systems, we develop a novel approximation scheme which relies on recent results on operator Hölder continuous functions and the equivalence of all Schatten norms in special spectral subspaces of the Hamiltonian. This approach is, as we show, motivated by continuity bounds for $α$-Rényi and $α$-Tsallis entropies of random variables that follow from the Hölder continuity of the entropy functionals. Bounds for $α>1$ are provided, too. Finally, we settle an open problem on related approximation questions posed in the recent works by Shirokov on the so-called Finite-dimensional Approximation (FA) property.
△ Less
Submitted 17 July, 2023; v1 submitted 5 April, 2021;
originally announced April 2021.
-
A tight uniform continuity bound for the Arimoto-Rényi conditional entropy and its extension to classical-quantum states
Authors:
Michael G. Jabbour,
Nilanjana Datta
Abstract:
We prove a tight uniform continuity bound for Arimoto's version of the conditional $α$-Rényi entropy, for the range $α\in [0, 1)$. This definition of the conditional Rényi entropy is the most natural one among the multiple forms which exist in the literature, since it satisfies two desirable properties of a conditional entropy, namely, the fact that conditioning reduces entropy, and that the assoc…
▽ More
We prove a tight uniform continuity bound for Arimoto's version of the conditional $α$-Rényi entropy, for the range $α\in [0, 1)$. This definition of the conditional Rényi entropy is the most natural one among the multiple forms which exist in the literature, since it satisfies two desirable properties of a conditional entropy, namely, the fact that conditioning reduces entropy, and that the associated reduction in uncertainty cannot exceed the information gained by conditioning. Furthermore, it has found interesting applications in various information theoretic tasks such as guessing with side information and sequential decoding. This conditional entropy reduces to the conditional Shannon entropy in the limit $α\to 1$, and this in turn allows us to recover the recently obtained tight uniform continuity bound for the latter from our result. Finally, we apply our result to obtain a tight uniform continuity bound for the conditional $α$-Rényi entropy of a classical-quantum state, for $α$ in the same range as above. This again yields the corresponding known bound for the conditional entropy of the state in the limit $α\to 1$.
△ Less
Submitted 26 March, 2022; v1 submitted 9 July, 2020;
originally announced July 2020.
