Showing 1–7 of 7 results for author: Pinelis, I

An Information-Theoretic Analog of the Twin Paradox

Authors: Mladen Kovačević, Iosif Pinelis, Marios Kountouris

Abstract: We revisit the familiar scenario involving two parties in relative motion, in which Alice stays at rest while Bob goes on a journey at speed $βc$ along an arbitrary trajectory and reunites with Alice after a certain period of time. It is a well-known consequence of special relativity that the time that passes until they meet again is different for the two parties and is shorter in Bob's frame by a… ▽ More We revisit the familiar scenario involving two parties in relative motion, in which Alice stays at rest while Bob goes on a journey at speed $βc$ along an arbitrary trajectory and reunites with Alice after a certain period of time. It is a well-known consequence of special relativity that the time that passes until they meet again is different for the two parties and is shorter in Bob's frame by a factor of $\sqrt{1-β^2}$. We investigate how this asymmetry manifests from an information-theoretic viewpoint. Assuming that Alice and Bob transmit signals of equal average power to each other during the whole journey, and that additive white Gaussian noise is present at both sides, we show that the maximum number of bits per second that Alice can transmit reliably to Bob is always higher than the one Bob can transmit to Alice. Equivalently, the energy per bit invested by Alice is lower than that invested by Bob, meaning that the traveler is less efficient from the communication perspective, as conjectured by Jarett and Cover. △ Less

Submitted 16 April, 2024; v1 submitted 21 September, 2023; originally announced September 2023.

Comments: To appear in Europhysics Letters (EPL)

MSC Class: 83A05; 94A24; 94A40

Journal ref: EPL, vol. 146, no. 4, art. no. 42002, 2024

Modulus of continuity of the quantum $f$-entropy with respect to the trace distance

Authors: Iosif Pinelis

Abstract: A well-known result due to Fannes is a certain upper bound on the modulus of continuity of the von Neumann entropy with respect to the trace distance between density matrices; this distance is the maximum probability of distinguishing between the corresponding quantum states. Much more recently, Audenaert obtained an exact expression of this modulus of continuity. In the present note, Audenaert'… ▽ More A well-known result due to Fannes is a certain upper bound on the modulus of continuity of the von Neumann entropy with respect to the trace distance between density matrices; this distance is the maximum probability of distinguishing between the corresponding quantum states. Much more recently, Audenaert obtained an exact expression of this modulus of continuity. In the present note, Audenaert's result is extended to a broad class of entropy functions indexed by arbitrary continuous convex functions $f$ in place of the Shannon--von Neumann function $x\mapsto x\log_2x$. The proof is based on the Schur majorization. △ Less

Submitted 26 August, 2021; v1 submitted 21 July, 2021; originally announced July 2021.

Comments: An acknowledgment of priority is added

MSC Class: Primary 15A42; 26B25; 26D15; 47A30; 47A63; 47B06; 94A17; secondary 47A60; 47B15; 47B65; 47A70

Differentially Private Fractional Frequency Moments Estimation with Polylogarithmic Space

Authors: Lun Wang, Iosif Pinelis, Dawn Song

Abstract: We prove that $\mathbb{F}_p$ sketch, a well-celebrated streaming algorithm for frequency moments estimation, is differentially private as is when $p\in(0, 1]$. $\mathbb{F}_p$ sketch uses only polylogarithmic space, exponentially better than existing DP baselines and only worse than the optimal non-private baseline by a logarithmic factor. The evaluation shows that $\mathbb{F}_p$ sketch can achieve… ▽ More We prove that $\mathbb{F}_p$ sketch, a well-celebrated streaming algorithm for frequency moments estimation, is differentially private as is when $p\in(0, 1]$. $\mathbb{F}_p$ sketch uses only polylogarithmic space, exponentially better than existing DP baselines and only worse than the optimal non-private baseline by a logarithmic factor. The evaluation shows that $\mathbb{F}_p$ sketch can achieve reasonable accuracy with strong privacy guarantees. △ Less

Submitted 30 September, 2021; v1 submitted 26 May, 2021; originally announced May 2021.

Exact upper and lower bounds on the misclassification probability

Authors: Iosif Pinelis

Abstract: Exact lower and upper bounds on the best possible misclassification probability for a finite number of classes are obtained in terms of the total variation norms of the differences between the sub-distributions over the classes. These bounds are compared with the exact bounds in terms of the conditional entropy obtained by Feder and Merhav. Exact lower and upper bounds on the best possible misclassification probability for a finite number of classes are obtained in terms of the total variation norms of the differences between the sub-distributions over the classes. These bounds are compared with the exact bounds in terms of the conditional entropy obtained by Feder and Merhav. △ Less

Submitted 8 February, 2018; v1 submitted 3 December, 2017; originally announced December 2017.

Comments: Version 3: exact upper bounds are added; results are compared with ones by Feder and Merhav. Version 4: additional discussion presented

MSC Class: 60E15; 62H30; 91B06 (Primary) 26D15; 26D20; 62C10; 68T10 (Secondary)

Exact Lower Bounds for the Agnostic Probably-Approximately-Correct (PAC) Machine Learning Model

Authors: Aryeh Kontorovich, Iosif Pinelis

Abstract: We provide an exact non-asymptotic lower bound on the minimax expected excess risk (EER) in the agnostic probably-ap\-proximately-correct (PAC) machine learning classification model and identify minimax learning algorithms as certain maximally symmetric and minimally randomized "voting" procedures. Based on this result, an exact asymptotic lower bound on the minimax EER is provided. This bound is… ▽ More We provide an exact non-asymptotic lower bound on the minimax expected excess risk (EER) in the agnostic probably-ap\-proximately-correct (PAC) machine learning classification model and identify minimax learning algorithms as certain maximally symmetric and minimally randomized "voting" procedures. Based on this result, an exact asymptotic lower bound on the minimax EER is provided. This bound is of the simple form $c_\infty/\sqrtν$ as $ν\to\infty$, where $c_\infty=0.16997\dots$ is a universal constant, $ν=m/d$, $m$ is the size of the training sample, and $d$ is the Vapnik--Chervonenkis dimension of the hypothesis class. It is shown that the differences between these asymptotic and non-asymptotic bounds, as well as the differences between these two bounds and the maximum EER of any learning algorithms that minimize the empirical risk, are asymptotically negligible, and all these differences are due to ties in the mentioned "voting" procedures. A few easy to compute non-asymptotic lower bounds on the minimax EER are also obtained, which are shown to be close to the exact asymptotic lower bound $c_\infty/\sqrtν$ even for rather small values of the ratio $ν=m/d$. As an application of these results, we substantially improve existing lower bounds on the tail probability of the excess risk. Among the tools used are Bayes estimation and apparently new identities and inequalities for binomial distributions. △ Less

Submitted 30 December, 2017; v1 submitted 28 June, 2016; originally announced June 2016.

Comments: Version 2: modified presentation in accordance with referees' comments

MSC Class: Primary 68T05; 62C20; 62C10; 62C12; 62G20; 62H30; secondary 62G10; 62C20; 91A35; 60C05

Polygon Convexity: Another O(n) Test

Authors: Iosif Pinelis

Abstract: An n-gon is defined as a sequence ¶=(V_0,...,V_{n-1}) of n points on the plane. An n-gon ¶is said to be convex if the boundary of the convex hull of the set {V_0,...,V_{n-1}} of the vertices of ¶coincides with the union of the edges [V_0,V_1],...,[V_{n-1},V_0]; if at that no three vertices of ¶are collinear then ¶is called strictly convex. We prove that an n-gon ¶with n\ge3 is strictly convex if… ▽ More An n-gon is defined as a sequence ¶=(V_0,...,V_{n-1}) of n points on the plane. An n-gon ¶is said to be convex if the boundary of the convex hull of the set {V_0,...,V_{n-1}} of the vertices of ¶coincides with the union of the edges [V_0,V_1],...,[V_{n-1},V_0]; if at that no three vertices of ¶are collinear then ¶is called strictly convex. We prove that an n-gon ¶with n\ge3 is strictly convex if and only if a cyclic shift of the sequence (\al_0,...,\al_{n-1})\in[0,2π)^n of the angles between the x-axis and the vectors V_1-V_0,...,V_0-V_{n-1} is strictly monotone. A ``non-strict'' version of this result is also proved. △ Less

Submitted 16 January, 2007; v1 submitted 8 January, 2007; originally announced January 2007.

Comments: 14 pages; changes: (i) a test for non-strict convexity is added; (ii) the proofs are gathered in a separate section; (iii) a more detailed abstract is given

ACM Class: I.3.5; F.2.2; G.2.1; G.2.2

Polygon Convexity: A Minimal O(n) Test

Authors: Iosif Pinelis

Abstract: An O(n) test for polygon convexity is stated and proved. It is also proved that the test is minimal in a certain exact sense. An O(n) test for polygon convexity is stated and proved. It is also proved that the test is minimal in a certain exact sense. △ Less

Submitted 25 September, 2006; originally announced September 2006.

Comments: 14 pages

ACM Class: I.3.5; F.2.2; G.2.1; G.2.2