Showing 1–31 of 31 results for author: Neininger, R

On fluctuations of complexity measures for the FIND algorithm

Authors: Jasper Ischebeck, Ralph Neininger

Abstract: The FIND algorithm (also called Quickselect) is a fundamental algorithm to select ranks or quantiles within a set of data. It was shown by Grübel and Rösler that the number of key comparisons required by Find as a process of the quantiles $α\in[0,1]$ in a natural probabilistic model converges after normalization in distribution within the càdlàg space $D[0,1]$ endowed with the Skorokhod metric. We… ▽ More The FIND algorithm (also called Quickselect) is a fundamental algorithm to select ranks or quantiles within a set of data. It was shown by Grübel and Rösler that the number of key comparisons required by Find as a process of the quantiles $α\in[0,1]$ in a natural probabilistic model converges after normalization in distribution within the càdlàg space $D[0,1]$ endowed with the Skorokhod metric. We show that the process of the residuals in the latter convergence after normalization converges in distribution to a mixture of Gaussian processes in $D[0,1]$ and identify the limit's conditional covariance functions. A similar result holds for the related algorithm QuickVal. Our method extends to other cost measures such as the number of swaps (key exchanges) required by Find or cost measures which are based on key comparisons but take into account that the cost of a comparison between two keys may depend on their values, an example being the number of bit comparisons needed to compare keys given by their bit expansions. △ Less

Submitted 12 March, 2024; originally announced March 2024.

Comments: This is an extended abstract later to be replaced by its full paper version

MSC Class: 60F17; 68Q25; 68P10; 60C05

Patricia's Bad Distributions

Authors: Louigi Addario-Berry, Pat Morin, Ralph Neininger

Abstract: The height of a random PATRICIA tree built from independent, identically distributed infinite binary strings with arbitrary diffuse probability distribution $μ$ on $\{0,1\}^\mathbb{N}$ is studied. We show that the expected height grows asymptotically sublinearly in the number of leaves for any such $μ$, but can be made to exceed any specific sublinear growth rate by choosing $μ$ appropriately. The height of a random PATRICIA tree built from independent, identically distributed infinite binary strings with arbitrary diffuse probability distribution $μ$ on $\{0,1\}^\mathbb{N}$ is studied. We show that the expected height grows asymptotically sublinearly in the number of leaves for any such $μ$, but can be made to exceed any specific sublinear growth rate by choosing $μ$ appropriately. △ Less

Submitted 18 May, 2024; v1 submitted 8 March, 2024; originally announced March 2024.

Comments: Revised version. Accepted for publication in the proceedings of the 35th International Conference on Probabilistic, Combinatorial and Asymptotic Methods for the Analysis of Algorithms (AofA2024)

MSC Class: 68P05; 60C05; 68R15; 68P10

Bivariate change point detection in movement direction and speed

Authors: Solveig Plomer, Theresa Ernst, Philipp Gebhardt, Enrico Schleiff, Ralph Neininger, Gaby Schneider

Abstract: Biological movement patterns can sometimes be quasi linear with abrupt changes in direction and speed, as in plastids in root cells investigated here. For the analysis of such changes we propose a new stochastic model for movement along linear structures. Maximum likelihood estimators are provided, and due to serial dependencies of increments, the classical MOSUM statistic is replaced by a moving… ▽ More Biological movement patterns can sometimes be quasi linear with abrupt changes in direction and speed, as in plastids in root cells investigated here. For the analysis of such changes we propose a new stochastic model for movement along linear structures. Maximum likelihood estimators are provided, and due to serial dependencies of increments, the classical MOSUM statistic is replaced by a moving kernel estimator. Convergence of the resulting difference process and strong consistency of the variance estimator are shown. We estimate the change points and propose a graphical technique to distinguish between change points in movement direction and speed. △ Less

Submitted 4 February, 2024; originally announced February 2024.

MSC Class: Primary 62P10; 60F17; Secondary: 60G15; 60G50

On solutions of the distributional Bellman equation

Authors: Julian Gerstenberg, Ralph Neininger, Denis Spiegel

Abstract: In distributional reinforcement learning not only expected returns but the complete return distributions of a policy are taken into account. The return distribution for a fixed policy is given as the solution of an associated distributional Bellman equation. In this note we consider general distributional Bellman equations and study existence and uniqueness of their solutions as well as tail prope… ▽ More In distributional reinforcement learning not only expected returns but the complete return distributions of a policy are taken into account. The return distribution for a fixed policy is given as the solution of an associated distributional Bellman equation. In this note we consider general distributional Bellman equations and study existence and uniqueness of their solutions as well as tail properties of return distributions. We give necessary and sufficient conditions for existence and uniqueness of return distributions and identify cases of regular variation. We link distributional Bellman equations to multivariate affine distributional equations. We show that any solution of a distributional Bellman equation can be obtained as the vector of marginal laws of a solution to a multivariate affine distributional equation. This makes the general theory of such equations applicable to the distributional reinforcement learning setting. △ Less

Submitted 26 May, 2023; v1 submitted 31 January, 2022; originally announced February 2022.

Comments: Largely revised version to appear in Electron. Res. Arch. (Special Issue: Mathematics of Machine Learning and Related Topics)

MSC Class: 60E05; 60H25 (Primary) 68T05; 90C40 (Secondary)

A note on the independence number, domination number and related parameters of random binary search trees and random recursive trees

Authors: Michael Fuchs, Cecilia Holmgren, Dieter Mitsche, Ralph Neininger

Abstract: We identify the mean growth of the independence number of random binary search trees and random recursive trees and show normal fluctuations around their means. Similarly we also show normal limit laws for the domination number and variations of it for these two cases of random tree models. Our results are an application of a recent general theorem of Holmgren and Janson on fringe trees in these t… ▽ More We identify the mean growth of the independence number of random binary search trees and random recursive trees and show normal fluctuations around their means. Similarly we also show normal limit laws for the domination number and variations of it for these two cases of random tree models. Our results are an application of a recent general theorem of Holmgren and Janson on fringe trees in these two random tree models. △ Less

Submitted 10 February, 2020; v1 submitted 27 September, 2019; originally announced September 2019.

MSC Class: 60C05 (Primary) 05C69; 05C05; 05C80; 60F05; 05C15 (Secondary)

Node Profiles of Symmetric Digital Search Trees: Concentration Properties

Authors: Michael Drmota, Michael Fuchs, Hsien-Kuei Hwang, Ralph Neininger

Abstract: We give a detailed asymptotic analysis of the profiles of random symmetric digital search trees, which are in close connection with the performance of the search complexity of random queries in such trees. While the expected profiles have been analyzed for several decades, the analysis of the variance turns out to be very difficult and challenging, and requires the combination of several different… ▽ More We give a detailed asymptotic analysis of the profiles of random symmetric digital search trees, which are in close connection with the performance of the search complexity of random queries in such trees. While the expected profiles have been analyzed for several decades, the analysis of the variance turns out to be very difficult and challenging, and requires the combination of several different analytic techniques, including Mellin and Laplace transforms, analytic de-Poissonization, and Laplace convolutions. Our results imply concentration of the profiles in the range where the mean tends to infinity. Moreover, we also obtain a two-point concentration for the distributions of the height and the saturation level. △ Less

Submitted 28 September, 2020; v1 submitted 18 November, 2017; originally announced November 2017.

Comments: The central limit theorem was removed from this version (and moved to a follow-up paper) since the proof in the previous versions was incomplete. Also, the word "Concentration Properties" was added to the title since this part now entirely focuses on such results

MSC Class: 05A16; 60C05; 68Q25; 68P05; 60F05

Probabilistic Analysis of the Dual-Pivot Quicksort "Count"

Authors: Ralph Neininger, Jasmin Straub

Abstract: Recently, Aumüller and Dietzfelbinger proposed a version of a dual-pivot quicksort, called "Count", which is optimal among dual-pivot versions with respect to the average number of key comparisons required. In this note we provide further probabilistic analysis of "Count". We derive an exact formula for the average number of swaps needed by "Count" as well as an asymptotic formula for the variance… ▽ More Recently, Aumüller and Dietzfelbinger proposed a version of a dual-pivot quicksort, called "Count", which is optimal among dual-pivot versions with respect to the average number of key comparisons required. In this note we provide further probabilistic analysis of "Count". We derive an exact formula for the average number of swaps needed by "Count" as well as an asymptotic formula for the variance of the number of swaps and a limit law. Also for the number of key comparisons the asymptotic variance and a limit law are identified. We also consider both complexity measures jointly and find their asymptotic correlation. △ Less

Submitted 20 October, 2017; originally announced October 2017.

Comments: To appear in the proceedings of Analytic Algorithmics and Combinatorics (ANALCO18)

Refined Asymptotics for the Composition of Cyclic Urns

Authors: Noela Müller, Ralph Neininger

Abstract: A cyclic urn is an urn model for balls of types $0,\ldots,m-1$. The urn starts at time zero with an initial configuration. Then, in each time step, first a ball is drawn from the urn uniformly and independently from the past. If its type is $j$, it is then returned to the urn together with a new ball of type $j+1 \mod m$. The case $m=2$ is the well-known Friedman urn. The composition vector, i.e.,… ▽ More A cyclic urn is an urn model for balls of types $0,\ldots,m-1$. The urn starts at time zero with an initial configuration. Then, in each time step, first a ball is drawn from the urn uniformly and independently from the past. If its type is $j$, it is then returned to the urn together with a new ball of type $j+1 \mod m$. The case $m=2$ is the well-known Friedman urn. The composition vector, i.e., the vector of the numbers of balls of each type after $n$ steps is, after normalization, known to be asymptotically normal for $2\le m\le 6$. For $m\ge 7$ the normalized composition vector is known not to converge. However, there is an almost sure approximation by a periodic random vector. In the present paper the asymptotic fluctuations around this periodic random vector are identified. We show that these fluctuations are asymptotically normal for all $7\le m\le 12$. For $m\ge 13$ we also find asymptotically normal fluctuations when normalizing in a more refined way. These fluctuations are of maximal dimension $m-1$ only when $6$ does not divide $m$. For $m$ being a multiple of $6$ the fluctuations are supported by a two-dimensional subspace. △ Less

Submitted 12 March, 2019; v1 submitted 28 December, 2016; originally announced December 2016.

Comments: arXiv admin note: text overlap with arXiv:1507.08119

Process convergence for the complexity of Radix Selection on Markov sources

Authors: Kevin Leckey, Ralph Neininger, Henning Sulzbach

Abstract: A fundamental algorithm for selecting ranks from a finite subset of an ordered set is Radix Selection. This algorithm requires the data to be given as strings of symbols over an ordered alphabet, e.g., binary expansions of real numbers. Its complexity is measured by the number of symbols that have to be read. In this paper the model of independent data identically generated from a Markov chain is… ▽ More A fundamental algorithm for selecting ranks from a finite subset of an ordered set is Radix Selection. This algorithm requires the data to be given as strings of symbols over an ordered alphabet, e.g., binary expansions of real numbers. Its complexity is measured by the number of symbols that have to be read. In this paper the model of independent data identically generated from a Markov chain is considered. The complexity is studied as a stochastic process indexed by the set of infinite strings over the given alphabet. The orders of mean and variance of the complexity and, after normalization, a limit theorem with a centered Gaussian process as limit are derived. This implies an analysis for two standard models for the ranks: uniformly chosen ranks, also called grand averages, and the worst case rank complexities which are of interest in computer science. For uniform data and the asymmetric Bernoulli model (i.e. memoryless sources), we also find weak convergence for the normalized process of complexities when indexed by the ranks while for more general Markov sources these processes are not tight under the standard normalizations. △ Less

Submitted 2 October, 2017; v1 submitted 8 May, 2016; originally announced May 2016.

Comments: main results significantly improved, 4 figures

MSC Class: 60F17; 60G15; 68P10; 60C05; 68Q25

The CLT Analogue for Cyclic Urns

Authors: Noela S. Müller, Ralph Neininger

Abstract: A cyclic urn is an urn model for balls of types $0,\ldots,m-1$ where in each draw the ball drawn, say of type $j$, is returned to the urn together with a new ball of type $j+1 \mod m$. The case $m=2$ is the well-known Friedman urn. The composition vector, i.e., the vector of the numbers of balls of each type after $n$ steps is, after normalization, known to be asymptotically normal for… ▽ More A cyclic urn is an urn model for balls of types $0,\ldots,m-1$ where in each draw the ball drawn, say of type $j$, is returned to the urn together with a new ball of type $j+1 \mod m$. The case $m=2$ is the well-known Friedman urn. The composition vector, i.e., the vector of the numbers of balls of each type after $n$ steps is, after normalization, known to be asymptotically normal for $2\le m\le 6$. For $m\ge 7$ the normalized composition vector does not converge. However, there is an almost sure approximation by a periodic random vector. In this paper the asymptotic fluctuations around this periodic random vector are identified. We show that these fluctuations are asymptotically normal for all $m\ge 7$. However, they are of maximal dimension $m-1$ only when $6$ does not divide $m$. For $m$ being a multiple of $6$ the fluctuations are supported by a two-dimensional subspace. △ Less

Submitted 29 July, 2015; originally announced July 2015.

Comments: Extended abstract to be replaced later by a full version

A Limit Theorem for Radix Sort and Tries with Markovian Input

Authors: Kevin Leckey, Ralph Neininger, Wojciech Szpankowski

Abstract: Tries are among the most versatile and widely used data structures on words. In particular, they are used in fundamental sorting algorithms such as radix sort which we study in this paper. While the performance of radix sort and tries under a realistic probabilistic model for the generation of words is of significant importance, its analysis, even for simplest memoryless sources, has proved diffic… ▽ More Tries are among the most versatile and widely used data structures on words. In particular, they are used in fundamental sorting algorithms such as radix sort which we study in this paper. While the performance of radix sort and tries under a realistic probabilistic model for the generation of words is of significant importance, its analysis, even for simplest memoryless sources, has proved difficult. In this paper we consider a more realistic model where words are generated by a Markov source. By a novel use of the contraction method combined with moment transfer techniques we prove a central limit theorem for the complexity of radix sort and for the external path length in a trie. This is the first application of the contraction method to the analysis of algorithms and data structures with Markovian inputs; it relies on the use of systems of stochastic recurrences combined with a product version of the Zolotarev metric. △ Less

Submitted 27 May, 2015; originally announced May 2015.

MSC Class: 60F05; 60C05; 68P10; 68Q25

Dependence and phase changes in random $m$-ary search trees

Authors: Hua-Huai Chern, Michael Fuchs, Hsien-Kuei Hwang, Ralph Neininger

Abstract: We study the joint asymptotic behavior of the space requirement and the total path length (either summing over all root-key distances or over all root-node distances) in random $m$-ary search trees. The covariance turns out to exhibit a change of asymptotic behavior: it is essentially linear when $3\le m\le 13$ but becomes of higher order when $m\ge14$. Surprisingly, the corresponding asymptotic c… ▽ More We study the joint asymptotic behavior of the space requirement and the total path length (either summing over all root-key distances or over all root-node distances) in random $m$-ary search trees. The covariance turns out to exhibit a change of asymptotic behavior: it is essentially linear when $3\le m\le 13$ but becomes of higher order when $m\ge14$. Surprisingly, the corresponding asymptotic correlation coefficient tends to zero when $3\le m\le 26$ but is periodically oscillating for larger $m$. Such a less anticipated phenomenon is not exceptional and we extend the results in two directions: one for more general shape parameters, and the other for other classes of random log-trees such as fringe-balanced binary search trees and quadtrees. The methods of proof combine asymptotic transfer for the underlying recurrence relations with the contraction method. △ Less

Submitted 25 February, 2016; v1 submitted 21 January, 2015; originally announced January 2015.

Comments: Revised unabridged version of our paper accepted for publication in Random Structures & Algorithms

MSC Class: 60F05; 68Q25; 68P05; 60C05; 05A16

Analysis of radix selection on Markov sources

Authors: Kevin Leckey, Ralph Neininger, Henning Sulzbach

Abstract: The complexity of the algorithm Radix Selection is considered for independent data generated from a Markov source. The complexity is measured by the number of bucket operations required and studied as a stochastic process indexed by the ranks; also the case of a uniformly chosen rank is considered. The orders of mean and variance of the complexity and limit theorems are derived. We find weak conve… ▽ More The complexity of the algorithm Radix Selection is considered for independent data generated from a Markov source. The complexity is measured by the number of bucket operations required and studied as a stochastic process indexed by the ranks; also the case of a uniformly chosen rank is considered. The orders of mean and variance of the complexity and limit theorems are derived. We find weak convergence of the appropriately normalized complexity towards a Gaussian process with explicit mean and covariance functions (in the space D[0,1] of cadlag functions on [0,1] with the Skorokhod metric) for uniform data and the asymmetric Bernoulli model. For uniformly chosen ranks and uniformly distributed data the normalized complexity was known to be asymptotically normal. For a general Markov source (excluding the uniform case) we find that this complexity is less concentrated and admits a limit law with non-normal limit distribution. △ Less

Submitted 14 April, 2014; originally announced April 2014.

Comments: To appear in the proceedings of the 25th International Conference on Probabilistic, Combinatorial and Asymptotic Methods for the Analysis of Algorithms (AofA14), 2014

MSC Class: 68P10; 60F17; 60G15; 60C05; 68Q25

A statistical view on exchanges in Quickselect

Authors: Benjamin Dadoun, Ralph Neininger

Abstract: In this paper we study the number of key exchanges required by Hoare's FIND algorithm (also called Quickselect) when operating on a uniformly distributed random permutation and selecting an independent uniformly distributed rank. After normalization we give a limit theorem where the limit law is a perpetuity characterized by a recursive distributional equation. To make the limit theorem usable for… ▽ More In this paper we study the number of key exchanges required by Hoare's FIND algorithm (also called Quickselect) when operating on a uniformly distributed random permutation and selecting an independent uniformly distributed rank. After normalization we give a limit theorem where the limit law is a perpetuity characterized by a recursive distributional equation. To make the limit theorem usable for statistical methods and statistical experiments we provide an explicit rate of convergence in the Kolmogorov--Smirnov metric, a numerical table of the limit law's distribution function and an algorithm for exact simulation from the limit distribution. We also investigate the limit law's density. This case study provides a program applicable to other cost measures, alternative models for the rank selected and more balanced choices of the pivot element such as median-of-$2t+1$ versions of Quickselect as well as further variations of the algorithm. △ Less

Submitted 19 November, 2013; v1 submitted 31 July, 2013; originally announced July 2013.

Comments: Theorem 4.4 revised; accepted for publication in Analytic Algorithmics and Combinatorics (ANALCO14)

MSC Class: Primary 60F05; 68P10; secondary 60C05; 68Q25

A Gaussian limit process for optimal FIND algorithms

Authors: Henning Sulzbach, Ralph Neininger, Michael Drmota

Abstract: We consider versions of the FIND algorithm where the pivot element used is the median of a subset chosen uniformly at random from the data. For the median selection we assume that subsamples of size asymptotic to $c \cdot n^α$ are chosen, where $0<α\le \frac{1}{2}$, $c>0$ and $n$ is the size of the data set to be split. We consider the complexity of FIND as a process in the rank to be selected and… ▽ More We consider versions of the FIND algorithm where the pivot element used is the median of a subset chosen uniformly at random from the data. For the median selection we assume that subsamples of size asymptotic to $c \cdot n^α$ are chosen, where $0<α\le \frac{1}{2}$, $c>0$ and $n$ is the size of the data set to be split. We consider the complexity of FIND as a process in the rank to be selected and measured by the number of key comparisons required. After normalization we show weak convergence of the complexity to a centered Gaussian process as $n\to\infty$, which depends on $α$. The proof relies on a contraction argument for probability distributions on c{à}dl{à}g functions. We also identify the covariance function of the Gaussian limit process and discuss path and tail properties. △ Less

Submitted 19 November, 2013; v1 submitted 19 July, 2013; originally announced July 2013.

Comments: revised version

MSC Class: Primary 60F17; 68P10; secondary 60G15; 60C05; 68Q25

Average Case and Distributional Analysis of Dual-Pivot Quicksort

Authors: Sebastian Wild, Markus E. Nebel, Ralph Neininger

Abstract: In 2009, Oracle replaced the long-serving sorting algorithm in its Java 7 runtime library by a new dual-pivot Quicksort variant due to Vladimir Yaroslavskiy. The decision was based on the strikingly good performance of Yaroslavskiy's implementation in running time experiments. At that time, no precise investigations of the algorithm were available to explain its superior performance - on the contr… ▽ More In 2009, Oracle replaced the long-serving sorting algorithm in its Java 7 runtime library by a new dual-pivot Quicksort variant due to Vladimir Yaroslavskiy. The decision was based on the strikingly good performance of Yaroslavskiy's implementation in running time experiments. At that time, no precise investigations of the algorithm were available to explain its superior performance - on the contrary: Previous theoretical studies of other dual-pivot Quicksort variants even discouraged the use of two pivots. Only in 2012, two of the authors gave an average case analysis of a simplified version of Yaroslavskiy's algorithm, proving that savings in the number of comparisons are possible. However, Yaroslavskiy's algorithm needs more swaps, which renders the analysis inconclusive. To force the issue, we herein extend our analysis to the fully detailed style of Knuth: We determine the exact number of executed Java Bytecode instructions. Surprisingly, Yaroslavskiy's algorithm needs sightly more Bytecode instructions than a simple implementation of classic Quicksort - contradicting observed running times. Like in Oracle's library implementation we incorporate the use of Insertionsort on small subproblems and show that it indeed speeds up Yaroslavskiy's Quicksort in terms of Bytecodes; but even with optimal Insertionsort thresholds the new Quicksort variant needs slightly more Bytecode instructions on average. Finally, we show that the (suitably normalized) costs of Yaroslavskiy's algorithm converge to a random variable whose distribution is characterized by a fixed-point equation. From that, we compute variances of costs and show that for large n, costs are concentrated around their mean. △ Less

Submitted 13 February, 2015; v1 submitted 3 April, 2013; originally announced April 2013.

Comments: v3 is content-wise identical to TALG version

ACM Class: F.2.2; G.2.1; G.3; F.2.3; D.3.2

Journal ref: ACM Transactions on Algorithms 11, 3, Article 22 (Jan 2015)

A multiple filter test for the detection of rate changes in renewal processes with varying variance

Authors: Michael Messer, Marietta Kirchner, Julia Schiemann, Jochen Roeper, Ralph Neininger, Gaby Schneider

Abstract: Nonstationarity of the event rate is a persistent problem in modeling time series of events, such as neuronal spike trains. Motivated by a variety of patterns in neurophysiological spike train recordings, we define a general class of renewal processes. This class is used to test the null hypothesis of stationary rate versus a wide alternative of renewal processes with finitely many rate changes (c… ▽ More Nonstationarity of the event rate is a persistent problem in modeling time series of events, such as neuronal spike trains. Motivated by a variety of patterns in neurophysiological spike train recordings, we define a general class of renewal processes. This class is used to test the null hypothesis of stationary rate versus a wide alternative of renewal processes with finitely many rate changes (change points). Our test extends ideas from the filtered derivative approach by using multiple moving windows simultaneously. To adjust the rejection threshold of the test, we use a Gaussian process, which emerges as the limit of the filtered derivative process. We also develop a multiple filter algorithm, which can be used when the null hypothesis is rejected in order to estimate the number and location of change points. We analyze the benefits of multiple filtering and its increased detection probability as compared to a single window approach. Application to spike trains recorded from dopamine midbrain neurons in anesthetized mice illustrates the relevance of the proposed techniques as preprocessing steps for methods that assume rate stationarity. In over 70% of all analyzed spike trains classified as rate nonstationary, different change points were detected by different window sizes. △ Less

Submitted 16 January, 2015; v1 submitted 14 March, 2013; originally announced March 2013.

Comments: Published in at http://dx.doi.org/10.1214/14-AOAS782 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOAS-AOAS782

Journal ref: Annals of Applied Statistics 2014, Vol. 8, No. 4, 2027-2067

Polya urns via the contraction method

Authors: Margarete Knape, Ralph Neininger

Abstract: We propose an approach to analyze the asymptotic behavior of Pólya urns based on the contraction method. For this, a new combinatorial discrete time embedding of the evolution of the urn into random rooted trees is developed. A decomposition of these trees leads to a system of recursive distributional equations which capture the distributions of the numbers of balls of each color. Ideas from the c… ▽ More We propose an approach to analyze the asymptotic behavior of Pólya urns based on the contraction method. For this, a new combinatorial discrete time embedding of the evolution of the urn into random rooted trees is developed. A decomposition of these trees leads to a system of recursive distributional equations which capture the distributions of the numbers of balls of each color. Ideas from the contraction method are used to study such systems of recursive distributional equations asymptotically. We apply our approach to a couple of concrete Pólya urns that lead to limit laws with normal limit distributions, with non-normal limit distributions and with asymptotic periodic distributional behavior. △ Less

Submitted 19 November, 2013; v1 submitted 15 January, 2013; originally announced January 2013.

Comments: minor revision; accepted for publication in Combinatorics, Probability & Computing (Special issue dedicated to the memory of Philippe Flajolet)

MSC Class: 60C05; 60F05; 60J05; 68Q25

Journal ref: Combinator. Probab. Comp. 23 (2014) 1148-1186

Refined Quicksort asymptotics

Authors: Ralph Neininger

Abstract: The complexity of the Quicksort algorithm is usually measured by the number of key comparisons used during its execution. When operating on a list of $n$ data, permuted uniformly at random, the appropriately normalized complexity $Y_n$ is known to converge almost surely to a non-degenerate random limit $Y$. This assumes a natural embedding of all $Y_n$ on one probability space, e.g., via random bi… ▽ More The complexity of the Quicksort algorithm is usually measured by the number of key comparisons used during its execution. When operating on a list of $n$ data, permuted uniformly at random, the appropriately normalized complexity $Y_n$ is known to converge almost surely to a non-degenerate random limit $Y$. This assumes a natural embedding of all $Y_n$ on one probability space, e.g., via random binary search trees. In this note a central limit theorem for the error term in the latter almost sure convergence is shown: $$\sqrt{\frac{n}{2\log n}}(Y_n-Y) \stackrel{d}{\longrightarrow} {\cal N} \qquad (n\to\infty),$$ where ${\cal N}$ denotes a standard normal random variable. △ Less

Submitted 24 January, 2013; v1 submitted 19 July, 2012; originally announced July 2012.

Comments: revised version; title slightly changed; accepted for publication in Random Structures and Algorithms

MSC Class: 60F05; 60F15; 68P10; 68Q25

Towards More Realistic Probabilistic Models for Data Structures: The External Path Length in Tries under the Markov Model

Authors: Kevin Leckey, Ralph Neininger, Wojciech Szpankowski

Abstract: Tries are among the most versatile and widely used data structures on words. They are pertinent to the (internal) structure of (stored) words and several splitting procedures used in diverse contexts ranging from document taxonomy to IP addresses lookup, from data compression (i.e., Lempel-Ziv'77 scheme) to dynamic hashing, from partial-match queries to speech recognition, from leader election alg… ▽ More Tries are among the most versatile and widely used data structures on words. They are pertinent to the (internal) structure of (stored) words and several splitting procedures used in diverse contexts ranging from document taxonomy to IP addresses lookup, from data compression (i.e., Lempel-Ziv'77 scheme) to dynamic hashing, from partial-match queries to speech recognition, from leader election algorithms to distributed hashing tables and graph compression. While the performance of tries under a realistic probabilistic model is of significant importance, its analysis, even for simplest memoryless sources, has proved difficult. Rigorous findings about inherently complex parameters were rarely analyzed (with a few notable exceptions) under more realistic models of string generations. In this paper we meet these challenges: By a novel use of the contraction method combined with analytic techniques we prove a central limit theorem for the external path length of a trie under a general Markov source. In particular, our results apply to the Lempel-Ziv'77 code. We envision that the methods described here will have further applications to other trie parameters and data structures. △ Less

Submitted 18 September, 2012; v1 submitted 2 July, 2012; originally announced July 2012.

Comments: minor revision; to appear in Proceedings of ACM-SIAM Symposium on Discrete Algorithms (SODA) (2013)

MSC Class: 60F05; 68P05; 68Q25

Appendix to "Approximating perpetuities"

Authors: Margarete Knape, Ralph Neininger

Abstract: An algorithm for perfect simulation from the unique solution of the distributional fixed point equation $Y=_d UY + U(1-U)$ is constructed, where $Y$ and $U$ are independent and $U$ is uniformly distributed on $[0,1]$. This distribution comes up as a limit distribution in the probabilistic analysis of the Quickselect algorithm. Our simulation algorithm is based on coupling from the past with a mult… ▽ More An algorithm for perfect simulation from the unique solution of the distributional fixed point equation $Y=_d UY + U(1-U)$ is constructed, where $Y$ and $U$ are independent and $U$ is uniformly distributed on $[0,1]$. This distribution comes up as a limit distribution in the probabilistic analysis of the Quickselect algorithm. Our simulation algorithm is based on coupling from the past with a multigamma coupler. It has four lines of code. △ Less

Submitted 29 July, 2012; v1 submitted 3 March, 2012; originally announced March 2012.

MSC Class: 60J05; 65C05; 68U20; 60E05

Asymptotic analysis of Hoppe trees

Authors: Kevin Leckey, Ralph Neininger

Abstract: We introduce and analyze a random tree model associated to Hoppe's urn. The tree is built successively by adding nodes to the existing tree when starting with the single root node. In each step a node is added to the tree as a child of an existing node where these parent nodes are chosen randomly with probabilities proportional to their weights. The root node has weight $\vartheta>0$, a given fixe… ▽ More We introduce and analyze a random tree model associated to Hoppe's urn. The tree is built successively by adding nodes to the existing tree when starting with the single root node. In each step a node is added to the tree as a child of an existing node where these parent nodes are chosen randomly with probabilities proportional to their weights. The root node has weight $\vartheta>0$, a given fixed parameter, all other nodes have weight 1. This resembles the stochastic dynamic of Hoppe's urn. For $\vartheta=1$ the resulting tree is the well-studied random recursive tree. We analyze the height, internal path length and number of leaves of the Hoppe tree with $n$ nodes as well as the depth of the last inserted node asymptotically as $n\to \infty$. Mainly expectations, variances and asymptotic distributions of these parameters are derived. △ Less

Submitted 5 July, 2012; v1 submitted 11 February, 2012; originally announced February 2012.

MSC Class: 60F05; 60C05 (Primary) 60G42; 68R05 (Secondary)

On a functional contraction method

Authors: Ralph Neininger, Henning Sulzbach

Abstract: Methods for proving functional limit laws are developed for sequences of stochastic processes which allow a recursive distributional decomposition either in time or space. Our approach is an extension of the so-called contraction method to the space $\mathcal{C}[0,1]$ of continuous functions endowed with uniform topology and the space $\mathcal {D}[0,1]$ of càdlàg functions with the Skorokhod topo… ▽ More Methods for proving functional limit laws are developed for sequences of stochastic processes which allow a recursive distributional decomposition either in time or space. Our approach is an extension of the so-called contraction method to the space $\mathcal{C}[0,1]$ of continuous functions endowed with uniform topology and the space $\mathcal {D}[0,1]$ of càdlàg functions with the Skorokhod topology. The contraction method originated from the probabilistic analysis of algorithms and random trees where characteristics satisfy natural distributional recurrences. It is based on stochastic fixed-point equations, where probability metrics can be used to obtain contraction properties and allow the application of Banach's fixed-point theorem. We develop the use of the Zolotarev metrics on the spaces $\mathcal{C}[0,1]$ and $\mathcal{D}[0,1]$ in this context. Applications are given, in particular, a short proof of Donsker's functional limit theorem is derived and recurrences arising in the probabilistic analysis of algorithms are discussed. △ Less

Submitted 9 September, 2015; v1 submitted 7 February, 2012; originally announced February 2012.

Comments: Published at http://dx.doi.org/10.1214/14-AOP919 in the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP919

Journal ref: Annals of Probability 2015, Vol. 43, No. 4, 1777-1822

A limit process for partial match queries in random quadtrees and $2$-d trees

Authors: Nicolas Broutin, Ralph Neininger, Henning Sulzbach

Abstract: We consider the problem of recovering items matching a partially specified pattern in multidimensional trees (quadtrees and $k$-d trees). We assume the traditional model where the data consist of independent and uniform points in the unit square. For this model, in a structure on $n$ points, it is known that the number of nodes $C_n(ξ)$ to visit in order to report the items matching a random query… ▽ More We consider the problem of recovering items matching a partially specified pattern in multidimensional trees (quadtrees and $k$-d trees). We assume the traditional model where the data consist of independent and uniform points in the unit square. For this model, in a structure on $n$ points, it is known that the number of nodes $C_n(ξ)$ to visit in order to report the items matching a random query $ξ$, independent and uniformly distributed on $[0,1]$, satisfies $\mathbf {E}[{C_n(ξ)}]\simκn^β$, where $κ$ and $β$ are explicit constants. We develop an approach based on the analysis of the cost $C_n(s)$ of any fixed query $s\in[0,1]$, and give precise estimates for the variance and limit distribution of the cost $C_n(x)$. Our results permit us to describe a limit process for the costs $C_n(x)$ as $x$ varies in $[0,1]$; one of the consequences is that $\mathbf {E}[{\max_{x\in[0,1]}C_n(x)}]\sim γn^β$; this settles a question of Devroye [Pers. Comm., 2000]. △ Less

Submitted 5 December, 2013; v1 submitted 6 February, 2012; originally announced February 2012.

Comments: Published in at http://dx.doi.org/10.1214/12-AAP912 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org). arXiv admin note: text overlap with arXiv:1107.2231

Report number: IMS-AAP-AAP912

Journal ref: Annals of Applied Probability 2013, Vol. 23, No. 6, 2560-2603

Partial match queries in random quadtrees

Authors: Nicolas Broutin, Ralph Neininger, Henning Sulzbach

Abstract: We consider the problem of recovering items matching a partially specified pattern in multidimensional trees (quad trees and k-d trees). We assume the traditional model where the data consist of independent and uniform points in the unit square. For this model, in a structure on $n$ points, it is known that the number of nodes $C_n(ξ)$ to visit in order to report the items matching an independent… ▽ More We consider the problem of recovering items matching a partially specified pattern in multidimensional trees (quad trees and k-d trees). We assume the traditional model where the data consist of independent and uniform points in the unit square. For this model, in a structure on $n$ points, it is known that the number of nodes $C_n(ξ)$ to visit in order to report the items matching an independent and uniformly on $[0,1]$ random query $ξ$ satisfies $\Ec{C_n(ξ)}\sim κn^β$, where $κ$ and $β$ are explicit constants. We develop an approach based on the analysis of the cost $C_n(x)$ of any fixed query $x\in [0,1]$, and give precise estimates for the variance and limit distribution of the cost $C_n(x)$. Our results permit to describe a limit process for the costs $C_n(x)$ as $x$ varies in $[0,1]$; one of the consequences is that $E{\max_{x\in [0,1]} C_n(x)} \sim γn^β$. △ Less

Submitted 12 July, 2011; originally announced July 2011.

Comments: 12 pages, 2 figures

MSC Class: 05A16; 05A15; 05C05; 60C05

Approximating Perpetuities

Authors: Margarete Knape, Ralph Neininger

Abstract: We propose and analyze an algorithm to approximate distribution functions and densities of perpetuities. Our algorithm refines an earlier approach based on iterating discretized versions of the fixed point equation that defines the perpetuity. We significantly reduce the complexity of the earlier algorithm. Also one particular perpetuity arising in the analysis of the selection algorithm Quickse… ▽ More We propose and analyze an algorithm to approximate distribution functions and densities of perpetuities. Our algorithm refines an earlier approach based on iterating discretized versions of the fixed point equation that defines the perpetuity. We significantly reduce the complexity of the earlier algorithm. Also one particular perpetuity arising in the analysis of the selection algorithm Quickselect is studied in more detail. Our approach works well for distribution functions. For densities we have weaker error bounds although computer experiments indicate that densities can also be approximated well. △ Less

Submitted 7 November, 2007; originally announced November 2007.

A functional limit theorem for the profile of search trees

Authors: Michael Drmota, Svante Janson, Ralph Neininger

Abstract: We study the profile $X_{n,k}$ of random search trees including binary search trees and $m$-ary search trees. Our main result is a functional limit theorem of the normalized profile $X_{n,k}/\mathbb{E}X_{n,k}$ for $k=\lfloorα\log n\rfloor$ in a certain range of $α$. A central feature of the proof is the use of the contraction method to prove convergence in distribution of certain random analytic… ▽ More We study the profile $X_{n,k}$ of random search trees including binary search trees and $m$-ary search trees. Our main result is a functional limit theorem of the normalized profile $X_{n,k}/\mathbb{E}X_{n,k}$ for $k=\lfloorα\log n\rfloor$ in a certain range of $α$. A central feature of the proof is the use of the contraction method to prove convergence in distribution of certain random analytic functions in a complex domain. This is based on a general theorem concerning the contraction method for random variables in an infinite-dimensional Hilbert space. As part of the proof, we show that the Zolotarev metric is complete for a Hilbert space. △ Less

Submitted 22 January, 2008; v1 submitted 14 September, 2006; originally announced September 2006.

Comments: Published in at http://dx.doi.org/10.1214/07-AAP457 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AAP-AAP457 MSC Class: 60F17 (Primary); 68Q25; 68P10; 60C05 (Secondary)

Journal ref: Annals of Applied Probability 2008, Vol. 18, No. 1, 288-333

The size of random fragmentation trees

Authors: S. Janson, R. Neininger

Abstract: We study a random fragmentation process and its associated random tree. The process has earlier been studied by Dean and Majumdar (J. Phys. A: Math. Gen., vol. 35, L501--L507), who found a phase transition: the number of fragmentations is asymptotically normal in some cases but not in others, depending on the position of roots of a certain characteristic equation. This parallels the behaviour of… ▽ More We study a random fragmentation process and its associated random tree. The process has earlier been studied by Dean and Majumdar (J. Phys. A: Math. Gen., vol. 35, L501--L507), who found a phase transition: the number of fragmentations is asymptotically normal in some cases but not in others, depending on the position of roots of a certain characteristic equation. This parallels the behaviour of discrete analogues with various random trees that have been studied in computer science. We give rigorous proofs of this phase transition, and add further details. The proof uses the contraction method. We extend some previous results for recursive sequences of random variables to families of random variables with a continuous parameter; we believe that this extension has independent interest. △ Less

Submitted 13 September, 2006; originally announced September 2006.

On the contraction method with degenerate limit equation

Authors: Ralph Neininger, Ludger Ruschendorf

Abstract: A class of random recursive sequences (Y_n) with slowly varying variances as arising for parameters of random trees or recursive algorithms leads after normalizations to degenerate limit equations of the form X\stackrel{L}{=}X. For nondegenerate limit equations the contraction method is a main tool to establish convergence of the scaled sequence to the ``unique'' solution of the limit equation.… ▽ More A class of random recursive sequences (Y_n) with slowly varying variances as arising for parameters of random trees or recursive algorithms leads after normalizations to degenerate limit equations of the form X\stackrel{L}{=}X. For nondegenerate limit equations the contraction method is a main tool to establish convergence of the scaled sequence to the ``unique'' solution of the limit equation. In this paper we develop an extension of the contraction method which allows us to derive limit theorems for parameters of algorithms and data structures with degenerate limit equation. In particular, we establish some new tools and a general convergence scheme, which transfers information on mean and variance into a central limit law (with normal limit). We also obtain a convergence rate result. For the proof we use selfdecomposability properties of the limit normal distribution which allow us to mimic the recursive sequence by an accompanying sequence in normal variables. △ Less

Submitted 6 October, 2004; originally announced October 2004.

Comments: Published by the Institute of Mathematical Statistics (http://www.imstat.org) in the Annals of Probability (http://www.imstat.org/aop/) at http://dx.doi.org/10.1214/009117904000000171

Report number: IMS-AOP-AOP294 MSC Class: 60F05; 68Q25 (Primary) 68P10. (Secondary)

Journal ref: Annals of Probability 2004, Vol. 32, No. 3B, 2838-2856

Probabilistic Analysis for Randomized Game Tree Evaluation

Authors: Tämur Ali Khan, Ralph Neininger

Abstract: We give a probabilistic analysis for the randomized game tree evaluation algorithm of Snir. We first show that there exists an input such that the running time, measured as the number of external nodes read by the algorithm, on that input is maximal in stochastic order among all possible inputs. For this worst case input we identify the exact expectation of the number of external nodes read by t… ▽ More We give a probabilistic analysis for the randomized game tree evaluation algorithm of Snir. We first show that there exists an input such that the running time, measured as the number of external nodes read by the algorithm, on that input is maximal in stochastic order among all possible inputs. For this worst case input we identify the exact expectation of the number of external nodes read by the algorithm, give the asymptotic order of the variance including the leading constant, provide a limit law for an appropriate normalization as well as a tail bound estimating large deviations. Our tail bound improves upon the exponent of an earlier bound due to Karp and Zhang, where subgaussian tails were shown based on an approach using multitype branching processes and Azuma's inequality. Our approach rests on a direct, inductive estimate of the moment generating function. △ Less

Submitted 17 May, 2004; originally announced May 2004.

Comments: 10 pages, conference: Third Colloquium on Mathematics and Computer Science

MSC Class: 60F10 (Primary); 60J80; 68W40; 60J85 (Secondary)

Perfect simulation from the Quicksort limit distribution

Authors: Luc Devroye, James Allen Fill, Ralph Neininger

Abstract: The weak limit of the normalized number of comparisons needed by the Quicksort algorithm to sort n randomly permuted items is known to be determined implicitly by a distributional fixed-point equation. We give an algorithm for perfect random variate generation from this distribution. The weak limit of the normalized number of comparisons needed by the Quicksort algorithm to sort n randomly permuted items is known to be determined implicitly by a distributional fixed-point equation. We give an algorithm for perfect random variate generation from this distribution. △ Less

Submitted 23 May, 2000; v1 submitted 23 May, 2000; originally announced May 2000.

Comments: 7 pages. See also http://www.mts.jhu.edu/~fill/, http://www-cgrl.cs.mcgill.ca/~luc/, and http://www.stochastik.uni-freiburg.de/homepages/neininger/ . Submitted for publication in May, 2000

Report number: 603, Department of Mathematical Sciences, The Johns Hopkins University MSC Class: 65C10 (primary); 65C05; 68U20; 11K45 (secondary)