-
Blockchain Metrics and Indicators in Cryptocurrency Trading
Authors:
Juan C. King,
Roberto Dale,
José M. Amigó
Abstract:
The objective of this paper is the construction of new indicators that can be useful to operate in the cryptocurrency market. These indicators are based on public data obtained from the blockchain network, specifically from the nodes that make up Bitcoin mining. Therefore, our analysis is unique to that network. The results obtained with numerical simulations of algorithmic trading and prediction…
▽ More
The objective of this paper is the construction of new indicators that can be useful to operate in the cryptocurrency market. These indicators are based on public data obtained from the blockchain network, specifically from the nodes that make up Bitcoin mining. Therefore, our analysis is unique to that network. The results obtained with numerical simulations of algorithmic trading and prediction via statistical models and Machine Learning demonstrate the importance of variables such as the hash rate, the difficulty of mining or the cost per transaction when it comes to trade Bitcoin assets or predict the direction of price. Variables obtained from the blockchain network will be called here blockchain metrics. The corresponding indicators (inspired by the "Hash Ribbon") perform well in locating buy signals. From our results, we conclude that such blockchain indicators allow obtaining information with a statistical advantage in the highly volatile cryptocurrency market.
△ Less
Submitted 11 February, 2024;
originally announced March 2024.
-
Permutation group entropy: a new route to complexity for real-valued processes
Authors:
José M. Amigó,
Roberto Dale,
Piergiulio Tempesta
Abstract:
This is a review of group entropy and its application to permutation complexity. Specifically we revisit a new approach to the notion of complexity in time serie analysis, based on both permutation entropy and group entropy. As a result, the permutation entropy rate can be extended from deterministic dynamics to random processes. More generally, our approach provides a unified framework to discuss…
▽ More
This is a review of group entropy and its application to permutation complexity. Specifically we revisit a new approach to the notion of complexity in time serie analysis, based on both permutation entropy and group entropy. As a result, the permutation entropy rate can be extended from deterministic dynamics to random processes. More generally, our approach provides a unified framework to discuss chaotic and random behaviours.
△ Less
Submitted 20 January, 2024;
originally announced January 2024.
-
Differentiating patients with obstructive sleep apnea from healthy controls based on heart rate - blood pressure coupling quantified by entropy-based indices
Authors:
Paweł Pilarczyk,
Grzegorz Graff,
José M. Amigó,
Katarzyna Tessmer,
Krzysztof Narkiewicz,
Beata Graff
Abstract:
We introduce an entropy-based classification method for pairs of sequences (ECPS) for quantifying mutual dependencies in heart rate and beat-to-beat blood pressure recordings. The purpose of the method is to build a classifier for data in which each item consists of the two intertwined data series taken for each subject. The method is based on ordinal patterns, and uses entropy-like indices. Machi…
▽ More
We introduce an entropy-based classification method for pairs of sequences (ECPS) for quantifying mutual dependencies in heart rate and beat-to-beat blood pressure recordings. The purpose of the method is to build a classifier for data in which each item consists of the two intertwined data series taken for each subject. The method is based on ordinal patterns, and uses entropy-like indices. Machine learning is used to select a subset of indices most suitable for our classification problem in order to build an optimal yet simple model for distinguishing between patients suffering from obstructive sleep apnea and a control group.
△ Less
Submitted 4 November, 2023;
originally announced November 2023.
-
Multilayer adaptive networks in neuronal processing
Authors:
Adrián Hernández,
José M. Amigó
Abstract:
The connectome is a wiring diagram map** all the neural connections in the brain. At the cellular level, it provides a map of the neurons and synapses within a part or all of the brain of an organism. In recent years, significant advances have been made in the study of the connectome via network science and graph theory. This analysis is fundamental to understand neurotransmission (fast synaptic…
▽ More
The connectome is a wiring diagram map** all the neural connections in the brain. At the cellular level, it provides a map of the neurons and synapses within a part or all of the brain of an organism. In recent years, significant advances have been made in the study of the connectome via network science and graph theory. This analysis is fundamental to understand neurotransmission (fast synaptic transmission) networks. However, neurons use other forms of communication as neuromodulation that, instead of conveying excitation or inhibition, change neuronal and synaptic properties. This additional neuromodulatory layers condition and reconfigure the connectome. In this paper, we propose that multilayer adaptive networks, in which different synaptic and neurochemical layers interact, are the appropriate framework to explain neuronal processing. Then, we describe a simplified multilayer adaptive network model that accounts for these extra-layers of interaction and analyse the emergence of interesting computational capabilities.
△ Less
Submitted 30 May, 2022;
originally announced May 2022.
-
Differentiable programming: Generalization, characterization and limitations of deep learning
Authors:
Adrián Hernández,
Gilles Millerioux,
José M. Amigó
Abstract:
In the past years, deep learning models have been successfully applied in several cognitive tasks. Originally inspired by neuroscience, these models are specific examples of differentiable programs. In this paper we define and motivate differentiable programming, as well as specify some program characteristics that allow us to incorporate the structure of the problem in a differentiable program. W…
▽ More
In the past years, deep learning models have been successfully applied in several cognitive tasks. Originally inspired by neuroscience, these models are specific examples of differentiable programs. In this paper we define and motivate differentiable programming, as well as specify some program characteristics that allow us to incorporate the structure of the problem in a differentiable program. We analyze different types of differentiable programs, from more general to more specific, and evaluate, for a specific problem with a graph dataset, its structure and knowledge with several differentiable programs using those characteristics. Finally, we discuss some inherent limitations of deep learning and differentiable programs, which are key challenges in advancing artificial intelligence, and then analyze possible solutions
△ Less
Submitted 13 May, 2022;
originally announced May 2022.
-
A simplified algorithm for the topological entropy of multimodal maps
Authors:
José M. Amigó,
Angel Giménez
Abstract:
A numerical algorithm to compute the topological entropy of multimodal maps is proposed. This algorithm results from a closed formula containing the so-called min-max symbols, which are closely related to the kneading symbols. Furthermore, it simplifies a previous algorithm, also based on min-max symbols, which was originally proposed for twice differentiable multimodal maps. The new algorithm has…
▽ More
A numerical algorithm to compute the topological entropy of multimodal maps is proposed. This algorithm results from a closed formula containing the so-called min-max symbols, which are closely related to the kneading symbols. Furthermore, it simplifies a previous algorithm, also based on min-max symbols, which was originally proposed for twice differentiable multimodal maps. The new algorithm has been benchmarked against the old one with a number of multimodal maps, the results being reported in the paper. In particular, the comparison is favorable to the new algorithm, except in the unimodal case.
△ Less
Submitted 12 April, 2022;
originally announced April 2022.
-
On entropy, entropy-like quantities, and applications
Authors:
José M. Amigó,
Karsten Keller,
Valentina Unakafova
Abstract:
This is a review on entropy in various fields of mathematics and science. Its scope is to convey a unified vision of the classical as well as some newer entropy notions to a broad audience with an intermediate background in dynamical systems and ergodic theory. Due to the breadth and depth of the subject, we have opted for a compact exposition whose contents are a compromise between conceptual imp…
▽ More
This is a review on entropy in various fields of mathematics and science. Its scope is to convey a unified vision of the classical as well as some newer entropy notions to a broad audience with an intermediate background in dynamical systems and ergodic theory. Due to the breadth and depth of the subject, we have opted for a compact exposition whose contents are a compromise between conceptual import and instrumental relevance. The intended technical level and the space limitation born furthermore upon the final selection of the topics, which cover the three items named in the title. Specifically, the first part is devoted to the avatars of entropy in the traditional contexts: many particle physics, information theory, and dynamical systems. This chronological order helps to present the materials in a didactic manner. The axiomatic approach will be also considered at this stage to show that, quite remarkably, the essence of entropy can be encapsulated in a few basic properties. Inspired by the classical entropies, further akin quantities have been proposed in the course of time, mostly aimed at specific needs. A common denominator of those addressed in the second part of this review is their major impact on research. The final part shows that, along with its profound role in the theory, entropy has interesting practical applications beyond information theory and communications technology. For this sake we preferred examples from applied mathematics, although there are certainly nice applications in, say, physics, computer science and even social sciences. This review concludes with a representative list of references.
△ Less
Submitted 7 February, 2022;
originally announced February 2022.
-
New RED-type TCP-AQM algorithms based on beta distribution drop functions
Authors:
Angel Giménez,
Miguel A. Murcia,
José M. Amigó,
Oscar Martínez-Bonastre,
José Valero
Abstract:
In recent years, Active Queue Management (AQM) mechanisms to improve the performance of TCP/IP networks have acquired a relevant role. In this paper we present a simple and robust RED-type algorithm together with a couple of dynamical variants with the ability to adapt to the specific characteristics of different network environments, as well as to the user needs. We first present a basic version…
▽ More
In recent years, Active Queue Management (AQM) mechanisms to improve the performance of TCP/IP networks have acquired a relevant role. In this paper we present a simple and robust RED-type algorithm together with a couple of dynamical variants with the ability to adapt to the specific characteristics of different network environments, as well as to the user needs. We first present a basic version called Beta RED (BetaRED), where the user is free to adjust the parameters according to the network conditions. The aim is to make the parameter setting easy and intuitive so that a good performance is obtained over a wide range of parameters. Secondly, BetaRED is used as a framework to design two dynamic algorithms, which we will call Adaptive Beta RED (ABetaRED) and Dynamic Beta RED (DBetaRED). In those new algorithms certain parameters are dynamically adjusted so that the queue length remains stable around a predetermined reference value and according to changing network traffic conditions. Finally, we present a battery of simulations using the Network Simulator 3 (ns-3) software with a two-fold objective: to guide the user on how to adjust the parameters of the BetaRED mechanism, and to show a performance comparison of ABetaRED and DBetaRED with other representative algorithms that pursue a similar objective.
△ Less
Submitted 22 September, 2022; v1 submitted 4 January, 2022;
originally announced January 2022.
-
Complexity-based permutation entropies: from deterministic time series to white noise
Authors:
J. M. Amigó,
R. Dale,
P. Tempesta
Abstract:
This is a paper in the intersection of time series analysis and complexity theory that presents new results on permutation complexity in general and permutation entropy in particular. In this context, permutation complexity refers to the characterization of time series by means of ordinal patterns (permutations), entropic measures, decay rates of missing ordinal patterns, and more. Since the incep…
▽ More
This is a paper in the intersection of time series analysis and complexity theory that presents new results on permutation complexity in general and permutation entropy in particular. In this context, permutation complexity refers to the characterization of time series by means of ordinal patterns (permutations), entropic measures, decay rates of missing ordinal patterns, and more. Since the inception of this \textquotedblleft ordinal\textquotedblright\ methodology, its practical application to any type of scalar time series and real-valued processes have proven to be simple and useful. However, the theoretical aspects have remained limited to noiseless deterministic series and dynamical systems, the main obstacle being the super-exponential growth of visible permutations with length when randomness (also in form of observational noise) is present in the data. To overcome this difficulty, we take a new approach through complexity classes, which are precisely defined by the growth of visible permutations with length, regardless of the deterministic or noisy nature of the data. We consider three major classes: exponential, sub-factorial and factorial. The next step is to adapt the concept of Z-entropy to each of those classes, which we call permutation entropy because it coincides with the conventional permutation entropy on the exponential class. Z-entropies are a family of group entropies, each of them extensive on a given complexity class. The result is a unified approach to the ordinal analysis of deterministic and random processes, from dynamical systems to white noise, with new concepts and tools. Numerical simulations show that permutation entropy discriminates time series from all complexity classes.
△ Less
Submitted 5 November, 2021; v1 submitted 5 March, 2021;
originally announced March 2021.
-
Entropy monotonicity and superstable cycles for the quadratic family revisited
Authors:
José M. Amigó,
Angel Giménez
Abstract:
The main result of this paper is a proof using real analysis of the monotonicity of the topological entropy for the family of quadratic maps, sometimes called Milnor's Monotonicity Conjecture. In contrast, the existing proofs rely in one way or another on complex analysis. Our proof is based on tools and algorithms previously developed by the authors and collaborators to compute the topological en…
▽ More
The main result of this paper is a proof using real analysis of the monotonicity of the topological entropy for the family of quadratic maps, sometimes called Milnor's Monotonicity Conjecture. In contrast, the existing proofs rely in one way or another on complex analysis. Our proof is based on tools and algorithms previously developed by the authors and collaborators to compute the topological entropy of multimodal maps. Specifically, we use the number of transverse intersections of the map iterates with the so-called critical line. The approach is technically simple and geometrical. The same approach is also used to briefly revisit the superstable cycles of the quadratic maps, since both topics are closely related.
△ Less
Submitted 11 October, 2020;
originally announced October 2020.
-
A generalized permutation entropy for random processes
Authors:
José M. Amigó,
Roberto Dale,
Piergiulio Tempesta
Abstract:
Permutation entropy measures the complexity of deterministic time series via a data symbolic quantization consisting of rank vectors called ordinal patterns or just permutations. The reasons for the increasing popularity of this entropy in time series analysis include that (i) it converges to the Kolmogorov-Sinai entropy of the underlying dynamics in the limit of ever longer permutations, and (ii)…
▽ More
Permutation entropy measures the complexity of deterministic time series via a data symbolic quantization consisting of rank vectors called ordinal patterns or just permutations. The reasons for the increasing popularity of this entropy in time series analysis include that (i) it converges to the Kolmogorov-Sinai entropy of the underlying dynamics in the limit of ever longer permutations, and (ii) its computation dispenses with generating and ad hoc partitions. However, permutation entropy diverges when the number of allowed permutations grows super-exponentially with their length, as is usually the case when time series are output by random processes. In this Letter we propose a generalized permutation entropy that is finite for random processes, including discrete-time dynamical systems with observational or dynamical noise.
△ Less
Submitted 30 March, 2020;
originally announced March 2020.
-
Internet congestion control: from stochastic to dynamical models
Authors:
José M. Amigó,
Angel Giménez,
Oscar Martínez-Bonastre,
José Valero
Abstract:
Since its inception, control of data congestion on the Internet has been based on stochastic models. One of the first such models was Random Early Detection. Later, this model was reformulated as a dynamical system, with the average queue sizes at a router's buffer being the states. Recently, the dynamical model has been generalized to improve global stability. In this paper we review the original…
▽ More
Since its inception, control of data congestion on the Internet has been based on stochastic models. One of the first such models was Random Early Detection. Later, this model was reformulated as a dynamical system, with the average queue sizes at a router's buffer being the states. Recently, the dynamical model has been generalized to improve global stability. In this paper we review the original stochastic model and both nonlinear models of Random Early Detection with a two-fold objective: (i) illustrate how a random model can be "smoothed out" to a deterministic one through data aggregation, and (ii) how this translation can shed light into complex processes such as the Internet data traffic. Furthermore, this paper contains new materials concerning the occurrence of chaos, bifurcation diagrams, Lyapunov exponents and global stability robustness with respect to control parameters. The results reviewed and reported here are expected to help design an active queue management algorithm in real conditions, that is, when system parameters such as the number of users and the round-trip time of the data packets change over time. The topic also illustrates the much-needed synergy of a theoretical approach, practical intuition and numerical simulations in engineering.
△ Less
Submitted 23 January, 2020;
originally announced January 2020.
-
Differentiable programming and its applications to dynamical systems
Authors:
Adrián Hernández,
José M. Amigó
Abstract:
Differentiable programming is the combination of classical neural networks modules with algorithmic ones in an end-to-end differentiable model. These new models, that use automatic differentiation to calculate gradients, have new learning capabilities (reasoning, attention and memory). In this tutorial, aimed at researchers in nonlinear systems with prior knowledge of deep learning, we present thi…
▽ More
Differentiable programming is the combination of classical neural networks modules with algorithmic ones in an end-to-end differentiable model. These new models, that use automatic differentiation to calculate gradients, have new learning capabilities (reasoning, attention and memory). In this tutorial, aimed at researchers in nonlinear systems with prior knowledge of deep learning, we present this new programming paradigm, describe some of its new features such as attention mechanisms, and highlight the benefits they bring. Then, we analyse the uses and limitations of traditional deep learning models in the modeling and prediction of dynamical systems. Here, a dynamical system is meant to be a set of state variables that evolve in time under general internal and external interactions. Finally, we review the advantages and applications of differentiable programming to dynamical systems.
△ Less
Submitted 2 May, 2020; v1 submitted 17 December, 2019;
originally announced December 2019.
-
General Algorithmic Search
Authors:
Sergio Hernández,
Guillem Duran,
José M. Amigó
Abstract:
In this paper we present a metaheuristic for global optimization called General Algorithmic Search (GAS). Specifically, GAS is a stochastic, single-objective method that evolves a swarm of agents in search of a global extremum. Numerical simulations with a sample of 31 test functions show that GAS outperforms Basin Hop**, Cuckoo Search, and Differential Evolution, especially in concurrent optimi…
▽ More
In this paper we present a metaheuristic for global optimization called General Algorithmic Search (GAS). Specifically, GAS is a stochastic, single-objective method that evolves a swarm of agents in search of a global extremum. Numerical simulations with a sample of 31 test functions show that GAS outperforms Basin Hop**, Cuckoo Search, and Differential Evolution, especially in concurrent optimization, i.e., when several runs with different initial settings are executed and the first best wins. Python codes of all algorithms and complementary information are available online.
△ Less
Submitted 24 May, 2017;
originally announced May 2017.
-
A closed formula for the topological entropy of multimodal maps based on min-max symbols
Authors:
Jose M. Amigo,
Angel Gimenez
Abstract:
Topological entropy is a measure of complex dynamics. In this regard, multimodal maps play an important role when it comes to study low-dimensional chaotic dynamics or explain some features of higher dimensional complex dynamics with conceptually simple models. In the first part of this paper an analytical formula for the topological entropy of twice differentiable multimodal maps is derived, and…
▽ More
Topological entropy is a measure of complex dynamics. In this regard, multimodal maps play an important role when it comes to study low-dimensional chaotic dynamics or explain some features of higher dimensional complex dynamics with conceptually simple models. In the first part of this paper an analytical formula for the topological entropy of twice differentiable multimodal maps is derived, and some basic properties are studied. This expression involves the so-called min-max symbols, which are closely related to the kneading symbols. Furthermore, its proof leads to a numerical algorithm that simplifies a previous one also based on min-max symbols. In the second part of the paper this new algorithm is used to compute the topological entropy of different modal maps. Moreover, it compares favorably to the previous algorithm when computing the topological entropy of the bi- and tri-modal maps considered in the numerical simulations.
△ Less
Submitted 30 October, 2013;
originally announced October 2013.
-
Permutation complexity of interacting dynamical systems
Authors:
Roberto Monetti,
José María Amigó,
Thomas Aschenbrenner,
Wolfram Bunk
Abstract:
The coupling complexity index is an information measure introduced within the framework of ordinal symbolic dynamics. This index is used to characterize the complexity of the relationship between dynamical system components. In this work, we clarify the meaning of the coupling complexity by discussing in detail some cases leading to extreme values, and present examples using synthetic data to desc…
▽ More
The coupling complexity index is an information measure introduced within the framework of ordinal symbolic dynamics. This index is used to characterize the complexity of the relationship between dynamical system components. In this work, we clarify the meaning of the coupling complexity by discussing in detail some cases leading to extreme values, and present examples using synthetic data to describe its properties. We also generalize the coupling complexity index to the multivariate case and derive a number of important properties by exploiting the structure of the symmetric group. The applicability of this index to the multivariate case is demonstrated with a real-world data example. Finally, we define the coupling complexity rate of random and deterministic time series. Some formal results about the multivariate coupling complexity index have been collected in an Appendix.
△ Less
Submitted 8 May, 2013;
originally announced May 2013.
-
Information directionality in coupled time series using transcripts
Authors:
Roberto Monetti,
Wolfram Bunk,
Thomas Aschenbrenner,
Stephan Springer,
Jose Maria Amigo
Abstract:
In ordinal symbolic dynamics, transcripts describe the algebraic relationship between ordinal patterns. Using the concept of transcript, we exploit the mathematical structure of the group of permutations to derive properties and relations among information measures of the symbolic representations of time series. These theoretical results are then applied for the assessment of coupling directionali…
▽ More
In ordinal symbolic dynamics, transcripts describe the algebraic relationship between ordinal patterns. Using the concept of transcript, we exploit the mathematical structure of the group of permutations to derive properties and relations among information measures of the symbolic representations of time series. These theoretical results are then applied for the assessment of coupling directionality in dynamical systems, where suitable coupling directionality measures are introduced depending only on transcripts. These novel measures estimate information flow in lower space dimension and reduce to well-established coupling directionality quantifiers when some general conditions are satisfied. Furthermore, by generalizing the definition of transcript to ordinal patterns of different lengths, several of the commonly used information directionality measures can be encompassed within the same framework.
△ Less
Submitted 29 April, 2013;
originally announced April 2013.
-
Cryptanalysis of a family of self-synchronizing chaotic stream ciphers
Authors:
David Arroyo,
Gonzalo Alvarez,
Jose Maria Amigo,
Shujun Li
Abstract:
Unimodal maps have been broadly used as a base of new encryption strategies. Recently, a stream cipher has been proposed in the literature, whose keystream is basically a symbolic sequence of the (one-parameter) logistic map or of the tent map. In the present work a thorough analysis of the keystream is made which reveals the existence of some serious security problems
Unimodal maps have been broadly used as a base of new encryption strategies. Recently, a stream cipher has been proposed in the literature, whose keystream is basically a symbolic sequence of the (one-parameter) logistic map or of the tent map. In the present work a thorough analysis of the keystream is made which reveals the existence of some serious security problems
△ Less
Submitted 17 March, 2009;
originally announced March 2009.
-
Estimation of the control parameter from symbolic sequences: Unimodal maps with variable critical point
Authors:
David Arroyo,
Gonzalo Alvarez,
José María Amigó
Abstract:
The work described in this paper can be interpreted as an application of the order patterns of symbolic dynamics when dealing with unimodal maps. Specifically, it is shown how Gray codes can be used to estimate the probability distribution functions (PDFs) of the order patterns of parametric unimodal maps. Furthermore, these PDFs depend on the value of the parameter, what eventually provides a h…
▽ More
The work described in this paper can be interpreted as an application of the order patterns of symbolic dynamics when dealing with unimodal maps. Specifically, it is shown how Gray codes can be used to estimate the probability distribution functions (PDFs) of the order patterns of parametric unimodal maps. Furthermore, these PDFs depend on the value of the parameter, what eventually provides a handle to estimate the parameter value from symbolic sequences (in form of Gray codes), even when the critical point depends on the parameter.
△ Less
Submitted 12 December, 2008;
originally announced December 2008.
-
Forbidden ordinal patterns in higher dimensional dynamics
Authors:
J. M. Amigó,
M. B. Kennel
Abstract:
Forbidden ordinal patterns are ordinal patterns (or `rank blocks') that cannot appear in the orbits generated by a map taking values on a linearly ordered space, in which case we say that the map has forbidden patterns. Once a map has a forbidden pattern of a given length $L_{0}$, it has forbidden patterns of any length $L\ge L_{0}$ and their number grows superexponentially with $L$. Using recen…
▽ More
Forbidden ordinal patterns are ordinal patterns (or `rank blocks') that cannot appear in the orbits generated by a map taking values on a linearly ordered space, in which case we say that the map has forbidden patterns. Once a map has a forbidden pattern of a given length $L_{0}$, it has forbidden patterns of any length $L\ge L_{0}$ and their number grows superexponentially with $L$. Using recent results on topological permutation entropy, we study in this paper the existence and some basic properties of forbidden ordinal patterns for self maps on n-dimensional intervals. Our most applicable conclusion is that expansive interval maps with finite topological entropy have necessarily forbidden patterns, although we conjecture that this is also the case under more general conditions. The theoretical results are nicely illustrated for n=2 both using the naive counting estimator for forbidden patterns and Chao's estimator for the number of classes in a population. The robustness of forbidden ordinal patterns against observational white noise is also illustrated.
△ Less
Submitted 12 November, 2007;
originally announced November 2007.
-
Forbidden patterns and shift systems
Authors:
José M. Amigó,
Sergi Elizalde,
Matthew B. Kennel
Abstract:
The scope of this paper is two-fold. First, to present to the researchers in combinatorics an interesting implementation of permutations avoiding generalized patterns in the framework of discrete-time dynamical systems. Indeed, the orbits generated by piecewise monotone maps on one-dimensional intervals have forbidden order patterns, i.e., order patterns that do not occur in any orbit. The allow…
▽ More
The scope of this paper is two-fold. First, to present to the researchers in combinatorics an interesting implementation of permutations avoiding generalized patterns in the framework of discrete-time dynamical systems. Indeed, the orbits generated by piecewise monotone maps on one-dimensional intervals have forbidden order patterns, i.e., order patterns that do not occur in any orbit. The allowed patterns are then those patterns avoiding the so-called forbidden root patterns and their shifted patterns. The second scope is to study forbidden patterns in shift systems, which are universal models in information theory, dynamical systems and stochastic processes. Due to its simple structure, shift systems are accessible to a more detailed analysis and, at the same time, exhibit all important properties of low-dimensional chaotic dynamical systems (e.g., sensitivity to initial conditions, strong mixing and a dense set of periodic points), allowing to export the results to other dynamical systems via order-isomorphisms.
△ Less
Submitted 4 September, 2007; v1 submitted 31 July, 2007;
originally announced July 2007.
-
The permutation entropy rate equals the metric entropy rate for ergodic information sources and ergodic dynamical systems
Authors:
Jose M. Amigo,
Matthew B. Kennel,
Ljupco Kocarev
Abstract:
Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy rates--measures of new disorder per new observed value--are equal for ergodic finite-alphabet information sources (discrete-time stationary stochastic processes). With thi…
▽ More
Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy rates--measures of new disorder per new observed value--are equal for ergodic finite-alphabet information sources (discrete-time stationary stochastic processes). With this result, we then prove that the same holds for deterministic dynamical systems defined by ergodic maps on $n$% -dimensional intervals. This result generalizes a previous one for piecewise monotone interval maps on the real line (Bandt, Keller and Pompe, "Entropy of interval maps via permutations",\textit{Nonlinearity} \textbf{15}, 1595-602, (2002)), at the expense of requiring ergodicity and using a definition of permutation entropy rate differing in the order of two limits. The case of non-ergodic finite-alphabet sources is also studied and an inequality developed. Finally, the equality of permutation and metric entropy rates is extended to ergodic non-discrete information sources when entropy is replaced by differential entropy in the usual way.
△ Less
Submitted 21 March, 2005;
originally announced March 2005.
