-
Role of correlations in the maximum distribution of multiscale stationary Markovian processes
Authors:
Salvatore Miccichè
Abstract:
We are interested in investigating the statistical properties of extreme values for strongly correlated variables. The starting motivation is to understand how the strong-correlation properties of power-law distributed processes affect the possibility of exploring the whole domain of a stochastic process (the real axis in most cases) when performing time-average numerical simulations and how this…
▽ More
We are interested in investigating the statistical properties of extreme values for strongly correlated variables. The starting motivation is to understand how the strong-correlation properties of power-law distributed processes affect the possibility of exploring the whole domain of a stochastic process (the real axis in most cases) when performing time-average numerical simulations and how this relates to the numerical evaluation of the autocorrelation function.
We show that correlations decrease the heterogeneity of the maximum values. Specifically, through numerical simulations we observe that for strongly correlated variables whose probability distribution function decays like a power-law $1/x^α$, the maximum distribution has a tail compatible with a $1/x^{α+2}$ decay, while for i.i.d. variables we expect a $1/x^α$ decay. As a consequence, we also show that the numerically estimated autocorrelation function converges to the theoretical prediction according to a factor that depends on the length of the simulated time-series $n$ according to a power-law: $1/n^{α^δ}$ with $δ<1$, This accounts for a very slow convergence rate.
△ Less
Submitted 19 May, 2024;
originally announced May 2024.
-
Two-step estimators of high dimensional correlation matrices
Authors:
Andrés García-Medina,
Salvatore Miccichè,
Rosario N. Mantegna
Abstract:
We investigate block diagonal and hierarchical nested stochastic multivariate Gaussian models by studying their sample cross-correlation matrix on high dimensions. By performing numerical simulations, we compare a filtered sample cross-correlation with the population cross-correlation matrices by using several rotationally invariant estimators (RIE) and hierarchical clustering estimators (HCE) und…
▽ More
We investigate block diagonal and hierarchical nested stochastic multivariate Gaussian models by studying their sample cross-correlation matrix on high dimensions. By performing numerical simulations, we compare a filtered sample cross-correlation with the population cross-correlation matrices by using several rotationally invariant estimators (RIE) and hierarchical clustering estimators (HCE) under several loss functions. We show that at large but finite sample size, sample cross-correlation filtered by RIE estimators are often outperformed by HCE estimators for several of the loss functions. We also show that for block models and for hierarchically nested block models the best determination of the filtered sample cross-correlation is achieved by introducing two-step estimators combining state-of-the-art non-linear shrinkage models with hierarchical clustering estimators.
△ Less
Submitted 10 October, 2023; v1 submitted 30 December, 2022;
originally announced December 2022.
-
A numerical recipe for the computation of stationary stochastic processes' autocorrelation function
Authors:
Salvatore Miccichè
Abstract:
Many natural phenomena exhibit a stochastic nature that one attempts at modeling by using stochastic processes of different types. In this context, often one is interested in investigating the memory properties of the natural phenomenon at hand. This is usually accomplished by computing the autocorrelation function of the numerical series describing the considered phenomenon. Often, especially whe…
▽ More
Many natural phenomena exhibit a stochastic nature that one attempts at modeling by using stochastic processes of different types. In this context, often one is interested in investigating the memory properties of the natural phenomenon at hand. This is usually accomplished by computing the autocorrelation function of the numerical series describing the considered phenomenon. Often, especially when considering real world data, the autocorrelation function must be computed starting from a single numerical series: i.e. with a time-average approach. Hereafter, we will propose a novel way of evaluating the time-average autocorrelation function, based on the preliminary evaluation of the quantity N(τ,gμ,gν), that, apart from normalization factors, represents a numerical estimate, based on a single realization of the process, of the 2-point joint probability density function P(x2,τ;x1,0). The main advantage of the proposed method is that it allows to quantitatively assess what is the error that one makes when numerically evaluating the autocorrelation function due to the fact that any simulated time series is necessarily bounded. In fact, we show that, for a wide class of stochastic processes admitting a nonlinear Langevin equation with white noise and that can be described by using a Fokker-Planck equation, the way the numerical estimate of the autocorrelation function converges to its theoretical prediction depends on the pdf tails. Moreover, the knowledge of N(τ,gμ,gν) allows to easily compute the process histogram and to characterize processes with multiple timescales. We will show the effectiveness of our new methodology by considering three stochastic processes whose autocorrelation function and two-point probability density function are both known in an analytical or numerical form, thus allowing direct comparisons.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Exploring the landscape of community-based dismantling strategies
Authors:
Federico Musciotto,
Salvatore Micciché
Abstract:
Network dismantling is a relevant research area in network science, gathering attention both from a theoretical and an operational point of view. Here, we propose a general framework for dismantling that prioritizes the removal of nodes that bridge together different network communities. The strategies we detect are not unique, as they depend on the specific realization of the community detection…
▽ More
Network dismantling is a relevant research area in network science, gathering attention both from a theoretical and an operational point of view. Here, we propose a general framework for dismantling that prioritizes the removal of nodes that bridge together different network communities. The strategies we detect are not unique, as they depend on the specific realization of the community detection algorithm considered. However, when applying the methodology to some real-world networks we find that the percolation threshold at which dismantling occurs is strongly robust, and it does not depend on the specific algorithm. Thus, the stochasticity inherently present in many community detection algorithms allows to identify several strategies that have comparable effectiveness but require the removal of distinct subsets of nodes. This feature is highly relevant in operational contexts in which the removal of nodes is costly and allows to identify the least expensive strategy that still holds high effectiveness.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
A primer on statistically validated networks
Authors:
Salvatore Miccichè,
Rosario Nunzio Mantegna
Abstract:
In this contribution we discuss some approaches of network analysis providing information about single links or single nodes with respect to a null hypothesis taking into account the heterogeneity of the system empirically observed. With this approach, a selection of nodes and links is feasible when the null hypothesis is statistically rejected. We focus our discussion on approaches using (i) the…
▽ More
In this contribution we discuss some approaches of network analysis providing information about single links or single nodes with respect to a null hypothesis taking into account the heterogeneity of the system empirically observed. With this approach, a selection of nodes and links is feasible when the null hypothesis is statistically rejected. We focus our discussion on approaches using (i) the so-called disparity filter and (ii) statistically validated network in bipartite networks. For both methods we discuss the importance of using multiple hypothesis test correction. Specific applications of statistically validated networks are discussed. We also discuss how statistically validated networks can be used to (i) pre-process large sets of data and (ii) detect cores of communities that are forming the most close-knit and stable subsets of clusters of nodes present in a complex system.
△ Less
Submitted 19 February, 2019;
originally announced February 2019.
-
Core of communities in bipartite networks
Authors:
Christian Bongiorno,
András London,
Salvatore Miccichè,
Rosario N. Mantegna
Abstract:
We use the information present in a bipartite network to detect cores of communities of each set of the bipartite system. Cores of communities are found by investigating statistically validated projected networks obtained using information present in the bipartite network. Cores of communities are highly informative and robust with respect to the presence of errors or missing entries in the bipart…
▽ More
We use the information present in a bipartite network to detect cores of communities of each set of the bipartite system. Cores of communities are found by investigating statistically validated projected networks obtained using information present in the bipartite network. Cores of communities are highly informative and robust with respect to the presence of errors or missing entries in the bipartite network. We assess the statistical robustness of cores by investigating an artificial benchmark network, the co-authorship network, and the actor-movie network. The accuracy and precision of the partition obtained with respect to the reference partition are measured in terms of the adjusted Rand index and of the adjusted Wallace index respectively. The detection of cores is highly precise although the accuracy of the methodology can be limited in some cases.
△ Less
Submitted 6 March, 2017;
originally announced April 2017.
-
An Empirically grounded Agent Based simulator for the Air Traffic Management in the SESAR scenario
Authors:
Gérald Gurtner,
Christian Bongiorno,
Marco Ducci,
Salvatore Miccichè
Abstract:
In this paper we present a simulator allowing to perform policy experiments relative to the air traffic management. Different SESAR solutions can be implemented in the model to see the reaction of the different stakeholders as well as other relevant metrics (delays, safety, etc). The model describes both the strategic phase associated to the planning of the flight trajectories and the tactical mod…
▽ More
In this paper we present a simulator allowing to perform policy experiments relative to the air traffic management. Different SESAR solutions can be implemented in the model to see the reaction of the different stakeholders as well as other relevant metrics (delays, safety, etc). The model describes both the strategic phase associated to the planning of the flight trajectories and the tactical modifications occurring in the en-route phase. An implementation of the model is available as open-source and freely accessible by any user.
More specifically, different procedures related to business trajectories and free-routing are tested and we illustrate the capabilities of the model on airspace implementing these concepts. After performing numerical simulations with the model, we show that in a free-routing scenario the controllers perform less operations although they are dispersed over a larger portion of the airspace. This can potentially increase the complexity of conflict detection and resolution for controllers.
In order to investigate this specific aspect, we consider some metrics used to measure traffic complexity. We first show that in non-free-routing situations our simulator deals with complexity in a way similar to what humans would do. This allows us to be confident that the results of our numerical simulations relative to the free-routing can reasonably forecast how human controllers would behave in this new situation. Specifically, our numerical simulations show that most of the complexity metrics decrease with free-routing, while the few metrics which increase are all linked to the flight level changes. This is a non-trivial result since intuitively the complexity should increase with free-routing because of problematic geometries and more dispersed conflicts over the airspace.
△ Less
Submitted 14 June, 2016;
originally announced June 2016.
-
Statistical characterization of deviations from planned flight trajectories in air traffic management
Authors:
C. Bongiorno,
G. Gurtner,
F. Lillo,
R. N. Mantegna,
S. Miccichè
Abstract:
Understanding the relation between planned and realized flight trajectories and the determinants of flight deviations is of great importance in air traffic management. In this paper we perform an in depth investigation of the statistical properties of planned and realized air traffic on the German airspace during a 28 day periods, corresponding to an AIRAC cycle. We find that realized trajectories…
▽ More
Understanding the relation between planned and realized flight trajectories and the determinants of flight deviations is of great importance in air traffic management. In this paper we perform an in depth investigation of the statistical properties of planned and realized air traffic on the German airspace during a 28 day periods, corresponding to an AIRAC cycle. We find that realized trajectories are on average shorter than planned ones and this effect is stronger during night-time than daytime. Flights are more frequently deviated close to the departure airport and at a relatively large angle to destination. Moreover, the probability of a deviation is higher in low traffic phases. All these evidences indicate that deviations are mostly used by controllers to give directs to flights when traffic conditions allow it. Finally we introduce a new metric, termed difork, which is able to characterize navigation points according to the likelihood that a deviation occurs there. Difork allows to identify in a statistically rigorous way navigation point pairs where deviations are more (less) frequent than expected under a null hypothesis of randomness that takes into account the heterogeneity of the navigation points. Such pairs can therefore be seen as sources of flexibility (stability) of controllers traffic management while conjugating safety and efficiency.
△ Less
Submitted 9 March, 2016;
originally announced March 2016.
-
Backbone of credit relationships in the Japanese credit market
Authors:
Luca Marotta,
Salvatore Miccichè,
Yoshi Fujiwara,
Hiroshi Iyetomi,
Hideaki Aoyama,
Mauro Gallegati,
Rosario N. Mantegna
Abstract:
We detect the backbone of the weighted bipartite network of the Japanese credit market relationships. The backbone is detected by adapting a general method used in the investigation of weighted networks. With this approach we detect a backbone that is statistically validated against a null hypothesis of uniform diversification of loans for banks and firms. Our investigation is done year by year an…
▽ More
We detect the backbone of the weighted bipartite network of the Japanese credit market relationships. The backbone is detected by adapting a general method used in the investigation of weighted networks. With this approach we detect a backbone that is statistically validated against a null hypothesis of uniform diversification of loans for banks and firms. Our investigation is done year by year and it covers more than thirty years during the period from 1980 to 2011. We relate some of our findings with economic events that have characterized the Japanese credit market during the last years. The study of the time evolution of the backbone allows us to detect changes occurred in network size, fraction of credit explained, and attributes characterizing the banks and the firms present in the backbone.
△ Less
Submitted 21 November, 2015;
originally announced November 2015.
-
Bank-firm credit network in Japan. An analysis of a bipartite network
Authors:
Luca Marotta,
Salvatore Miccichè,
Yoshi Fujiwara,
Hiroshi Iyetomi,
Hideaki Aoyama,
Mauro Gallegati,
Rosario N. Mantegna
Abstract:
We present an analysis of the credit market of Japan. The analysis is performed by investigating the bipartite network of banks and firms which is obtained by setting a link between a bank and a firm when a credit relationship is present in a given time window. In our investigation we focus on a community detection algorithm which is identifying communities composed by both banks and firms. We sho…
▽ More
We present an analysis of the credit market of Japan. The analysis is performed by investigating the bipartite network of banks and firms which is obtained by setting a link between a bank and a firm when a credit relationship is present in a given time window. In our investigation we focus on a community detection algorithm which is identifying communities composed by both banks and firms. We show that the clusters obtained by directly working on the bipartite network carry information about the networked nature of the Japanese credit market. Our analysis is performed for each calendar year during the time period from 1980 to 2011. Specifically, we obtain communities of banks and networks for each of the 32 investigated years, and we introduce a method to track the time evolution of these communities on a statistical basis. We then characterize communities by detecting the simultaneous over-expression of attributes of firms and banks. Specifically, we consider as attributes the economic sector and the geographical location of firms and the type of banks. In our 32 year long analysis we detect a persistence of the over-expression of attributes of clusters of banks and firms together with a slow dynamics of changes from some specific attributes to new ones. Our empirical observations show that the credit market in Japan is a networked market where the type of banks, geographical location of firms and banks and economic sector of the firm play a role in sha** the credit relationships between banks and firms.
△ Less
Submitted 21 July, 2014;
originally announced July 2014.
-
Statistically validated mobile communication networks: Evolution of motifs in European and Chinese data
Authors:
Ming-Xia Li,
Vasyl Palchykov,
Zhi-Qiang Jiang,
Kimmo Kaski,
Janos Kertész,
Salvatore Miccichè,
Michele Tumminello,
Wei-Xing Zhou,
Rosario N. Mantegna
Abstract:
Big data open up unprecedented opportunities to investigate complex systems including the society. In particular, communication data serve as major sources for computational social sciences but they have to be cleaned and filtered as they may contain spurious information due to recording errors as well as interactions, like commercial and marketing activities, not directly related to the social ne…
▽ More
Big data open up unprecedented opportunities to investigate complex systems including the society. In particular, communication data serve as major sources for computational social sciences but they have to be cleaned and filtered as they may contain spurious information due to recording errors as well as interactions, like commercial and marketing activities, not directly related to the social network. The network constructed from communication data can only be considered as a proxy for the network of social relationships. Here we apply a systematic method, based on multiple hypothesis testing, to statistically validate the links and then construct the corresponding Bonferroni network, generalized to the directed case. We study two large datasets of mobile phone records, one from Europe and the other from China. For both datasets we compare the raw data networks with the corresponding Bonferroni networks and point out significant differences in the structures and in the basic network measures. We show evidence that the Bonferroni network provides a better proxy for the network of social interactions than the original one. By using the filtered networks we investigated the statistics and temporal evolution of small directed 3-motifs and conclude that closed communication triads have a formation time-scale, which is quite fast and typically intraday. We also find that open communication triads preferentially evolve to other open triads with a higher fraction of reciprocated calls. These stylized facts were observed for both datasets.
△ Less
Submitted 15 March, 2014;
originally announced March 2014.
-
A comparative analysis of the statistical properties of large mobile phone calling networks
Authors:
Ming-Xia Li,
Zhi-Qiang Jiang,
Wen-Jie Xie,
Salvatore Miccichè,
Michele Tumminello,
Wei-Xing Zhou,
Rosario N. Mantegna
Abstract:
Mobile phone calling is one of the most widely used communication methods in modern society. The records of calls among mobile phone users provide us a valuable proxy for the understanding of human communication patterns embedded in social networks. Mobile phone users call each other forming a directed calling network. If only reciprocal calls are considered, we obtain an undirected mutual calling…
▽ More
Mobile phone calling is one of the most widely used communication methods in modern society. The records of calls among mobile phone users provide us a valuable proxy for the understanding of human communication patterns embedded in social networks. Mobile phone users call each other forming a directed calling network. If only reciprocal calls are considered, we obtain an undirected mutual calling network. The preferential communication behavior between two connected users can be statistically tested and it results in two Bonferroni networks with statistically validated edges. We perform a comparative analysis of the statistical properties of these four networks, which are constructed from the calling records of more than nine million individuals in Shanghai over a period of 110 days. We find that these networks share many common structural properties and also exhibit idiosyncratic features when compared with previously studied large mobile calling networks. The empirical findings provide us an intriguing picture of a representative large social network that might shed new lights on the modelling of large social networks.
△ Less
Submitted 6 May, 2014; v1 submitted 25 February, 2014;
originally announced February 2014.
-
Multi-scale analysis of the European airspace using network community detection
Authors:
Gérald Gurtner,
Stefania Vitali,
Marco Cipolla,
Fabrizio Lillo,
Rosario Nunzio Mantegna,
Salvatore Miccichè,
Simone Pozzi
Abstract:
We show that the European airspace can be represented as a multi-scale traffic network whose nodes are airports, sectors, or navigation points and links are defined and weighted according to the traffic of flights between the nodes. By using a unique database of the air traffic in the European airspace, we investigate the architecture of these networks with a special emphasis on their community st…
▽ More
We show that the European airspace can be represented as a multi-scale traffic network whose nodes are airports, sectors, or navigation points and links are defined and weighted according to the traffic of flights between the nodes. By using a unique database of the air traffic in the European airspace, we investigate the architecture of these networks with a special emphasis on their community structure. We propose that unsupervised network community detection algorithms can be used to monitor the current use of the airspaces and improve it by guiding the design of new ones. Specifically, we compare the performance of three community detection algorithms, also by using a null model which takes into account the spatial distance between nodes, and we discuss their ability to find communities that could be used to define new control units of the airspace.
△ Less
Submitted 17 June, 2013;
originally announced June 2013.
-
Gene-based and semantic structure of the Gene Ontology as a complex network
Authors:
Salvatore Miccichè
Abstract:
The last decade has seen the advent and consolidation of ontology based tools for the identification and biological interpretation of classes of genes, such as the Gene Ontology. The information accumulated time-by-time and included in the GO is encoded in the definition of terms and in the setting up of semantic relations amongst terms. This approach might be usefully complemented by a bottom-up…
▽ More
The last decade has seen the advent and consolidation of ontology based tools for the identification and biological interpretation of classes of genes, such as the Gene Ontology. The information accumulated time-by-time and included in the GO is encoded in the definition of terms and in the setting up of semantic relations amongst terms. This approach might be usefully complemented by a bottom-up approach based on the knowledge of relationships amongst genes. To this end, we investigate the Gene Ontology from a complex network perspective. We consider the semantic network of terms naturally associated with the semantic relationships provided by the Gene Ontology consortium and a gene-based weighted network in which the nodes are the terms and a link between any two terms is set up whenever genes are annotated in both terms. One aim of the present paper is to understand whether the semantic and the gene-based network share the same structural properties or not. We then consider network communities. The identification of communities in the SVNs network can therefore be the basis of a simple protocol aiming at fully exploiting the possible relationships amongst terms, thus improving the knowledge of the semantic structure of GO. This is also important from a biomedical point of view, as it might reveal how genes over-expressed in a certain term also affect other biological functions not directly linked by the GO semantics. As a by-product, we present a simple methodology that allows to have a first glance insight about the biological characterization of groups of GO terms.
△ Less
Submitted 10 November, 2012;
originally announced November 2012.
-
Do firms share the same functional form of their growth rate distribution? A new statistical test
Authors:
Josè T. Lunardi,
Salvatore Miccichè,
Fabrizio Lillo,
Rosario N. Mantegna,
Mauro Gallegati
Abstract:
We introduce a new statistical test of the hypothesis that a balanced panel of firms have the same growth rate distribution or, more generally, that they share the same functional form of growth rate distribution. We applied the test to European Union and US publicly quoted manufacturing firms data, considering functional forms belonging to the Subbotin family of distributions. While our hypothese…
▽ More
We introduce a new statistical test of the hypothesis that a balanced panel of firms have the same growth rate distribution or, more generally, that they share the same functional form of growth rate distribution. We applied the test to European Union and US publicly quoted manufacturing firms data, considering functional forms belonging to the Subbotin family of distributions. While our hypotheses are rejected for the vast majority of sets at the sector level, we cannot rejected them at the subsector level, indicating that homogenous panels of firms could be described by a common functional form of growth rate distribution.
△ Less
Submitted 11 March, 2011;
originally announced March 2011.
-
Community characterization of heterogeneous complex systems
Authors:
Michele Tumminello,
Salvatore Miccichè,
Fabrizio Lillo,
Jan Varho,
Jyrki Piilo,
Rosario N. Mantegna
Abstract:
We introduce an analytical statistical method to characterize the communities detected in heterogeneous complex systems. By posing a suitable null hypothesis, our method makes use of the hypergeometric distribution to assess the probability that a given property is over-expressed in the elements of a community with respect to all the elements of the investigated set. We apply our method to two spe…
▽ More
We introduce an analytical statistical method to characterize the communities detected in heterogeneous complex systems. By posing a suitable null hypothesis, our method makes use of the hypergeometric distribution to assess the probability that a given property is over-expressed in the elements of a community with respect to all the elements of the investigated set. We apply our method to two specific complex networks, namely a network of world movies and a network of physics preprints. The characterization of the elements and of the communities is done in terms of languages and countries for the movie network and of journals and subject categories for papers. We find that our method is able to characterize clearly the identified communities. Moreover our method works well both for large and for small communities.
△ Less
Submitted 18 November, 2010;
originally announced November 2010.
-
Statistically validated networks in bipartite complex systems
Authors:
Michele Tumminello,
Salvatore Miccichè,
Fabrizio Lillo,
Jyrki Piilo,
Rosario N. Mantegna
Abstract:
Many complex systems present an intrinsic bipartite nature and are often described and modeled in terms of networks [1-5]. Examples include movies and actors [1, 2, 4], authors and scientific papers [6-9], email accounts and emails [10], plants and animals that pollinate them [11, 12]. Bipartite networks are often very heterogeneous in the number of relationships that the elements of one set estab…
▽ More
Many complex systems present an intrinsic bipartite nature and are often described and modeled in terms of networks [1-5]. Examples include movies and actors [1, 2, 4], authors and scientific papers [6-9], email accounts and emails [10], plants and animals that pollinate them [11, 12]. Bipartite networks are often very heterogeneous in the number of relationships that the elements of one set establish with the elements of the other set. When one constructs a projected network with nodes from only one set, the system heterogeneity makes it very difficult to identify preferential links between the elements. Here we introduce an unsupervised method to statistically validate each link of the projected network against a null hypothesis taking into account the heterogeneity of the system. We apply our method to three different systems, namely the set of clusters of orthologous genes (COG) in completely sequenced genomes [13, 14], a set of daily returns of 500 US financial stocks, and the set of world movies of the IMDb database [15]. In all these systems, both different in size and level of heterogeneity, we find that our method is able to detect network structures which are informative about the system and are not simply expression of its heterogeneity. Specifically, our method (i) identifies the preferential relationships between the elements, (ii) naturally highlights the clustered structure of investigated systems, and (iii) allows to classify links according to the type of statistically validated relationships between the connected nodes.
△ Less
Submitted 8 August, 2010;
originally announced August 2010.
-
The role of conditional probability in multi-scale stationary Markovian processes
Authors:
Salvatore Miccichè
Abstract:
The aim of the paper is to understand how the inclusion of more and more time-scales into a stochastic stationary Markovian process affects its conditional probability. To this end, we consider two Gaussian processes: (i) a short-range correlated process with an infinite set of time-scales bounded from below, and (ii) a power-law correlated process with an infinite and unbounded set of time-scale…
▽ More
The aim of the paper is to understand how the inclusion of more and more time-scales into a stochastic stationary Markovian process affects its conditional probability. To this end, we consider two Gaussian processes: (i) a short-range correlated process with an infinite set of time-scales bounded from below, and (ii) a power-law correlated process with an infinite and unbounded set of time-scales. For these processes we investigate the equal position conditional probability P(x,t|x,0) and the mean First Passage Time T(L). The function P(x,t|x,0) can be considered as a proxy of the persistence, i.e. the fact that when a process reaches a position x then it spends some time around that position value. The mean First Passage Time can be considered as a proxy of how fast is the process in reaching a position at distance L starting from position x. In the first investigation we show that the more time-scales the process includes, the larger the persistence. Specifically, we show that the power-law correlated process shows a slow power-law decay of P(x,t|x,0) to the stationary pdf. By contrast, the short range correlated process shows a decay dominated by an exponential cut-off. Moreover, we also show that the existence of an infinite and unbouded set of time-scales is a necessary and not sufficient condition for observing a slow power-law decay of P(x,t|x,0). In the second investigation, we show that for large values of L the more time-scales the process includes, the larger the mean First Passage Time, i.e. the slowest the process. On the other hand, for small values of L, the more time-scales the process includes, the smaller the mean First Passage Time, i.e. when a process statistically spends more time in a given position the likelihood that it reached nearby positions by chance is also enhanced.
△ Less
Submitted 23 March, 2010;
originally announced March 2010.
-
Emergence of time-horizon invariant correlation structure in financial returns by subtraction of the market mode
Authors:
Christian Borghesi,
Matteo Marsili,
Salvatore Miccichè
Abstract:
We investigate the emergence of a structure in the correlation matrix of assets' returns as the time-horizon over which returns are computed increases from the minutes to the daily scale. We analyze data from different stock markets (New York, Paris, London, Milano) and with different methods. Result crucially depends on whether the data is restricted to the ``internal'' dynamics of the market,…
▽ More
We investigate the emergence of a structure in the correlation matrix of assets' returns as the time-horizon over which returns are computed increases from the minutes to the daily scale. We analyze data from different stock markets (New York, Paris, London, Milano) and with different methods. Result crucially depends on whether the data is restricted to the ``internal'' dynamics of the market, where the ``center of mass'' motion (the market mode) is removed or not. If the market mode is not removed, we find that the structure emerges, as the time-horizon increases, from splitting a single large cluster. In NYSE we find that when the market mode is removed, the structure of correlation at the daily scale is already well defined at the 5 minutes time-horizon, and this structure accounts for 80 % of the classification of stocks in economic sectors. Similar results, though less sharp, are found for the other markets. We also find that the structure of correlations in the overnight returns is markedly different from that of intraday activity.
△ Less
Submitted 13 February, 2007;
originally announced February 2007.
-
Economic sector identification in a set of stocks traded at the New York Stock Exchange: a comparative analysis
Authors:
C. Coronnello,
M. Tumminello,
F. Lillo,
S. Micciche`,
R. N. Mantegna
Abstract:
We review some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory and hierarchical clustering techniques. We apply these methods to a set of stocks traded at the New York Stock Exchange. The investigated time series are recorde…
▽ More
We review some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory and hierarchical clustering techniques. We apply these methods to a set of stocks traded at the New York Stock Exchange. The investigated time series are recorded at a daily time horizon.
All the considered methods are able to detect economic information and the presence of clusters characterized by the economic sector of stocks. However, different methodologies provide different information about the considered set. Our comparative analysis suggests that the application of just a single method could not be able to extract all the economic information present in the correlation coefficient matrix of a set of stocks.
△ Less
Submitted 5 September, 2006;
originally announced September 2006.
-
Sector identification in a set of stock return time series traded at the London Stock Exchange
Authors:
C. Coronnello,
M. Tumminello,
F. Lillo,
S. Miccichè,
R. N. Mantegna
Abstract:
We compare some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory and hierarchical clustering techniques. We apply these methods to a portfolio of stocks traded at the London Stock Exchange. The investigated time series are re…
▽ More
We compare some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory and hierarchical clustering techniques. We apply these methods to a portfolio of stocks traded at the London Stock Exchange. The investigated time series are recorded both at a daily time horizon and at a 5-minute time horizon. The correlation coefficient matrix is very different at different time horizons confirming that more structured correlation coefficient matrices are observed for long time horizons. All the considered methods are able to detect economic information and the presence of clusters characterized by the economic sector of stocks. However different methods present a different degree of sensitivity with respect to different sectors. Our comparative analysis suggests that the application of just a single method could not be able to extract all the economic information present in the correlation coefficient matrix of a stock portfolio.
△ Less
Submitted 4 August, 2005;
originally announced August 2005.
-
Scaling and data collapse for the mean exit time of asset prices
Authors:
Miquel Montero,
Josep Perello,
Jaume Masoliver,
Fabrizio Lillo,
Salvatore Micciche,
Rosario N. Mantegna
Abstract:
We study theoretical and empirical aspects of the mean exit time of financial time series. The theoretical modeling is done within the framework of continuous time random walk. We empirically verify that the mean exit time follows a quadratic scaling law and it has associated a pre-factor which is specific to the analyzed stock. We perform a series of statistical tests to determine which kind of…
▽ More
We study theoretical and empirical aspects of the mean exit time of financial time series. The theoretical modeling is done within the framework of continuous time random walk. We empirically verify that the mean exit time follows a quadratic scaling law and it has associated a pre-factor which is specific to the analyzed stock. We perform a series of statistical tests to determine which kind of correlation are responsible for this specificity. The main contribution is associated with the autocorrelation property of stock returns. We introduce and solve analytically both a two-state and a three-state Markov chain models. The analytical results obtained with the two-state Markov chain model allows us to obtain a data collapse of the 20 measured MET profiles in a single master curve.
△ Less
Submitted 6 July, 2005;
originally announced July 2005.
-
Degree stability of a minimum spanning tree of price return and volatility
Authors:
Salvatore Miccichè,
Giovanni Bonanno,
Fabrizio Lillo,
Rosario N. Mantegna
Abstract:
We investigate the time series of the degree of minimum spanning trees obtained by using a correlation based clustering procedure which is starting from (i) asset return and (ii) volatility time series. The minimum spanning tree is obtained at different times by computing correlation among time series over a time window of fixed length $T$. We find that the minimum spanning tree of asset return…
▽ More
We investigate the time series of the degree of minimum spanning trees obtained by using a correlation based clustering procedure which is starting from (i) asset return and (ii) volatility time series. The minimum spanning tree is obtained at different times by computing correlation among time series over a time window of fixed length $T$. We find that the minimum spanning tree of asset return is characterized by stock degree values, which are more stable in time than the ones obtained by analyzing a minimum spanning tree computed starting from volatility time series. Our analysis also shows that the degree of stocks has a very slow dynamics with a time-scale of several years in both cases.
△ Less
Submitted 14 December, 2002;
originally announced December 2002.
