-
Role of correlations in the maximum distribution of multiscale stationary Markovian processes
Authors:
Salvatore Miccichè
Abstract:
We are interested in investigating the statistical properties of extreme values for strongly correlated variables. The starting motivation is to understand how the strong-correlation properties of power-law distributed processes affect the possibility of exploring the whole domain of a stochastic process (the real axis in most cases) when performing time-average numerical simulations and how this…
▽ More
We are interested in investigating the statistical properties of extreme values for strongly correlated variables. The starting motivation is to understand how the strong-correlation properties of power-law distributed processes affect the possibility of exploring the whole domain of a stochastic process (the real axis in most cases) when performing time-average numerical simulations and how this relates to the numerical evaluation of the autocorrelation function.
We show that correlations decrease the heterogeneity of the maximum values. Specifically, through numerical simulations we observe that for strongly correlated variables whose probability distribution function decays like a power-law $1/x^α$, the maximum distribution has a tail compatible with a $1/x^{α+2}$ decay, while for i.i.d. variables we expect a $1/x^α$ decay. As a consequence, we also show that the numerically estimated autocorrelation function converges to the theoretical prediction according to a factor that depends on the length of the simulated time-series $n$ according to a power-law: $1/n^{α^δ}$ with $δ<1$, This accounts for a very slow convergence rate.
△ Less
Submitted 19 May, 2024;
originally announced May 2024.
-
Search for Neutrino Emission from GRB 221009A using the KM3NeT ARCA and ORCA detectors
Authors:
S. Aiello,
A. Albert,
M. Alshamsi,
S. Alves Garre,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
F. Badaracco,
L. Bailly-Salins,
Z. Bardačová,
B. Baret,
A. Bariego-Quintana,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
M. Benhassi,
D. M. Benoit
, et al. (251 additional authors not shown)
Abstract:
Gamma-ray bursts are promising candidate sources of high-energy astrophysical neutrinos. The recent GRB 221009A event, identified as the brightest gamma-ray burst ever detected, provides a unique opportunity to investigate hadronic emissions involving neutrinos. The KM3NeT undersea neutrino detectors participated in the worldwide follow-up effort triggered by the event, searching for neutrino even…
▽ More
Gamma-ray bursts are promising candidate sources of high-energy astrophysical neutrinos. The recent GRB 221009A event, identified as the brightest gamma-ray burst ever detected, provides a unique opportunity to investigate hadronic emissions involving neutrinos. The KM3NeT undersea neutrino detectors participated in the worldwide follow-up effort triggered by the event, searching for neutrino events. In this letter, we summarize subsequent searches, in a wide energy range from MeV up to a few PeVs. No neutrino events are found in any of the searches performed. Upper limits on the neutrino emission associated with GRB 221009A are computed.
△ Less
Submitted 30 April, 2024; v1 submitted 8 April, 2024;
originally announced April 2024.
-
Astronomy potential of KM3NeT/ARCA
Authors:
S. Aiello,
A. Albert,
M. Alshamsi,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
F. Badaracco,
L. Bailly-Salins,
Z. Bardacová,
B. Baret,
A. Bariego-Quintana,
A. Baruzzi,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati
, et al. (253 additional authors not shown)
Abstract:
The KM3NeT/ARCA neutrino detector is currently under construction at 3500 m depth offshore Capo Passero, Sicily, in the Mediterranean Sea. The main science objectives are the detection of high-energy cosmic neutrinos and the discovery of their sources. Simulations were conducted for the full KM3NeT/ARCA detector, instrumenting a volume of 1 km$^3$, to estimate the sensitivity and discovery potenti…
▽ More
The KM3NeT/ARCA neutrino detector is currently under construction at 3500 m depth offshore Capo Passero, Sicily, in the Mediterranean Sea. The main science objectives are the detection of high-energy cosmic neutrinos and the discovery of their sources. Simulations were conducted for the full KM3NeT/ARCA detector, instrumenting a volume of 1 km$^3$, to estimate the sensitivity and discovery potential to point-like neutrino sources and an all-sky diffuse neutrino flux. This paper covers the reconstruction of track- and shower-like signatures, as well as the criteria employed for neutrino event selection. By leveraging both the track and shower observation channels, the KM3NeT/ARCA detector demonstrates the capability to detect the diffuse astrophysical neutrino flux within half a year of operation, achieving a 5$σ$ statistical significance. With an angular resolution below 0.1$^\circ$ for tracks and under 2$^\circ$ for showers, the sensitivity to point-like neutrino sources surpasses existing observed limits across the entire sky.
△ Less
Submitted 29 March, 2024; v1 submitted 13 February, 2024;
originally announced February 2024.
-
Searches for neutrino counterparts of gravitational waves from the LIGO/Virgo third observing run with KM3NeT
Authors:
KM3NeT Collaboration,
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
L. Bailly-Salins,
Z. Bardačová,
B. Baret,
A. Bariego-Quintana,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
M. Benhassi,
D. M. Benoit
, et al. (251 additional authors not shown)
Abstract:
The KM3NeT neutrino telescope is currently being deployed at two different sites in the Mediterranean Sea. First searches for astrophysical neutrinos have been performed using data taken with the partial detector configuration already in operation. The paper presents the results of two independent searches for neutrinos from compact binary mergers detected during the third observing run of the LIG…
▽ More
The KM3NeT neutrino telescope is currently being deployed at two different sites in the Mediterranean Sea. First searches for astrophysical neutrinos have been performed using data taken with the partial detector configuration already in operation. The paper presents the results of two independent searches for neutrinos from compact binary mergers detected during the third observing run of the LIGO and Virgo gravitational wave interferometers. The first search looks for a global increase in the detector counting rates that could be associated with inverse beta decay events generated by MeV-scale electron anti-neutrinos. The second one focuses on upgoing track-like events mainly induced by muon (anti-)neutrinos in the GeV--TeV energy range. Both searches yield no significant excess for the sources in the gravitational wave catalogs. For each source, upper limits on the neutrino flux and on the total energy emitted in neutrinos in the respective energy ranges have been set. Stacking analyses of binary black hole mergers and neutron star-black hole mergers have also been performed to constrain the characteristic neutrino emission from these categories.
△ Less
Submitted 7 May, 2024; v1 submitted 7 November, 2023;
originally announced November 2023.
-
Prospects for combined analyses of hadronic emission from $γ$-ray sources in the Milky Way with CTA and KM3NeT
Authors:
T. Unbehaun,
L. Mohrmann,
S. Funk,
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anghinolfi,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
C. Bagatelas,
L. Bailly-Salins,
Z. Bardačová,
B. Baret,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman
, et al. (249 additional authors not shown)
Abstract:
The Cherenkov Telescope Array and the KM3NeT neutrino telescopes are major upcoming facilities in the fields of $γ$-ray and neutrino astronomy, respectively. Possible simultaneous production of $γ$ rays and neutrinos in astrophysical accelerators of cosmic-ray nuclei motivates a combination of their data. We assess the potential of a combined analysis of CTA and KM3NeT data to determine the contri…
▽ More
The Cherenkov Telescope Array and the KM3NeT neutrino telescopes are major upcoming facilities in the fields of $γ$-ray and neutrino astronomy, respectively. Possible simultaneous production of $γ$ rays and neutrinos in astrophysical accelerators of cosmic-ray nuclei motivates a combination of their data. We assess the potential of a combined analysis of CTA and KM3NeT data to determine the contribution of hadronic emission processes in known Galactic $γ$-ray emitters, comparing this result to the cases of two separate analyses. In doing so, we demonstrate the capability of Gammapy, an open-source software package for the analysis of $γ$-ray data, to also process data from neutrino telescopes. For a selection of prototypical $γ$-ray sources within our Galaxy, we obtain models for primary proton and electron spectra in the hadronic and leptonic emission scenario, respectively, by fitting published $γ$-ray spectra. Using these models and instrument response functions for both detectors, we employ the Gammapy package to generate pseudo data sets, where we assume 200 hours of CTA observations and 10 years of KM3NeT detector operation. We then apply a three-dimensional binned likelihood analysis to these data sets, separately for each instrument and jointly for both. We find that the largest benefit of the combined analysis lies in the possibility of a consistent modelling of the $γ$-ray and neutrino emission. Assuming a purely leptonic scenario as input, we obtain, for the most favourable source, an average expected 68% credible interval that constrains the contribution of hadronic processes to the observed $γ$-ray emission to below 15%.
△ Less
Submitted 2 February, 2024; v1 submitted 6 September, 2023;
originally announced September 2023.
-
Embedded Software of the KM3NeT Central Logic Board
Authors:
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
E. Androutsou,
M. Anghinolfi,
M. Anguita,
L. Aphecetche,
M. Ardid,
S. Ardid,
H. Atmani,
J. Aublin,
C. Bagatelas,
L. Bailly-Salins,
Z. Bardačová,
B. Baret,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
M. Benhassi,
D. M. Benoit
, et al. (249 additional authors not shown)
Abstract:
The KM3NeT Collaboration is building and operating two deep sea neutrino telescopes at the bottom of the Mediterranean Sea. The telescopes consist of latices of photomultiplier tubes housed in pressure-resistant glass spheres, called digital optical modules and arranged in vertical detection units. The two main scientific goals are the determination of the neutrino mass ordering and the discovery…
▽ More
The KM3NeT Collaboration is building and operating two deep sea neutrino telescopes at the bottom of the Mediterranean Sea. The telescopes consist of latices of photomultiplier tubes housed in pressure-resistant glass spheres, called digital optical modules and arranged in vertical detection units. The two main scientific goals are the determination of the neutrino mass ordering and the discovery and observation of high-energy neutrino sources in the Universe. Neutrinos are detected via the Cherenkov light, which is induced by charged particles originated in neutrino interactions. The photomultiplier tubes convert the Cherenkov light into electrical signals that are acquired and timestamped by the acquisition electronics. Each optical module houses the acquisition electronics for collecting and timestam** the photomultiplier signals with one nanosecond accuracy. Once finished, the two telescopes will have installed more than six thousand optical acquisition nodes, completing one of the more complex networks in the world in terms of operation and synchronization. The embedded software running in the acquisition nodes has been designed to provide a framework that will operate with different hardware versions and functionalities. The hardware will not be accessible once in operation, which complicates the embedded software architecture. The embedded software provides a set of tools to facilitate remote manageability of the deployed hardware, including safe reconfiguration of the firmware. This paper presents the architecture and the techniques, methods and implementation of the embedded software running in the acquisition nodes of the KM3NeT neutrino telescopes.
△ Less
Submitted 12 October, 2023; v1 submitted 2 August, 2023;
originally announced August 2023.
-
Probing invisible neutrino decay with KM3NeT-ORCA
Authors:
KM3NeT Collaboration,
S. Aiello,
A. Albert,
S. Alves Garre,
Z. Aly,
A. Ambrosone,
F. Ameli,
M. Andre,
M. Anghinolfi,
M. Anguita,
M. Ardid,
S. Ardid,
J. Aublin,
C. Bagatelas,
L. Bailly-Salins,
B. Baret,
S. Basegmez du Pree,
Y. Becherini,
M. Bendahman,
F. Benfenati,
E. Berbee,
V. Bertin,
S. Biagi,
M. Boettcher,
M. Bou Cabo
, et al. (230 additional authors not shown)
Abstract:
In the era of precision measurements of the neutrino oscillation parameters, upcoming neutrino experiments will also be sensitive to physics beyond the Standard Model. KM3NeT/ORCA is a neutrino detector optimised for measuring atmospheric neutrinos from a few GeV to around 100 GeV. In this paper, the sensitivity of the KM3NeT/ORCA detector to neutrino decay has been explored. A three-flavour neutr…
▽ More
In the era of precision measurements of the neutrino oscillation parameters, upcoming neutrino experiments will also be sensitive to physics beyond the Standard Model. KM3NeT/ORCA is a neutrino detector optimised for measuring atmospheric neutrinos from a few GeV to around 100 GeV. In this paper, the sensitivity of the KM3NeT/ORCA detector to neutrino decay has been explored. A three-flavour neutrino oscillation scenario, where the third neutrino mass state $ν_3$ decays into an invisible state, e.g. a sterile neutrino, is considered. We find that KM3NeT/ORCA would be sensitive to invisible neutrino decays with $1/α_3=τ_3/m_3 < 180$~$\mathrm{ps/eV}$ at $90\%$ confidence level, assuming true normal ordering. Finally, the impact of neutrino decay on the precision of KM3NeT/ORCA measurements for $θ_{23}$, $Δm^2_{31}$ and mass ordering have been studied. No significant effect of neutrino decay on the sensitivity to these measurements has been found.
△ Less
Submitted 27 March, 2023; v1 submitted 6 February, 2023;
originally announced February 2023.
-
Two-step estimators of high dimensional correlation matrices
Authors:
Andrés García-Medina,
Salvatore Miccichè,
Rosario N. Mantegna
Abstract:
We investigate block diagonal and hierarchical nested stochastic multivariate Gaussian models by studying their sample cross-correlation matrix on high dimensions. By performing numerical simulations, we compare a filtered sample cross-correlation with the population cross-correlation matrices by using several rotationally invariant estimators (RIE) and hierarchical clustering estimators (HCE) und…
▽ More
We investigate block diagonal and hierarchical nested stochastic multivariate Gaussian models by studying their sample cross-correlation matrix on high dimensions. By performing numerical simulations, we compare a filtered sample cross-correlation with the population cross-correlation matrices by using several rotationally invariant estimators (RIE) and hierarchical clustering estimators (HCE) under several loss functions. We show that at large but finite sample size, sample cross-correlation filtered by RIE estimators are often outperformed by HCE estimators for several of the loss functions. We also show that for block models and for hierarchically nested block models the best determination of the filtered sample cross-correlation is achieved by introducing two-step estimators combining state-of-the-art non-linear shrinkage models with hierarchical clustering estimators.
△ Less
Submitted 10 October, 2023; v1 submitted 30 December, 2022;
originally announced December 2022.
-
A numerical recipe for the computation of stationary stochastic processes' autocorrelation function
Authors:
Salvatore Miccichè
Abstract:
Many natural phenomena exhibit a stochastic nature that one attempts at modeling by using stochastic processes of different types. In this context, often one is interested in investigating the memory properties of the natural phenomenon at hand. This is usually accomplished by computing the autocorrelation function of the numerical series describing the considered phenomenon. Often, especially whe…
▽ More
Many natural phenomena exhibit a stochastic nature that one attempts at modeling by using stochastic processes of different types. In this context, often one is interested in investigating the memory properties of the natural phenomenon at hand. This is usually accomplished by computing the autocorrelation function of the numerical series describing the considered phenomenon. Often, especially when considering real world data, the autocorrelation function must be computed starting from a single numerical series: i.e. with a time-average approach. Hereafter, we will propose a novel way of evaluating the time-average autocorrelation function, based on the preliminary evaluation of the quantity N(τ,gμ,gν), that, apart from normalization factors, represents a numerical estimate, based on a single realization of the process, of the 2-point joint probability density function P(x2,τ;x1,0). The main advantage of the proposed method is that it allows to quantitatively assess what is the error that one makes when numerically evaluating the autocorrelation function due to the fact that any simulated time series is necessarily bounded. In fact, we show that, for a wide class of stochastic processes admitting a nonlinear Langevin equation with white noise and that can be described by using a Fokker-Planck equation, the way the numerical estimate of the autocorrelation function converges to its theoretical prediction depends on the pdf tails. Moreover, the knowledge of N(τ,gμ,gν) allows to easily compute the process histogram and to characterize processes with multiple timescales. We will show the effectiveness of our new methodology by considering three stochastic processes whose autocorrelation function and two-point probability density function are both known in an analytical or numerical form, thus allowing direct comparisons.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Exploring the landscape of community-based dismantling strategies
Authors:
Federico Musciotto,
Salvatore Micciché
Abstract:
Network dismantling is a relevant research area in network science, gathering attention both from a theoretical and an operational point of view. Here, we propose a general framework for dismantling that prioritizes the removal of nodes that bridge together different network communities. The strategies we detect are not unique, as they depend on the specific realization of the community detection…
▽ More
Network dismantling is a relevant research area in network science, gathering attention both from a theoretical and an operational point of view. Here, we propose a general framework for dismantling that prioritizes the removal of nodes that bridge together different network communities. The strategies we detect are not unique, as they depend on the specific realization of the community detection algorithm considered. However, when applying the methodology to some real-world networks we find that the percolation threshold at which dismantling occurs is strongly robust, and it does not depend on the specific algorithm. Thus, the stochasticity inherently present in many community detection algorithms allows to identify several strategies that have comparable effectiveness but require the removal of distinct subsets of nodes. This feature is highly relevant in operational contexts in which the removal of nodes is costly and allows to identify the least expensive strategy that still holds high effectiveness.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Nested partitions from hierarchical clustering statistical validation
Authors:
Christian Bongiorno,
Salvatore Miccichè,
Rosario N. Mantegna
Abstract:
We develop a greedy algorithm that is fast and scalable in the detection of a nested partition extracted from a dendrogram obtained from hierarchical clustering of a multivariate series. Our algorithm provides a $p$-value for each clade observed in the hierarchical tree. The $p$-value is obtained by computing a number of bootstrap replicas of the dissimilarity matrix and by performing a statistica…
▽ More
We develop a greedy algorithm that is fast and scalable in the detection of a nested partition extracted from a dendrogram obtained from hierarchical clustering of a multivariate series. Our algorithm provides a $p$-value for each clade observed in the hierarchical tree. The $p$-value is obtained by computing a number of bootstrap replicas of the dissimilarity matrix and by performing a statistical test on each difference between the dissimilarity associated with a given clade and the dissimilarity of the clade of its parent node. We prove the efficacy of our algorithm with a set of benchmarks generated by using a hierarchical factor model. We compare the results obtained by our algorithm with those of Pvclust. Pvclust is a widely used algorithm developed with a global approach originally motivated by phylogenetic studies. In our numerical experiments we focus on the role of multiple hypothesis test correction and on the robustness of the algorithms to inaccuracy and errors of datasets. We also apply our algorithm to a reference empirical dataset. We verify that our algorithm is much faster than Pvclust algorithm and has a better scalability both in the number of elements and in the number of records of the investigated multivariate set. Our algorithm provides a hierarchically nested partition in much shorter time than currently widely used algorithms allowing to perform a statistically validated cluster analysis detection in very large systems.
△ Less
Submitted 17 June, 2019;
originally announced June 2019.
-
A primer on statistically validated networks
Authors:
Salvatore Miccichè,
Rosario Nunzio Mantegna
Abstract:
In this contribution we discuss some approaches of network analysis providing information about single links or single nodes with respect to a null hypothesis taking into account the heterogeneity of the system empirically observed. With this approach, a selection of nodes and links is feasible when the null hypothesis is statistically rejected. We focus our discussion on approaches using (i) the…
▽ More
In this contribution we discuss some approaches of network analysis providing information about single links or single nodes with respect to a null hypothesis taking into account the heterogeneity of the system empirically observed. With this approach, a selection of nodes and links is feasible when the null hypothesis is statistically rejected. We focus our discussion on approaches using (i) the so-called disparity filter and (ii) statistically validated network in bipartite networks. For both methods we discuss the importance of using multiple hypothesis test correction. Specific applications of statistically validated networks are discussed. We also discuss how statistically validated networks can be used to (i) pre-process large sets of data and (ii) detect cores of communities that are forming the most close-knit and stable subsets of clusters of nodes present in a complex system.
△ Less
Submitted 19 February, 2019;
originally announced February 2019.
-
Bootstrap validation of links of a minimum spanning tree
Authors:
Federico Musciotto,
Luca Marotta,
Salvatore Miccichè,
Rosario N. Mantegna
Abstract:
We describe two different bootstrap methods applied to the detection of a minimum spanning tree obtained from a set of multivariate variables. We show that two different bootstrap procedures provide partly distinct information that can be highly informative about the investigated complex system. Our case study, based on the investigation of daily returns of a portfolio of stocks traded in the US e…
▽ More
We describe two different bootstrap methods applied to the detection of a minimum spanning tree obtained from a set of multivariate variables. We show that two different bootstrap procedures provide partly distinct information that can be highly informative about the investigated complex system. Our case study, based on the investigation of daily returns of a portfolio of stocks traded in the US equity markets, shows the degree of robustness and completeness of the information extracted with popular information filtering methods such as the minimum spanning tree and the planar maximally filtered graph. The first method performs a "row bootstrap" whereas the second method performs a "pair bootstrap". We show that the parallel use of the two methods is suggested especially for complex systems presenting both a nested hierarchical organization together with the presence of global feedback channels.
△ Less
Submitted 9 February, 2018;
originally announced February 2018.
-
Core of communities in bipartite networks
Authors:
Christian Bongiorno,
András London,
Salvatore Miccichè,
Rosario N. Mantegna
Abstract:
We use the information present in a bipartite network to detect cores of communities of each set of the bipartite system. Cores of communities are found by investigating statistically validated projected networks obtained using information present in the bipartite network. Cores of communities are highly informative and robust with respect to the presence of errors or missing entries in the bipart…
▽ More
We use the information present in a bipartite network to detect cores of communities of each set of the bipartite system. Cores of communities are found by investigating statistically validated projected networks obtained using information present in the bipartite network. Cores of communities are highly informative and robust with respect to the presence of errors or missing entries in the bipartite network. We assess the statistical robustness of cores by investigating an artificial benchmark network, the co-authorship network, and the actor-movie network. The accuracy and precision of the partition obtained with respect to the reference partition are measured in terms of the adjusted Rand index and of the adjusted Wallace index respectively. The detection of cores is highly precise although the accuracy of the methodology can be limited in some cases.
△ Less
Submitted 6 March, 2017;
originally announced April 2017.
-
An Empirically grounded Agent Based simulator for the Air Traffic Management in the SESAR scenario
Authors:
Gérald Gurtner,
Christian Bongiorno,
Marco Ducci,
Salvatore Miccichè
Abstract:
In this paper we present a simulator allowing to perform policy experiments relative to the air traffic management. Different SESAR solutions can be implemented in the model to see the reaction of the different stakeholders as well as other relevant metrics (delays, safety, etc). The model describes both the strategic phase associated to the planning of the flight trajectories and the tactical mod…
▽ More
In this paper we present a simulator allowing to perform policy experiments relative to the air traffic management. Different SESAR solutions can be implemented in the model to see the reaction of the different stakeholders as well as other relevant metrics (delays, safety, etc). The model describes both the strategic phase associated to the planning of the flight trajectories and the tactical modifications occurring in the en-route phase. An implementation of the model is available as open-source and freely accessible by any user.
More specifically, different procedures related to business trajectories and free-routing are tested and we illustrate the capabilities of the model on airspace implementing these concepts. After performing numerical simulations with the model, we show that in a free-routing scenario the controllers perform less operations although they are dispersed over a larger portion of the airspace. This can potentially increase the complexity of conflict detection and resolution for controllers.
In order to investigate this specific aspect, we consider some metrics used to measure traffic complexity. We first show that in non-free-routing situations our simulator deals with complexity in a way similar to what humans would do. This allows us to be confident that the results of our numerical simulations relative to the free-routing can reasonably forecast how human controllers would behave in this new situation. Specifically, our numerical simulations show that most of the complexity metrics decrease with free-routing, while the few metrics which increase are all linked to the flight level changes. This is a non-trivial result since intuitively the complexity should increase with free-routing because of problematic geometries and more dispersed conflicts over the airspace.
△ Less
Submitted 14 June, 2016;
originally announced June 2016.
-
Statistical characterization of deviations from planned flight trajectories in air traffic management
Authors:
C. Bongiorno,
G. Gurtner,
F. Lillo,
R. N. Mantegna,
S. Miccichè
Abstract:
Understanding the relation between planned and realized flight trajectories and the determinants of flight deviations is of great importance in air traffic management. In this paper we perform an in depth investigation of the statistical properties of planned and realized air traffic on the German airspace during a 28 day periods, corresponding to an AIRAC cycle. We find that realized trajectories…
▽ More
Understanding the relation between planned and realized flight trajectories and the determinants of flight deviations is of great importance in air traffic management. In this paper we perform an in depth investigation of the statistical properties of planned and realized air traffic on the German airspace during a 28 day periods, corresponding to an AIRAC cycle. We find that realized trajectories are on average shorter than planned ones and this effect is stronger during night-time than daytime. Flights are more frequently deviated close to the departure airport and at a relatively large angle to destination. Moreover, the probability of a deviation is higher in low traffic phases. All these evidences indicate that deviations are mostly used by controllers to give directs to flights when traffic conditions allow it. Finally we introduce a new metric, termed difork, which is able to characterize navigation points according to the likelihood that a deviation occurs there. Difork allows to identify in a statistically rigorous way navigation point pairs where deviations are more (less) frequent than expected under a null hypothesis of randomness that takes into account the heterogeneity of the navigation points. Such pairs can therefore be seen as sources of flexibility (stability) of controllers traffic management while conjugating safety and efficiency.
△ Less
Submitted 9 March, 2016;
originally announced March 2016.
-
Patterns of trading profiles at the Nordic Stock Exchange. A correlation-based approach
Authors:
Federico Musciotto,
Luca Marotta,
Salvatore Miccichè,
Jyrki Piilo,
Rosario N. Mantegna
Abstract:
We investigate the trading behavior of Finnish individual investors trading the stocks selected to compute the OMXH25 index in 2003 by tracking the individual daily investment decisions. We verify that the set of investors is a highly heterogeneous system under many aspects. We introduce a correlation based method that is able to detect a hierarchical structure of the trading profiles of heterogen…
▽ More
We investigate the trading behavior of Finnish individual investors trading the stocks selected to compute the OMXH25 index in 2003 by tracking the individual daily investment decisions. We verify that the set of investors is a highly heterogeneous system under many aspects. We introduce a correlation based method that is able to detect a hierarchical structure of the trading profiles of heterogeneous individual investors. We verify that the detected hierarchical structure is highly overlap** with the cluster structure obtained with the approach of statistically validated networks when an appropriate threshold of the hierarchical trees is used. We also show that the combination of the correlation based method and of the statistically validated method provides a way to expand the information about the clusters of investors with similar trading profiles in a robust and reliable way.
△ Less
Submitted 21 November, 2015;
originally announced November 2015.
-
Backbone of credit relationships in the Japanese credit market
Authors:
Luca Marotta,
Salvatore Miccichè,
Yoshi Fujiwara,
Hiroshi Iyetomi,
Hideaki Aoyama,
Mauro Gallegati,
Rosario N. Mantegna
Abstract:
We detect the backbone of the weighted bipartite network of the Japanese credit market relationships. The backbone is detected by adapting a general method used in the investigation of weighted networks. With this approach we detect a backbone that is statistically validated against a null hypothesis of uniform diversification of loans for banks and firms. Our investigation is done year by year an…
▽ More
We detect the backbone of the weighted bipartite network of the Japanese credit market relationships. The backbone is detected by adapting a general method used in the investigation of weighted networks. With this approach we detect a backbone that is statistically validated against a null hypothesis of uniform diversification of loans for banks and firms. Our investigation is done year by year and it covers more than thirty years during the period from 1980 to 2011. We relate some of our findings with economic events that have characterized the Japanese credit market during the last years. The study of the time evolution of the backbone allows us to detect changes occurred in network size, fraction of credit explained, and attributes characterizing the banks and the firms present in the backbone.
△ Less
Submitted 21 November, 2015;
originally announced November 2015.
-
Bank-firm credit network in Japan. An analysis of a bipartite network
Authors:
Luca Marotta,
Salvatore Miccichè,
Yoshi Fujiwara,
Hiroshi Iyetomi,
Hideaki Aoyama,
Mauro Gallegati,
Rosario N. Mantegna
Abstract:
We present an analysis of the credit market of Japan. The analysis is performed by investigating the bipartite network of banks and firms which is obtained by setting a link between a bank and a firm when a credit relationship is present in a given time window. In our investigation we focus on a community detection algorithm which is identifying communities composed by both banks and firms. We sho…
▽ More
We present an analysis of the credit market of Japan. The analysis is performed by investigating the bipartite network of banks and firms which is obtained by setting a link between a bank and a firm when a credit relationship is present in a given time window. In our investigation we focus on a community detection algorithm which is identifying communities composed by both banks and firms. We show that the clusters obtained by directly working on the bipartite network carry information about the networked nature of the Japanese credit market. Our analysis is performed for each calendar year during the time period from 1980 to 2011. Specifically, we obtain communities of banks and networks for each of the 32 investigated years, and we introduce a method to track the time evolution of these communities on a statistical basis. We then characterize communities by detecting the simultaneous over-expression of attributes of firms and banks. Specifically, we consider as attributes the economic sector and the geographical location of firms and the type of banks. In our 32 year long analysis we detect a persistence of the over-expression of attributes of clusters of banks and firms together with a slow dynamics of changes from some specific attributes to new ones. Our empirical observations show that the credit market in Japan is a networked market where the type of banks, geographical location of firms and banks and economic sector of the firm play a role in sha** the credit relationships between banks and firms.
△ Less
Submitted 21 July, 2014;
originally announced July 2014.
-
Statistically validated mobile communication networks: Evolution of motifs in European and Chinese data
Authors:
Ming-Xia Li,
Vasyl Palchykov,
Zhi-Qiang Jiang,
Kimmo Kaski,
Janos Kertész,
Salvatore Miccichè,
Michele Tumminello,
Wei-Xing Zhou,
Rosario N. Mantegna
Abstract:
Big data open up unprecedented opportunities to investigate complex systems including the society. In particular, communication data serve as major sources for computational social sciences but they have to be cleaned and filtered as they may contain spurious information due to recording errors as well as interactions, like commercial and marketing activities, not directly related to the social ne…
▽ More
Big data open up unprecedented opportunities to investigate complex systems including the society. In particular, communication data serve as major sources for computational social sciences but they have to be cleaned and filtered as they may contain spurious information due to recording errors as well as interactions, like commercial and marketing activities, not directly related to the social network. The network constructed from communication data can only be considered as a proxy for the network of social relationships. Here we apply a systematic method, based on multiple hypothesis testing, to statistically validate the links and then construct the corresponding Bonferroni network, generalized to the directed case. We study two large datasets of mobile phone records, one from Europe and the other from China. For both datasets we compare the raw data networks with the corresponding Bonferroni networks and point out significant differences in the structures and in the basic network measures. We show evidence that the Bonferroni network provides a better proxy for the network of social interactions than the original one. By using the filtered networks we investigated the statistics and temporal evolution of small directed 3-motifs and conclude that closed communication triads have a formation time-scale, which is quite fast and typically intraday. We also find that open communication triads preferentially evolve to other open triads with a higher fraction of reciprocated calls. These stylized facts were observed for both datasets.
△ Less
Submitted 15 March, 2014;
originally announced March 2014.
-
A comparative analysis of the statistical properties of large mobile phone calling networks
Authors:
Ming-Xia Li,
Zhi-Qiang Jiang,
Wen-Jie Xie,
Salvatore Miccichè,
Michele Tumminello,
Wei-Xing Zhou,
Rosario N. Mantegna
Abstract:
Mobile phone calling is one of the most widely used communication methods in modern society. The records of calls among mobile phone users provide us a valuable proxy for the understanding of human communication patterns embedded in social networks. Mobile phone users call each other forming a directed calling network. If only reciprocal calls are considered, we obtain an undirected mutual calling…
▽ More
Mobile phone calling is one of the most widely used communication methods in modern society. The records of calls among mobile phone users provide us a valuable proxy for the understanding of human communication patterns embedded in social networks. Mobile phone users call each other forming a directed calling network. If only reciprocal calls are considered, we obtain an undirected mutual calling network. The preferential communication behavior between two connected users can be statistically tested and it results in two Bonferroni networks with statistically validated edges. We perform a comparative analysis of the statistical properties of these four networks, which are constructed from the calling records of more than nine million individuals in Shanghai over a period of 110 days. We find that these networks share many common structural properties and also exhibit idiosyncratic features when compared with previously studied large mobile calling networks. The empirical findings provide us an intriguing picture of a representative large social network that might shed new lights on the modelling of large social networks.
△ Less
Submitted 6 May, 2014; v1 submitted 25 February, 2014;
originally announced February 2014.
-
Multi-scale analysis of the European airspace using network community detection
Authors:
Gérald Gurtner,
Stefania Vitali,
Marco Cipolla,
Fabrizio Lillo,
Rosario Nunzio Mantegna,
Salvatore Miccichè,
Simone Pozzi
Abstract:
We show that the European airspace can be represented as a multi-scale traffic network whose nodes are airports, sectors, or navigation points and links are defined and weighted according to the traffic of flights between the nodes. By using a unique database of the air traffic in the European airspace, we investigate the architecture of these networks with a special emphasis on their community st…
▽ More
We show that the European airspace can be represented as a multi-scale traffic network whose nodes are airports, sectors, or navigation points and links are defined and weighted according to the traffic of flights between the nodes. By using a unique database of the air traffic in the European airspace, we investigate the architecture of these networks with a special emphasis on their community structure. We propose that unsupervised network community detection algorithms can be used to monitor the current use of the airspaces and improve it by guiding the design of new ones. Specifically, we compare the performance of three community detection algorithms, also by using a null model which takes into account the spatial distance between nodes, and we discuss their ability to find communities that could be used to define new control units of the airspace.
△ Less
Submitted 17 June, 2013;
originally announced June 2013.
-
Scale-free relaxation of a wave packet in a quantum well with power-law tails
Authors:
Salvatore Miccichè,
Andreas Buchleitner,
Fabrizio Lillo,
Rosario N. Mantegna,
Tobias Paul,
Sandro Wimberger
Abstract:
We propose a setup for which a power-law decay is predicted to be observable for generic and realistic conditions. The system we study is very simple: A quantum wave packet initially prepared in a potential well with (i) tails asymptotically decaying like ~ x^{-2} and (ii) an eigenvalues spectrum that shows a continuous part attached to the ground or equilibrium state. We analytically derive the a…
▽ More
We propose a setup for which a power-law decay is predicted to be observable for generic and realistic conditions. The system we study is very simple: A quantum wave packet initially prepared in a potential well with (i) tails asymptotically decaying like ~ x^{-2} and (ii) an eigenvalues spectrum that shows a continuous part attached to the ground or equilibrium state. We analytically derive the asymptotic decay law from the spectral properties for generic, confined initial states. Our findings are supported by realistic numerical simulations for state-of-the-art expansion experiments with cold atoms.
△ Less
Submitted 10 February, 2013; v1 submitted 27 November, 2012;
originally announced November 2012.
-
Gene-based and semantic structure of the Gene Ontology as a complex network
Authors:
Salvatore Miccichè
Abstract:
The last decade has seen the advent and consolidation of ontology based tools for the identification and biological interpretation of classes of genes, such as the Gene Ontology. The information accumulated time-by-time and included in the GO is encoded in the definition of terms and in the setting up of semantic relations amongst terms. This approach might be usefully complemented by a bottom-up…
▽ More
The last decade has seen the advent and consolidation of ontology based tools for the identification and biological interpretation of classes of genes, such as the Gene Ontology. The information accumulated time-by-time and included in the GO is encoded in the definition of terms and in the setting up of semantic relations amongst terms. This approach might be usefully complemented by a bottom-up approach based on the knowledge of relationships amongst genes. To this end, we investigate the Gene Ontology from a complex network perspective. We consider the semantic network of terms naturally associated with the semantic relationships provided by the Gene Ontology consortium and a gene-based weighted network in which the nodes are the terms and a link between any two terms is set up whenever genes are annotated in both terms. One aim of the present paper is to understand whether the semantic and the gene-based network share the same structural properties or not. We then consider network communities. The identification of communities in the SVNs network can therefore be the basis of a simple protocol aiming at fully exploiting the possible relationships amongst terms, thus improving the knowledge of the semantic structure of GO. This is also important from a biomedical point of view, as it might reveal how genes over-expressed in a certain term also affect other biological functions not directly linked by the GO semantics. As a by-product, we present a simple methodology that allows to have a first glance insight about the biological characterization of groups of GO terms.
△ Less
Submitted 10 November, 2012;
originally announced November 2012.
-
How news affect the trading behavior of different categories of investors in a financial market
Authors:
Fabrizio Lillo,
Salvatore Miccichè,
Michele Tumminello,
Jyrki Piilo,
Rosario Nunzio Mantegna
Abstract:
We investigate the trading behavior of a large set of single investors trading the highly liquid Nokia stock over the period 2003-2008 with the aim of determining the relative role of endogenous and exogenous factors that may affect their behavior. As endogenous factors we consider returns and volatility, whereas the exogenous factors we use are the total daily number of news and a semantic variab…
▽ More
We investigate the trading behavior of a large set of single investors trading the highly liquid Nokia stock over the period 2003-2008 with the aim of determining the relative role of endogenous and exogenous factors that may affect their behavior. As endogenous factors we consider returns and volatility, whereas the exogenous factors we use are the total daily number of news and a semantic variable based on a sentiment analysis of news. Linear regression and partial correlation analysis of data show that different categories of investors are differently correlated to these factors. Governmental and non profit organizations are weakly sensitive to news and returns or volatility, and, typically, they are more correlated with the former than with the latter. Households and companies, on the contrary, are very sensitive to both endogenous and exogenous factors, and volatility and returns are, on average, much more relevant than the number of news and sentiment, respectively. Finally, financial institutions and foreign organizations are intermediate between these two cases, in terms of both the total explanatory power of these factors and their relative importance.
△ Less
Submitted 13 July, 2012;
originally announced July 2012.
-
Do firms share the same functional form of their growth rate distribution? A new statistical test
Authors:
Josè T. Lunardi,
Salvatore Miccichè,
Fabrizio Lillo,
Rosario N. Mantegna,
Mauro Gallegati
Abstract:
We introduce a new statistical test of the hypothesis that a balanced panel of firms have the same growth rate distribution or, more generally, that they share the same functional form of growth rate distribution. We applied the test to European Union and US publicly quoted manufacturing firms data, considering functional forms belonging to the Subbotin family of distributions. While our hypothese…
▽ More
We introduce a new statistical test of the hypothesis that a balanced panel of firms have the same growth rate distribution or, more generally, that they share the same functional form of growth rate distribution. We applied the test to European Union and US publicly quoted manufacturing firms data, considering functional forms belonging to the Subbotin family of distributions. While our hypotheses are rejected for the vast majority of sets at the sector level, we cannot rejected them at the subsector level, indicating that homogenous panels of firms could be described by a common functional form of growth rate distribution.
△ Less
Submitted 11 March, 2011;
originally announced March 2011.
-
Community characterization of heterogeneous complex systems
Authors:
Michele Tumminello,
Salvatore Miccichè,
Fabrizio Lillo,
Jan Varho,
Jyrki Piilo,
Rosario N. Mantegna
Abstract:
We introduce an analytical statistical method to characterize the communities detected in heterogeneous complex systems. By posing a suitable null hypothesis, our method makes use of the hypergeometric distribution to assess the probability that a given property is over-expressed in the elements of a community with respect to all the elements of the investigated set. We apply our method to two spe…
▽ More
We introduce an analytical statistical method to characterize the communities detected in heterogeneous complex systems. By posing a suitable null hypothesis, our method makes use of the hypergeometric distribution to assess the probability that a given property is over-expressed in the elements of a community with respect to all the elements of the investigated set. We apply our method to two specific complex networks, namely a network of world movies and a network of physics preprints. The characterization of the elements and of the communities is done in terms of languages and countries for the movie network and of journals and subject categories for papers. We find that our method is able to characterize clearly the identified communities. Moreover our method works well both for large and for small communities.
△ Less
Submitted 18 November, 2010;
originally announced November 2010.
-
Statistically validated networks in bipartite complex systems
Authors:
Michele Tumminello,
Salvatore Miccichè,
Fabrizio Lillo,
Jyrki Piilo,
Rosario N. Mantegna
Abstract:
Many complex systems present an intrinsic bipartite nature and are often described and modeled in terms of networks [1-5]. Examples include movies and actors [1, 2, 4], authors and scientific papers [6-9], email accounts and emails [10], plants and animals that pollinate them [11, 12]. Bipartite networks are often very heterogeneous in the number of relationships that the elements of one set estab…
▽ More
Many complex systems present an intrinsic bipartite nature and are often described and modeled in terms of networks [1-5]. Examples include movies and actors [1, 2, 4], authors and scientific papers [6-9], email accounts and emails [10], plants and animals that pollinate them [11, 12]. Bipartite networks are often very heterogeneous in the number of relationships that the elements of one set establish with the elements of the other set. When one constructs a projected network with nodes from only one set, the system heterogeneity makes it very difficult to identify preferential links between the elements. Here we introduce an unsupervised method to statistically validate each link of the projected network against a null hypothesis taking into account the heterogeneity of the system. We apply our method to three different systems, namely the set of clusters of orthologous genes (COG) in completely sequenced genomes [13, 14], a set of daily returns of 500 US financial stocks, and the set of world movies of the IMDb database [15]. In all these systems, both different in size and level of heterogeneity, we find that our method is able to detect network structures which are informative about the system and are not simply expression of its heterogeneity. Specifically, our method (i) identifies the preferential relationships between the elements, (ii) naturally highlights the clustered structure of investigated systems, and (iii) allows to classify links according to the type of statistically validated relationships between the connected nodes.
△ Less
Submitted 8 August, 2010;
originally announced August 2010.
-
First Passage Time Distribution of multi-scale stationary Markovian processes
Authors:
S. Micciché
Abstract:
The aim of this paper is to investigate how the correlation properties of a stationary Markovian stochastic processes affect the First Passage Time distribution. First Passage Time issues are a classical topic in stochastic processes research. They also have relevant applications, for example, in many fields of finance such as the assessment of the default risk for firms' assets. By using some exp…
▽ More
The aim of this paper is to investigate how the correlation properties of a stationary Markovian stochastic processes affect the First Passage Time distribution. First Passage Time issues are a classical topic in stochastic processes research. They also have relevant applications, for example, in many fields of finance such as the assessment of the default risk for firms' assets. By using some explicit examples, in this paper we will show that the tail of the First Passage Time distribution crucially depends on the correlation properties of the process and it is independent from its stationary distribution. When the process includes an infinite set of time-scales bounded from above, the FPTD shows tails modulated by some exponential decay. In the case when the process is power-law correlated the FPTD shows power-law tails 1/t^(alfa+1)/2 and therefore the moments <t^n> of the FPTD are finite only when n< (alfa-1)/2. We will also show that such power-law behaviour is not merely due to the fact that the process includes an infinite and unbounded set of time-scales. Rather, the time-scale must enter the FPTD with weights that must be distributed according to a power-law for large time-scales values. Finally, we will give a general result connecting the FPTD of an additive stochastic processes x(t) to the FPTD of a generic process y(t) related by a coordinate transformation y=f(x) to the first one.
△ Less
Submitted 11 June, 2010;
originally announced June 2010.
-
The role of conditional probability in multi-scale stationary Markovian processes
Authors:
Salvatore Miccichè
Abstract:
The aim of the paper is to understand how the inclusion of more and more time-scales into a stochastic stationary Markovian process affects its conditional probability. To this end, we consider two Gaussian processes: (i) a short-range correlated process with an infinite set of time-scales bounded from below, and (ii) a power-law correlated process with an infinite and unbounded set of time-scale…
▽ More
The aim of the paper is to understand how the inclusion of more and more time-scales into a stochastic stationary Markovian process affects its conditional probability. To this end, we consider two Gaussian processes: (i) a short-range correlated process with an infinite set of time-scales bounded from below, and (ii) a power-law correlated process with an infinite and unbounded set of time-scales. For these processes we investigate the equal position conditional probability P(x,t|x,0) and the mean First Passage Time T(L). The function P(x,t|x,0) can be considered as a proxy of the persistence, i.e. the fact that when a process reaches a position x then it spends some time around that position value. The mean First Passage Time can be considered as a proxy of how fast is the process in reaching a position at distance L starting from position x. In the first investigation we show that the more time-scales the process includes, the larger the persistence. Specifically, we show that the power-law correlated process shows a slow power-law decay of P(x,t|x,0) to the stationary pdf. By contrast, the short range correlated process shows a decay dominated by an exponential cut-off. Moreover, we also show that the existence of an infinite and unbouded set of time-scales is a necessary and not sufficient condition for observing a slow power-law decay of P(x,t|x,0). In the second investigation, we show that for large values of L the more time-scales the process includes, the larger the mean First Passage Time, i.e. the slowest the process. On the other hand, for small values of L, the more time-scales the process includes, the smaller the mean First Passage Time, i.e. when a process statistically spends more time in a given position the likelihood that it reached nearby positions by chance is also enhanced.
△ Less
Submitted 23 March, 2010;
originally announced March 2010.
-
Modeling long-range memory with stationary Markovian processes
Authors:
Salvatore Miccichè
Abstract:
In this paper we give explicit examples of power-law correlated stationary Markovian processes y(t) where the stationary pdf shows tails which are gaussian or exponential. These processes are obtained by simply performing a coordinate transformation of a specific power-law correlated additive process x(t), already known in the literature, whose pdf shows power-law tails 1/x^a. We give analytical…
▽ More
In this paper we give explicit examples of power-law correlated stationary Markovian processes y(t) where the stationary pdf shows tails which are gaussian or exponential. These processes are obtained by simply performing a coordinate transformation of a specific power-law correlated additive process x(t), already known in the literature, whose pdf shows power-law tails 1/x^a. We give analytical and numerical evidence that although the new processes (i) are Markovian and (ii) have gaussian or exponential tails their autocorrelation function still shows a power-law decay <y(t) y(t+T)>=1/T^b where b grows with a with a law which is compatible with b=a/2-c, where c is a numerical constant. When a<2(1+c) the process y(t), although Markovian, is long-range correlated. Our results help in clarifying that even in the context of Markovian processes long-range dependencies are not necessarily associated to the occurrence of extreme events. Moreover, our results can be relevant in the modeling of complex systems with long memory. In fact, we provide simple processes associated to Langevin equations thus showing that long-memory effects can be modeled in the context of continuous time stationary Markovian processes.
△ Less
Submitted 4 June, 2008;
originally announced June 2008.
-
Statistical properties of thermodynamically predicted RNA secondary structures in viral genomes
Authors:
Marco Spanò,
Fabrizio Lillo,
Salvatore Miccichè,
Rosario N. Mantegna
Abstract:
By performing a comprehensive study on 1832 segments of 1212 complete genomes of viruses, we show that in viral genomes the hairpin structures of thermodynamically predicted RNA secondary structures are more abundant than expected under a simple random null hypothesis. The detected hairpin structures of RNA secondary structures are present both in coding and in noncoding regions for the four gro…
▽ More
By performing a comprehensive study on 1832 segments of 1212 complete genomes of viruses, we show that in viral genomes the hairpin structures of thermodynamically predicted RNA secondary structures are more abundant than expected under a simple random null hypothesis. The detected hairpin structures of RNA secondary structures are present both in coding and in noncoding regions for the four groups of viruses categorized as dsDNA, dsRNA, ssDNA and ssRNA. For all groups hairpin structures of RNA secondary structures are detected more frequently than expected for a random null hypothesis in noncoding rather than in coding regions. However, potential RNA secondary structures are also present in coding regions of dsDNA group. In fact we detect evolutionary conserved RNA secondary structures in conserved coding and noncoding regions of a large set of complete genomes of dsDNA herpesviruses.
△ Less
Submitted 18 March, 2008;
originally announced March 2008.
-
Emergence of time-horizon invariant correlation structure in financial returns by subtraction of the market mode
Authors:
Christian Borghesi,
Matteo Marsili,
Salvatore Miccichè
Abstract:
We investigate the emergence of a structure in the correlation matrix of assets' returns as the time-horizon over which returns are computed increases from the minutes to the daily scale. We analyze data from different stock markets (New York, Paris, London, Milano) and with different methods. Result crucially depends on whether the data is restricted to the ``internal'' dynamics of the market,…
▽ More
We investigate the emergence of a structure in the correlation matrix of assets' returns as the time-horizon over which returns are computed increases from the minutes to the daily scale. We analyze data from different stock markets (New York, Paris, London, Milano) and with different methods. Result crucially depends on whether the data is restricted to the ``internal'' dynamics of the market, where the ``center of mass'' motion (the market mode) is removed or not. If the market mode is not removed, we find that the structure emerges, as the time-horizon increases, from splitting a single large cluster. In NYSE we find that when the market mode is removed, the structure of correlation at the daily scale is already well defined at the 5 minutes time-horizon, and this structure accounts for 80 % of the classification of stocks in economic sectors. Similar results, though less sharp, are found for the other markets. We also find that the structure of correlations in the overnight returns is markedly different from that of intraday activity.
△ Less
Submitted 13 February, 2007;
originally announced February 2007.
-
Economic sector identification in a set of stocks traded at the New York Stock Exchange: a comparative analysis
Authors:
C. Coronnello,
M. Tumminello,
F. Lillo,
S. Micciche`,
R. N. Mantegna
Abstract:
We review some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory and hierarchical clustering techniques. We apply these methods to a set of stocks traded at the New York Stock Exchange. The investigated time series are recorde…
▽ More
We review some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory and hierarchical clustering techniques. We apply these methods to a set of stocks traded at the New York Stock Exchange. The investigated time series are recorded at a daily time horizon.
All the considered methods are able to detect economic information and the presence of clusters characterized by the economic sector of stocks. However, different methodologies provide different information about the considered set. Our comparative analysis suggests that the application of just a single method could not be able to extract all the economic information present in the correlation coefficient matrix of a set of stocks.
△ Less
Submitted 5 September, 2006;
originally announced September 2006.
-
Sector identification in a set of stock return time series traded at the London Stock Exchange
Authors:
C. Coronnello,
M. Tumminello,
F. Lillo,
S. Miccichè,
R. N. Mantegna
Abstract:
We compare some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory and hierarchical clustering techniques. We apply these methods to a portfolio of stocks traded at the London Stock Exchange. The investigated time series are re…
▽ More
We compare some methods recently used in the literature to detect the existence of a certain degree of common behavior of stock returns belonging to the same economic sector. Specifically, we discuss methods based on random matrix theory and hierarchical clustering techniques. We apply these methods to a portfolio of stocks traded at the London Stock Exchange. The investigated time series are recorded both at a daily time horizon and at a 5-minute time horizon. The correlation coefficient matrix is very different at different time horizons confirming that more structured correlation coefficient matrices are observed for long time horizons. All the considered methods are able to detect economic information and the presence of clusters characterized by the economic sector of stocks. However different methods present a different degree of sensitivity with respect to different sectors. Our comparative analysis suggests that the application of just a single method could not be able to extract all the economic information present in the correlation coefficient matrix of a stock portfolio.
△ Less
Submitted 4 August, 2005;
originally announced August 2005.
-
Scaling and data collapse for the mean exit time of asset prices
Authors:
Miquel Montero,
Josep Perello,
Jaume Masoliver,
Fabrizio Lillo,
Salvatore Micciche,
Rosario N. Mantegna
Abstract:
We study theoretical and empirical aspects of the mean exit time of financial time series. The theoretical modeling is done within the framework of continuous time random walk. We empirically verify that the mean exit time follows a quadratic scaling law and it has associated a pre-factor which is specific to the analyzed stock. We perform a series of statistical tests to determine which kind of…
▽ More
We study theoretical and empirical aspects of the mean exit time of financial time series. The theoretical modeling is done within the framework of continuous time random walk. We empirically verify that the mean exit time follows a quadratic scaling law and it has associated a pre-factor which is specific to the analyzed stock. We perform a series of statistical tests to determine which kind of correlation are responsible for this specificity. The main contribution is associated with the autocorrelation property of stock returns. We introduce and solve analytically both a two-state and a three-state Markov chain models. The analytical results obtained with the two-state Markov chain model allows us to obtain a data collapse of the 20 measured MET profiles in a single master curve.
△ Less
Submitted 6 July, 2005;
originally announced July 2005.
-
Inverted Repeats in Viral Genomes
Authors:
M. Spano,
F. Lillo,
S. Micciche,
R. N. Mantegna
Abstract:
We investigate 738 complete genomes of viruses to detect the presence of short inverted repeats. The number of inverted repeats found is compared with the prediction obtained for a Bernoullian and for a Markovian control model. We find as a statistical regularity that the number of observed inverted repeats is often greater than the one expected in terms of a Bernoullian or Markovian model in se…
▽ More
We investigate 738 complete genomes of viruses to detect the presence of short inverted repeats. The number of inverted repeats found is compared with the prediction obtained for a Bernoullian and for a Markovian control model. We find as a statistical regularity that the number of observed inverted repeats is often greater than the one expected in terms of a Bernoullian or Markovian model in several of the viruses and in almost all those with a genome longer than 30,000 bp.
△ Less
Submitted 5 October, 2004;
originally announced October 2004.
-
Networks of equities in financial markets
Authors:
G. Bonanno,
G. Caldarelli,
F. Lillo,
S. Micciche`,
N. Vandewalle,
R. N. Mantegna
Abstract:
We review the recent approach of correlation based networks of financial equities. We investigate portfolio of stocks at different time horizons, financial indices and volatility time series and we show that meaningful economic information can be extracted from noise dressed correlation matrices. We show that the method can be used to falsify widespread market models by directly comparing the to…
▽ More
We review the recent approach of correlation based networks of financial equities. We investigate portfolio of stocks at different time horizons, financial indices and volatility time series and we show that meaningful economic information can be extracted from noise dressed correlation matrices. We show that the method can be used to falsify widespread market models by directly comparing the topological properties of networks of real and artificial markets.
△ Less
Submitted 16 January, 2004;
originally announced January 2004.
-
Degree stability of a minimum spanning tree of price return and volatility
Authors:
Salvatore Miccichè,
Giovanni Bonanno,
Fabrizio Lillo,
Rosario N. Mantegna
Abstract:
We investigate the time series of the degree of minimum spanning trees obtained by using a correlation based clustering procedure which is starting from (i) asset return and (ii) volatility time series. The minimum spanning tree is obtained at different times by computing correlation among time series over a time window of fixed length $T$. We find that the minimum spanning tree of asset return…
▽ More
We investigate the time series of the degree of minimum spanning trees obtained by using a correlation based clustering procedure which is starting from (i) asset return and (ii) volatility time series. The minimum spanning tree is obtained at different times by computing correlation among time series over a time window of fixed length $T$. We find that the minimum spanning tree of asset return is characterized by stock degree values, which are more stable in time than the ones obtained by analyzing a minimum spanning tree computed starting from volatility time series. Our analysis also shows that the degree of stocks has a very slow dynamics with a time-scale of several years in both cases.
△ Less
Submitted 14 December, 2002;
originally announced December 2002.
-
Volatility in Financial Markets: Stochastic Models and Empirical Results
Authors:
Salvatore Micciche`,
Giovanni Bonanno,
Fabrizio Lillo,
Rosario N. Mantegna
Abstract:
We investigate the historical volatility of the 100 most capitalized stocks traded in US equity markets. An empirical probability density function (pdf) of volatility is obtained and compared with the theoretical predictions of a lognormal model and of the Hull and White model. The lognormal model well describes the pdf in the region of low values of volatility whereas the Hull and White model b…
▽ More
We investigate the historical volatility of the 100 most capitalized stocks traded in US equity markets. An empirical probability density function (pdf) of volatility is obtained and compared with the theoretical predictions of a lognormal model and of the Hull and White model. The lognormal model well describes the pdf in the region of low values of volatility whereas the Hull and White model better approximates the empirical pdf for large values of volatility. Both models fails in describing the empirical pdf over a moderately large volatility range.
△ Less
Submitted 28 February, 2002;
originally announced February 2002.
-
Soliton Solutions with Real Poles in the Alekseev formulation of the Inverse-Scattering method
Authors:
S. Micciche,
J. B. Griffiths
Abstract:
A new approach to the inverse-scattering technique of Alekseev is presented which permits real-pole soliton solutions of the Ernst equations to be considered. This is achieved by adopting distinct real poles in the scattering matrix and its inverse. For the case in which the electromagnetic field vanishes, some explicit solutions are given using a Minkowski seed metric. The relation with the cor…
▽ More
A new approach to the inverse-scattering technique of Alekseev is presented which permits real-pole soliton solutions of the Ernst equations to be considered. This is achieved by adopting distinct real poles in the scattering matrix and its inverse. For the case in which the electromagnetic field vanishes, some explicit solutions are given using a Minkowski seed metric. The relation with the corresponding soliton solutions that can be constructed using the Belinskii-Zakharov inverse-scattering technique is determined.
△ Less
Submitted 22 September, 1999;
originally announced September 1999.
-
Infra-Red Asymptotic Dynamics of Gauge Invariant Charged Fields: QED versus QCD
Authors:
E. d'Emilio,
S. Micciche
Abstract:
The freedom one has in constructing locally gauge invariant charged fields in gauge theories is analyzed in full detail and exploited to construct, in QED, an electron field whose two-point function W(p), up to the fourth order in the coupling constant, is normalized with on-shell normalization conditions and is, nonetheless, infra-red finite; as a consequence the radiative corrections vanish on…
▽ More
The freedom one has in constructing locally gauge invariant charged fields in gauge theories is analyzed in full detail and exploited to construct, in QED, an electron field whose two-point function W(p), up to the fourth order in the coupling constant, is normalized with on-shell normalization conditions and is, nonetheless, infra-red finite; as a consequence the radiative corrections vanish on the mass shell $p^2=μ^2$ and the free field singularity is dominant, although, in contrast to quantum field theories with mass gap, the eigenvalue $μ^2$ of the mass operator is not isolated. The same construction, carried out for the quark in QCD, is not sufficient for cancellation of infra-red divergences to take place in the fourth order. The latter divergences, however, satisfy a simple factorization equation. We speculate on the scenario that could be drawn about infra-red asymptotic dynamics of QCD, should this factorization equation be true in any order of perturbation theory.
△ Less
Submitted 18 August, 1999;
originally announced August 1999.
-
The extensions of gravitational soliton solutions with real poles
Authors:
J. B. Griffiths,
S. Micciche
Abstract:
We analyse vacuum gravitational "soliton" solutions with real poles in the cosmological context. It is well known that these solutions contain singularities on certain null hypersurfaces. Using a Kasner seed solution, we demonstrate that these may contain thin sheets of null matter or may be simple coordinate singularities, and we describe a number of possible extensions through them.
We analyse vacuum gravitational "soliton" solutions with real poles in the cosmological context. It is well known that these solutions contain singularities on certain null hypersurfaces. Using a Kasner seed solution, we demonstrate that these may contain thin sheets of null matter or may be simple coordinate singularities, and we describe a number of possible extensions through them.
△ Less
Submitted 2 November, 1998;
originally announced November 1998.
