Showing 1–22 of 22 results for author: Escudero, J

Graph-Based Multivariate Multiscale Dispersion Entropy: Efficient Implementation and Applications to Real-World Network Data

Authors: John Stewart Fabila-Carrasco, Chao Tan, Javier Escudero

Abstract: We introduce Multivariate Multiscale Graph-based Dispersion Entropy (mvDEG), a novel, computationally efficient method for analyzing multivariate time series data in graph and complex network frameworks, and demonstrate its application in real-world data. mvDEG effectively combines temporal dynamics with topological relationships, offering enhanced analysis compared to traditional nonlinear entrop… ▽ More We introduce Multivariate Multiscale Graph-based Dispersion Entropy (mvDEG), a novel, computationally efficient method for analyzing multivariate time series data in graph and complex network frameworks, and demonstrate its application in real-world data. mvDEG effectively combines temporal dynamics with topological relationships, offering enhanced analysis compared to traditional nonlinear entropy methods. Its efficacy is established through testing on synthetic signals, such as uncorrelated and correlated noise, showcasing its adeptness in discerning various levels of dependency and complexity. The robustness of mvDEG is further validated with real-world datasets, effectively differentiating various two-phase flow regimes and capturing distinct dynamics in weather data analysis. An important advancement of mvDEG is its computational efficiency. Our optimized algorithm displays a computational time that grows linearly with the number of vertices or nodes, in contrast to the exponential growth observed in classical methods. This efficiency is achieved through refined matrix power calculations that exploit matrix and Kronecker product properties, making our method faster than the state of the art. The significant acceleration in computational time positions mvDEG as a transformative tool for extensive and real-time applications, setting a new benchmark in the analysis of time series recorded at distributed locations and opening avenues for innovative applications. △ Less

Submitted 1 May, 2024; originally announced May 2024.

Comments: 9 pages, 10 figures

MSC Class: 60J20; 05C82; 05C85; 94C15

An IoT system for a smart campus: Challenges and solutions illustrated over several real-world use cases

Authors: Tomás Domínguez-Bolaño, Valentín Barral, Carlos J. Escudero, José A. García-Naya

Abstract: This article discusses the development of an IoT system for monitoring and controlling various devices and systems from different vendors. The authors considered key challenges in IoT projects, such as interoperability and integration, scalability, and data storage, processing, and visualization, during the design and deployment phases. In addition to these general challenges, the authors also del… ▽ More This article discusses the development of an IoT system for monitoring and controlling various devices and systems from different vendors. The authors considered key challenges in IoT projects, such as interoperability and integration, scalability, and data storage, processing, and visualization, during the design and deployment phases. In addition to these general challenges, the authors also delve into the specific integration challenges they encountered. Various devices and systems were integrated into the system and five real-world scenarios in a university campus environment are used to illustrate the challenges encountered. The scenarios involve monitoring various aspects of a university campus environment, including air quality, environmental parameters, energy efficiency, solar photovoltaic energy, and energy consumption. The authors analyzed data and CPU usage to ensure that the system could handle the large amount of data generated by the devices. The platform developed uses open source projects such as Home Assistant, InfluxDB, Grafana, and Node-RED. All developments have been published as open source in public repositories. In conclusion, this work highlights the potential and feasibility of IoT systems in various real-world applications, the importance of considering key challenges in IoT projects during the design and deployment phases, and the specific integration challenges that may be encountered. △ Less

Submitted 15 February, 2024; originally announced March 2024.

Comments: 21 pages, 16 figures, Published in Internet of Things

Journal ref: Internet of Things, vol. 25, April 2024,

Collaborative learning of common latent representations in routinely collected multivariate ICU physiological signals

Authors: Hollan Haule, Ian Piper, Patricia Jones, Tsz-Yan Milly Lo, Javier Escudero

Abstract: In Intensive Care Units (ICU), the abundance of multivariate time series presents an opportunity for machine learning (ML) to enhance patient phenoty**. In contrast to previous research focused on electronic health records (EHR), here we propose an ML approach for phenoty** using routinely collected physiological time series data. Our new algorithm integrates Long Short-Term Memory (LSTM) netw… ▽ More In Intensive Care Units (ICU), the abundance of multivariate time series presents an opportunity for machine learning (ML) to enhance patient phenoty**. In contrast to previous research focused on electronic health records (EHR), here we propose an ML approach for phenoty** using routinely collected physiological time series data. Our new algorithm integrates Long Short-Term Memory (LSTM) networks with collaborative filtering concepts to identify common physiological states across patients. Tested on real-world ICU clinical data for intracranial hypertension (IH) detection in patients with brain injury, our method achieved an area under the curve (AUC) of 0.889 and average precision (AP) of 0.725. Moreover, our algorithm outperforms autoencoders in learning more structured latent representations of the physiological signals. These findings highlight the promise of our methodology for patient phenoty**, leveraging routinely collected multivariate time series to improve clinical care practices. △ Less

Submitted 27 February, 2024; originally announced February 2024.

VAE-IF: Deep feature extraction with averaging for unsupervised artifact detection in routine acquired ICU time-series

Authors: Hollan Haule, Ian Piper, Patricia Jones, Chen Qin, Tsz-Yan Milly Lo, Javier Escudero

Abstract: Artifacts are a common problem in physiological time-series data collected from intensive care units (ICU) and other settings. They affect the quality and reliability of clinical research and patient care. Manual annotation of artifacts is costly and time-consuming, rendering it impractical. Automated methods are desired. Here, we propose a novel unsupervised approach to detect artifacts in clinic… ▽ More Artifacts are a common problem in physiological time-series data collected from intensive care units (ICU) and other settings. They affect the quality and reliability of clinical research and patient care. Manual annotation of artifacts is costly and time-consuming, rendering it impractical. Automated methods are desired. Here, we propose a novel unsupervised approach to detect artifacts in clinical-standard minute-by-minute resolution ICU data without any prior labeling or signal-specific knowledge. Our approach combines a variational autoencoder (VAE) and an isolation forest (iForest) model to learn features and identify anomalies in different types of vital signs, such as blood pressure, heart rate, and intracranial pressure. We evaluate our approach on a real-world ICU dataset and compare it with supervised models based on long short-term memory (LSTM) and XGBoost. We show that our approach achieves comparable sensitivity and generalizes well to an external dataset. We also visualize the latent space learned by the VAE and demonstrate its ability to disentangle clean and noisy samples. Our approach offers a promising solution for cleaning ICU data in clinical research and practice without the need for any labels whatsoever. △ Less

Submitted 10 December, 2023; originally announced December 2023.

Open-VERSO: a vision of 5G experimentation infrastructures, hurdles and challenges

Authors: Angel Martin, Pablo Losada, Carolina Fernández, Mikel Zorrilla, Zaloa Fernandez, Alvaro Gabilondo, Juncal Uriol, Felipe Mogollon, Mikel Serón, Michalis Dalgitsis, Roberto Viola, Luis Roca, Carlos Giraldo, Pablo Gonzalez, Anxo Tato, Joaquín Escudero, Alvaro Vazquez, Daniel Camps, Andrés Cárdenas, Carlos Herranz, Joan Josep Aleixendri, Rebeca Iglesias, Gianluca Cernigliaro, Mario Montagud, Pau Tomàs , et al. (1 additional authors not shown)

Abstract: 5G led to a digital revolution for networks by leveraging virtualisation techniques to manage software-based network functions through provided standard interfaces, which have matured recently for cloud infrastructure that is widely employed across domains and sectors. This undiscovered potential to adequately respond to concurrent and specialised traffic demands is promising for a wide spectrum o… ▽ More 5G led to a digital revolution for networks by leveraging virtualisation techniques to manage software-based network functions through provided standard interfaces, which have matured recently for cloud infrastructure that is widely employed across domains and sectors. This undiscovered potential to adequately respond to concurrent and specialised traffic demands is promising for a wide spectrum of industries. Moreover, it exposes the networking ecosystem to prospects beyond the traditional value chain. However, the configuration, deployment and operation of a 5G network are challenging. Thus, different scientific and research entities have built their own open, evolvable and updateable testbed infrastructure that can be used for experimentation purposes. Such testbeds enable different stakeholders to integrate new systems or features exploiting new technologies, assess the performance of innovative services, and customise operation policies to find optimal setups from a cost-effective perspective. Furthermore, federations of infrastructure allow for wider and more complex experiments to be performed in distributed domains. However, numerous technical and procedural obstacles exist during the building of 5G network testbeds. In addition, some technical barriers persist despite the testing of alternatives and ongoing efforts within open-source systems and commercial equipment portfolios. All these limitations and challenges are relevant for experimenters and stakeholders as they attempt to determine the scope of 5G set expectations. △ Less

Submitted 28 August, 2023; originally announced August 2023.

Comments: 41 pages, 8 tables, White Paper

Hybrid Artifact Detection System for Minute Resolution Blood Pressure Signals from ICU

Authors: Hollan Haule, Evangelos Kafantaris, Tsz-Yan Milly Lo, Chen Qin, Javier Escudero

Abstract: Physiological monitoring in intensive care units (ICU) generates data that can be used in clinical research. However, the recording conditions in clinical settings limit the automated extraction of relevant information from physiological signals due to noise and artifacts. Therefore, removing artifacts before clinical research is essential. Manual annotation by experienced researchers, which is th… ▽ More Physiological monitoring in intensive care units (ICU) generates data that can be used in clinical research. However, the recording conditions in clinical settings limit the automated extraction of relevant information from physiological signals due to noise and artifacts. Therefore, removing artifacts before clinical research is essential. Manual annotation by experienced researchers, which is the gold standard for removing artifacts, is time-consuming and costly due to the volume of the data generated in the ICU. In this study, we propose a hybrid artifact detection system that combines a Variational Autoencoder with a statistical detection component for the labeling of artifactual samples to automate the costly process of cleaning physiological recordings. The system is applied to minute-by-minute mean blood pressure signals from an intensive care unit dataset. Its performance is verified by manual annotations made by an expert. We benchmark the performance of our system with two other systems that combine an ARIMA or an autoencoder-based model with our statistical detection component. Our results indicate that the system consistently achieves sensitivity and specificity levels of over 90%. Thus, it provides an initial foundation to automate data cleaning in recordings from ICU. △ Less

Submitted 31 August, 2022; v1 submitted 11 March, 2022; originally announced March 2022.

Multivariate permutation entropy, a Cartesian graph product approach

Authors: John Stewart Fabila-Carrasco, Chao Tan, Javier Escudero

Abstract: Entropy metrics are nonlinear measures to quantify the complexity of time series. Among them, permutation entropy is a common metric due to its robustness and fast computation. Multivariate entropy metrics techniques are needed to analyse data consisting of more than one time series. To this end, we present a multivariate permutation entropy, $MPE_G$, using a graph-based approach. Given a multiv… ▽ More Entropy metrics are nonlinear measures to quantify the complexity of time series. Among them, permutation entropy is a common metric due to its robustness and fast computation. Multivariate entropy metrics techniques are needed to analyse data consisting of more than one time series. To this end, we present a multivariate permutation entropy, $MPE_G$, using a graph-based approach. Given a multivariate signal, the algorithm $MPE_G$ involves two main steps: 1) we construct an underlying graph G as the Cartesian product of two graphs G1 and G2, where G1 preserves temporal information of each times series together with G2 that models the relations between different channels, and 2) we consider the multivariate signal as samples defined on the regular graph G and apply the recently introduced permutation entropy for graphs. Our graph-based approach gives the flexibility to consider diverse types of cross channel relationships and signals, and it overcomes with the limitations of current multivariate permutation entropy. △ Less

Submitted 1 March, 2022; originally announced March 2022.

Comments: 5 pages, 4 figures, 2 tables

MSC Class: 37M25; 05C82; 94C15; 18M35

Stratified Multivariate Multiscale Dispersion Entropy for Physiological Signal Analysis

Authors: Evangelos Kafantaris, Tsz-Yan Milly Lo, Javier Escudero

Abstract: Multivariate entropy quantification algorithms are becoming a prominent tool for the extraction of information from multi-channel physiological time-series. However, in the analysis of physiological signals from heterogeneous organ systems, certain channels may overshadow the patterns of others, resulting in information loss. Here, we introduce the framework of Stratified Entropy to prioritize eac… ▽ More Multivariate entropy quantification algorithms are becoming a prominent tool for the extraction of information from multi-channel physiological time-series. However, in the analysis of physiological signals from heterogeneous organ systems, certain channels may overshadow the patterns of others, resulting in information loss. Here, we introduce the framework of Stratified Entropy to prioritize each channels' dynamics based on their allocation to respective strata, leading to a richer description of the multi-channel time-series. As an implementation of the framework, three algorithmic variations of the Stratified Multivariate Multiscale Dispersion Entropy are introduced. These variations and the original algorithm are applied to synthetic time-series, waveform physiological time-series, and derivative physiological data. Based on the synthetic time-series experiments, the variations successfully prioritize channels following their strata allocation while maintaining the low computation time of the original algorithm. In experiments on waveform physiological time-series and derivative physiological data, increased discrimination capacity was noted for multiple strata allocations in the variations when benchmarked to the original algorithm. This suggests improved physiological state monitoring by the variations. Furthermore, our variations can be modified to utilize a priori knowledge for the stratification of channels. Thus, our research provides a novel approach for the extraction of previously inaccessible information from multi-channel time series acquired from heterogeneous systems. △ Less

Submitted 17 January, 2023; v1 submitted 18 February, 2022; originally announced February 2022.

Permutation Entropy for Graph Signals

Authors: John Stewart Fabila-Carrasco, Chao Tan, Javier Escudero

Abstract: Entropy metrics (for example, permutation entropy) are nonlinear measures of irregularity in time series (one-dimensional data). Some of these entropy metrics can be generalised to data on periodic structures such as a grid or lattice pattern (two-dimensional data) using its symmetry, thus enabling their application to images. However, these metrics have not been developed for signals sampled on i… ▽ More Entropy metrics (for example, permutation entropy) are nonlinear measures of irregularity in time series (one-dimensional data). Some of these entropy metrics can be generalised to data on periodic structures such as a grid or lattice pattern (two-dimensional data) using its symmetry, thus enabling their application to images. However, these metrics have not been developed for signals sampled on irregular domains, defined by a graph. Here, we define for the first time an entropy metric to analyse signals measured over irregular graphs by generalising permutation entropy, a well-established nonlinear metric based on the comparison of neighbouring values within patterns in a time series. Our algorithm is based on comparing signal values on neighbouring nodes, using the adjacency matrix. We show that this generalisation preserves the properties of classical permutation for time series and the recent permutation entropy for images, and it can be applied to any graph structure with synthetic and real signals. We expect the present work to enable the extension of other nonlinear dynamic approaches to graph signals. △ Less

Submitted 20 October, 2021; v1 submitted 1 October, 2021; originally announced October 2021.

Comments: 11 pares, 12 figures, 2 tables

An Efficient Mixture of Deep and Machine Learning Models for COVID-19 and Tuberculosis Detection Using X-Ray Images in Resource Limited Settings

Authors: Ali H. Al-Timemy, Rami N. Khushaba, Zahraa M. Mosa, Javier Escudero

Abstract: Clinicians in the frontline need to assess quickly whether a patient with symptoms indeed has COVID-19 or not. The difficulty of this task is exacerbated in low resource settings that may not have access to biotechnology tests. Furthermore, Tuberculosis (TB) remains a major health problem in several low- and middle-income countries and its common symptoms include fever, cough and tiredness, simila… ▽ More Clinicians in the frontline need to assess quickly whether a patient with symptoms indeed has COVID-19 or not. The difficulty of this task is exacerbated in low resource settings that may not have access to biotechnology tests. Furthermore, Tuberculosis (TB) remains a major health problem in several low- and middle-income countries and its common symptoms include fever, cough and tiredness, similarly to COVID-19. In order to help in the detection of COVID-19, we propose the extraction of deep features (DF) from chest X-ray images, a technology available in most hospitals, and their subsequent classification using machine learning methods that do not require large computational resources. We compiled a five-class dataset of X-ray chest images including a balanced number of COVID-19, viral pneumonia, bacterial pneumonia, TB, and healthy cases. We compared the performance of pipelines combining 14 individual state-of-the-art pre-trained deep networks for DF extraction with traditional machine learning classifiers. A pipeline consisting of ResNet-50 for DF computation and ensemble of subspace discriminant classifier was the best performer in the classification of the five classes, achieving a detection accuracy of 91.6+ 2.6% (accuracy + 95% Confidence Interval). Furthermore, the same pipeline achieved accuracies of 98.6+1.4% and 99.9+0.5% in simpler three-class and two-class classification problems focused on distinguishing COVID-19, TB and healthy cases; and COVID-19 and healthy images, respectively. The pipeline was computationally efficient requiring just 0.19 second to extract DF per X-ray image and 2 minutes for training a traditional classifier with more than 2000 images on a CPU machine. The results suggest the potential benefits of using our pipeline in the detection of COVID-19, particularly in resource-limited settings and it can run with limited computational resources. △ Less

Submitted 16 July, 2020; originally announced July 2020.

Comments: The final constructed dataset named COVID-19 five-class balanced dataset is available from: https://drive.google.com/drive/folders/1toMymyHTy0DR_fyE7hjO3LSBGWtVoPNf?usp=sharing

Report number: This is a preprint of the following chapter: Ali Al-Timemy, [An Efficient Mixture of Deep and Machine Learning Models for COVID-19 and Tuberculosis Detection Using X-Ray Images in Resource Limited Settings, published in Artificial Intelligence for COVID-19, edited by Diego Oliva, 2021, Springer reproduced with permission of publisher Springer Nature Switzerland AG. The final authenticated version is available online at: https://doi.org/10.1007/978-3-030-69744-0_6

Journal ref: Artificial Intelligence for COVID-19. Studies in Systems, Decision and Control, vol 358. 2021, Springer, Cham

An improved DNN-based spectral feature map** that removes noise and reverberation for robust automatic speech recognition

Authors: Juan Pablo Escudero, José Novoa, Rodrigo Mahu, Jorge Wuth, Fernando Huenupán, Richard Stern, Néstor Becerra Yoma

Abstract: Reverberation and additive noise have detrimental effects on the performance of automatic speech recognition systems. In this paper we explore the ability of a DNN-based spectral feature map** to remove the effects of reverberation and additive noise. Experiments with the CHiME-2 database show that this DNN can achieve an average reduction in WER of 4.5%, when compared to the baseline system, at… ▽ More Reverberation and additive noise have detrimental effects on the performance of automatic speech recognition systems. In this paper we explore the ability of a DNN-based spectral feature map** to remove the effects of reverberation and additive noise. Experiments with the CHiME-2 database show that this DNN can achieve an average reduction in WER of 4.5%, when compared to the baseline system, at SNRs equal to -6 dB, -3 dB, 0 dB and 3 dB, and just 0.8% at greater SNRs of 6 dB and 9 dB. These results suggest that this DNN is more effective in removing additive noise than reverberation. To improve the DNN performance, we combine it with the weighted prediction error (WPE) method that shows a complementary behavior. While this combination provided a reduction in WER of approximately 11% when compared with the baseline, the observed improvement is not as great as that obtained using WPE alone. However, modifications to the DNN training process were applied and an average reduction in WER equal to 18.3% was achieved when compared with the baseline system. Furthermore, the improved DNN combined with WPE achieves a reduction in WER of 7.9% when compared with WPE alone. △ Less

Submitted 3 April, 2018; v1 submitted 23 March, 2018; originally announced March 2018.

Comments: 5 pages

Exploring the robustness of features and enhancement on speech recognition systems in highly-reverberant real environments

Authors: José Novoa, Juan Pablo Escudero, Jorge Wuth, Victor Poblete, Simon King, Richard Stern, Néstor Becerra Yoma

Abstract: This paper evaluates the robustness of a DNN-HMM-based speech recognition system in highly-reverberant real environments using the HRRE database. The performance of locally-normalized filter bank (LNFB) and Mel filter bank (MelFB) features in combination with Non-negative Matrix Factorization (NMF), Suppression of Slowly-varying components and the Falling edge (SSF) and Weighted Prediction Error (… ▽ More This paper evaluates the robustness of a DNN-HMM-based speech recognition system in highly-reverberant real environments using the HRRE database. The performance of locally-normalized filter bank (LNFB) and Mel filter bank (MelFB) features in combination with Non-negative Matrix Factorization (NMF), Suppression of Slowly-varying components and the Falling edge (SSF) and Weighted Prediction Error (WPE) enhancement methods are discussed and evaluated. Two training conditions were considered: clean and reverberated (Reverb). With Reverb training the use of WPE and LNFB provides WERs that are 3% and 20% lower in average than SSF and NMF, respectively. WPE and MelFB provides WERs that are 11% and 24% lower in average than SSF and NMF, respectively. With clean training, which represents a significant mismatch between testing and training conditions, LNFB features clearly outperform MelFB features. The results show that different types of training, parametrization, and enhancement techniques may work better for a specific combination of speaker-microphone distance and reverberation time. This suggests that there could be some degree of complementarity between systems trained with different enhancement and parametrization methods. △ Less

Submitted 23 March, 2018; originally announced March 2018.

Comments: 5 pages

Normalised Degree Variance

Authors: Keith M. Smith, Javier Escudero

Abstract: Finding graph indices which are unbiased to network size and density is of high importance both within a given field and across fields for enhancing comparability of modern network science studies. The degree variance is an important metric for characterising network degree heterogeneity. Here, we provide an analytically valid normalisation of degree variance to replace previous normalisations whi… ▽ More Finding graph indices which are unbiased to network size and density is of high importance both within a given field and across fields for enhancing comparability of modern network science studies. The degree variance is an important metric for characterising network degree heterogeneity. Here, we provide an analytically valid normalisation of degree variance to replace previous normalisations which are either invalid or not applicable to all networks. It is shown that this normalisation provides equal values for graphs and their complements; it is maximal in the star graph (and its complement); and its expected value is constant with respect to density for Erdös-Rényi (ER) random graphs of the same size. We strengthen these results with model observations in ER random graphs, random geometric graphs, scale-free networks, random hierarchy networks and resting-state brain networks, showing that the proposed normalisation is generally less affected by both network size and density than previous normalisation attempts. The closed form expression proposed also benefits from high computational efficiency and straightforward mathematical analysis. Analysis of 184 real-world binary networks across different disciplines shows that normalised degree variance is not correlated with average degree and is robust to node and edge subsampling. Comparisons across subdomains of biological networks reveals greater degree heterogeneity among brain connectomes and food webs than in protein interaction networks. △ Less

Submitted 7 April, 2020; v1 submitted 8 March, 2018; originally announced March 2018.

Comments: 16 pages, 6 figures

Highly-Reverberant Real Environment database: HRRE

Authors: Juan Pablo Escudero, Victor Poblete, José Novoa, Jorge Wuth, Josué Fredes, Rodrigo Mahu, Richard Stern, Néstor Becerra Yoma

Abstract: Speech recognition in highly-reverberant real environments remains a major challenge. An evaluation dataset for this task is needed. This report describes the generation of the Highly-Reverberant Real Environment database (HRRE). This database contains 13.4 hours of data recorded in real reverberant environments and consists of 20 different testing conditions which consider a wide range of reverbe… ▽ More Speech recognition in highly-reverberant real environments remains a major challenge. An evaluation dataset for this task is needed. This report describes the generation of the Highly-Reverberant Real Environment database (HRRE). This database contains 13.4 hours of data recorded in real reverberant environments and consists of 20 different testing conditions which consider a wide range of reverberation times and speaker-to-microphone distances. These evaluation sets were generated by re-recording the clean test set of the Aurora-4 database which corresponds to five loudspeaker-microphone distances in four reverberant conditions. △ Less

Submitted 23 March, 2018; v1 submitted 29 January, 2018; originally announced January 2018.

Comments: five pages

Multichannel Robot Speech Recognition Database: MChRSR

Authors: José Novoa, Juan Pablo Escudero, Josué Fredes, Jorge Wuth, Rodrigo Mahu, Néstor Becerra Yoma

Abstract: In real human robot interaction (HRI) scenarios, speech recognition represents a major challenge due to robot noise, background noise and time-varying acoustic channel. This document describes the procedure used to obtain the Multichannel Robot Speech Recognition Database (MChRSR). It is composed of 12 hours of multichannel evaluation data recorded in a real mobile HRI scenario. This database was… ▽ More In real human robot interaction (HRI) scenarios, speech recognition represents a major challenge due to robot noise, background noise and time-varying acoustic channel. This document describes the procedure used to obtain the Multichannel Robot Speech Recognition Database (MChRSR). It is composed of 12 hours of multichannel evaluation data recorded in a real mobile HRI scenario. This database was recorded with a PR2 robot performing different translational and azimuthal movements. Accordingly, 16 evaluation sets were obtained re-recording the clean set of the Aurora 4 database in different movement conditions. △ Less

Submitted 29 December, 2017; originally announced January 2018.

Amplitude- and Frequency-based Dispersion Patterns and Entropy

Authors: Hamed Azami, Javier Escudero

Abstract: Permutation patterns-based approaches, such as permutation entropy (PerEn), have been widely and successfully used to analyze data. However, these methods have two main shortcomings. First, when a series is symbolized based on permutation patterns, repetition as an unavoidable phenomenon in data is not took in to account. Second, they consider only the order of amplitude values and so, some inform… ▽ More Permutation patterns-based approaches, such as permutation entropy (PerEn), have been widely and successfully used to analyze data. However, these methods have two main shortcomings. First, when a series is symbolized based on permutation patterns, repetition as an unavoidable phenomenon in data is not took in to account. Second, they consider only the order of amplitude values and so, some information regarding the amplitude values themselves may be ignored. To address these deficiencies, we have very recently introduced dispersion patterns and subsequently, dispersion entropy (DispEn). In this paper, we investigate the effect of different linear and non-linear map** approaches, used in the algorithm of DispEn, on the characterization of signals. We also inspect the sensitivity of different parameters of DispEn to noise. Moreover, we introduce frequency-based DispEn (FDispEn) as a measure to deal with only the frequency of time series. The results suggest that DispEn and FDispEn with the log-sigmoid map** approach, unlike PerEn, can detect outliers. Furthermore, the original and frequency-based forbidden dispersion patterns are introduced to discriminate deterministic from stochastic time series. The computation times show that DispEn and FDispEn are considerably faster than PerEn. Finally, we find that DispEn and FDispEn outperform PerEn to distinguish various dynamics of biomedical signals. Due to their advantages over existing entropy methods, DispEn and FDispEn are expected to be widely used for the characterization of a wide variety of real-world time series. △ Less

Submitted 3 August, 2017; originally announced August 2017.

Complex tensor factorisation with PARAFAC2 for the estimation of brain connectivity from the EEG

Authors: Loukianos Spyrou, Mario Parra, Javier Escudero

Abstract: Objective: The coupling between neuronal populations and its magnitude have been shown to be informative for various clinical applications. One method to estimate brain connectivity is with electroencephalography (EEG) from which the cross-spectrum between different sensor locations is derived. We wish to test the efficacy of tensor factorisation in the estimation of brain connectivity. Methods: C… ▽ More Objective: The coupling between neuronal populations and its magnitude have been shown to be informative for various clinical applications. One method to estimate brain connectivity is with electroencephalography (EEG) from which the cross-spectrum between different sensor locations is derived. We wish to test the efficacy of tensor factorisation in the estimation of brain connectivity. Methods: Complex tensor factorisation based on PARAFAC2 is used to decompose the EEG into scalp components described by the spatial, spectral, and complex trial profiles. An EEG model in the complex domain was derived that shows the suitability of PARAFAC2. A connectivity metric was also derived on the complex trial profiles of the extracted components. Results: Results on a benchmark EEG dataset confirmed that PARAFAC2 can estimate connectivity better than traditional tensor analysis such as PARAFAC within a range of signal-to-noise ratios. The analysis of EEG from patients with mild cognitive impairment or Alzheimer's disease showed that PARAFAC2 identifies loss of brain connectivity better than traditional approaches and agreeing with prior pathological knowledge. Conclusion: The complex PARAFAC2 algorithm is suitable for EEG connectivity estimation since it allows to extract meaningful coupled sources and provides better estimates than complex PARAFAC. Significance: A new paradigm that employs complex tensor factorisation has demonstrated to be successful in identifying brain connectivity and the location of couples sources for both a benchmark and a real-world EEG dataset. This can enable future applications and has the potential to solve some the issues that deteriorate the performance of traditional connectivity metrics. △ Less

Submitted 2 May, 2017; originally announced May 2017.

Weighted network estimation by the use of topological graph metrics

Authors: Loukianos Spyrou, Javier Escudero

Abstract: Topological metrics of graphs provide a natural way to describe the prominent features of various types of networks. Graph metrics describe the structure and interplay of graph edges and have found applications in many scientific fields. In this work, graph metrics are used in network estimation by develo** optimisation methods that incorporate prior knowledge of a network's topology. The deriva… ▽ More Topological metrics of graphs provide a natural way to describe the prominent features of various types of networks. Graph metrics describe the structure and interplay of graph edges and have found applications in many scientific fields. In this work, graph metrics are used in network estimation by develo** optimisation methods that incorporate prior knowledge of a network's topology. The derivatives of graph metrics are used in gradient descent schemes for weighted undirected network denoising, network completion, and network decomposition. The successful performance of our methodology is shown in a number of toy examples and real-world datasets. Most notably, our work establishes a new link between graph theory, network science and optimisation. △ Less

Submitted 19 June, 2018; v1 submitted 2 May, 2017; originally announced May 2017.

Comments: Accepted for publication in IEEE Transactions on Network Science and Engineering

MSC Class: 05C22; 62H12

Graph-Variate Signal Analysis

Authors: Keith Smith, Loukianos Spyrou, Javier Escudero

Abstract: Incorporating graphs in the analysis of multivariate signals is becoming a standard way to understand the interdependency of activity recorded at different sites. The new research frontier in this direction includes the important problem of how to assess dynamic changes of signal activity. We address this problem in a novel way by defining the graph-variate signal alongside methods for its analysi… ▽ More Incorporating graphs in the analysis of multivariate signals is becoming a standard way to understand the interdependency of activity recorded at different sites. The new research frontier in this direction includes the important problem of how to assess dynamic changes of signal activity. We address this problem in a novel way by defining the graph-variate signal alongside methods for its analysis. Essentially, graph-variate signal analysis leverages graphs of reliable connectivity information to filter instantaneous bivariate functions of the multivariate signal. This opens up a new and robust approach to analyse joint signal and network dynamics at sample resolution. Furthermore, our method can be formulated as instantaneous networks on which standard network analysis can be implemented. When graph connectivity is estimated from the multivariate signal itself, the appropriate consideration of instantaneous graph signal functions allows for a novel dynamic connectivity measure-- graphvariate dynamic (GVD) connectivity-- which is robust to spurious short-term dependencies. Particularly, we present appropriate functions for three pertinent connectivity metrics-- correlation, coherence and the phase-lag index. We show that our approach can determine signals with a single correlated couple against wholly uncorrelated data of up to 128 nodes in signal size (1 out of 8128 weighted edges). GVD connectivity is also shown to be more robust than i) other GSP approaches at detecting a randomly traveling spheroid on a 3D grid and ii) standard dynamic connectivity in determining differences in EEG restingstate and task-related activity. We also demonstrate its use in revealing hidden depth correlations from geophysical gamma ray data. We expect that the methods and framework presented will provide new approaches to data analysis in a variety of applied settings. △ Less

Submitted 12 November, 2018; v1 submitted 20 March, 2017; originally announced March 2017.

Journal ref: IEEE Transactions on Signal Processing, vol. 67, no. 2, pp. 293-305, 15 Jan.15, 2019

Are Erdös- Rényi Random Graphs Topologically Random?

Authors: Keith Smith, Javier Escudero

Abstract: No. We prove that Erdos- Renyi Random Graphs are not topologically random. No. We prove that Erdos- Renyi Random Graphs are not topologically random. △ Less

Submitted 31 March, 2017; v1 submitted 1 March, 2017; originally announced March 2017.

Comments: This paper has been withdrawn by the author due to known results. See B. Bollobas, The Automorphism Group, Chapter 9 of Random Graphs, Cambridge University Press, 2011

Refined Composite Multiscale Dispersion Entropy and its Application to Biomedical Signals

Authors: Hamed Azami, Mostafa Rostaghi, Daniel Abasolo, Javier Escudero

Abstract: Multiscale entropy (MSE) is a widely-used tool to analyze biomedical signals. It was proposed to overcome the deficiencies of conventional entropy methods when quantifying the complexity of time series. However, MSE is undefined for very short signals and slow for real-time applications because of the use of sample entropy (SampEn). To overcome these shortcomings, we introduce multiscale dispersio… ▽ More Multiscale entropy (MSE) is a widely-used tool to analyze biomedical signals. It was proposed to overcome the deficiencies of conventional entropy methods when quantifying the complexity of time series. However, MSE is undefined for very short signals and slow for real-time applications because of the use of sample entropy (SampEn). To overcome these shortcomings, we introduce multiscale dispersion entropy (DisEn - MDE) as a very fast and powerful method to quantify the complexity of signals. MDE is based on our recently developed DisEn, which has a computation cost of O(N), compared with O(N2) for SampEn. We also propose the refined composite MDE (RCMDE) to improve the stability of MDE. We evaluate MDE, RCMDE, and refined composite MSE (RCMSE) on synthetic signals and find that these methods have similar behaviors but the MDE and RCMDE are significantly faster than MSE and RCMSE, respectively. The results also illustrate that RCMDE is more stable than MDE for short and noisy signals, which are common in biomedical applications. To evaluate the proposed methods on real signals, we employ three biomedical datasets, including focal and non-focal electroencephalograms (EEGs), blood pressure recordings in Fantasia database, and resting-state EEGs activity in Alzheimer's disease (AD). The results again demonstrate a similar behavior of RCMSE, MDE and RCMDE, although the RCMDE and MDE are significantly faster and lead to larger differences between physiological conditions known to alter the complexity of the physiological recordings. To sum up, MDE and RCMDE are expected to be useful for the analysis of physiological signals thanks to their ability to distinguish different types of dynamics. △ Less

Submitted 3 May, 2017; v1 submitted 4 June, 2016; originally announced June 2016.

Comments: 8 pages, 6 figures

Journal ref: IEEE Transactions on Biomedical Engineering (2017)

Refined Multiscale Fuzzy Entropy based on Standard Deviation for Biomedical Signal Analysis

Authors: Hamed Azami, Alberto Fernandez, Javier Escudero

Abstract: Multiscale entropy (MSE) has been a prevalent algorithm to quantify the complexity of fluctuations in the local mean value of biomedical time series. Recent developments in the field have tried to improve the MSE by reducing its variability in large scale factors. On the other hand, there has been recent interest in using other statistical moments than the mean, i.e. variance, in the coarse-graini… ▽ More Multiscale entropy (MSE) has been a prevalent algorithm to quantify the complexity of fluctuations in the local mean value of biomedical time series. Recent developments in the field have tried to improve the MSE by reducing its variability in large scale factors. On the other hand, there has been recent interest in using other statistical moments than the mean, i.e. variance, in the coarse-graining step of the MSE. Building on these trends, here we introduce the so-called refined composite multiscale fuzzy entropy based on the standard deviation (RCMFEσ) to quantify the dynamical properties of spread over multiple time scales. We demonstrate the dependency of the RCMFEσ, in comparison with other multiscale approaches, on several straightforward signal processing concepts using a set of synthetic signals. We also investigate the complementarity of using the standard deviation instead of the mean in the coarse-graining process using magnetoencephalograms in Alzheimer disease and publicly available electroencephalograms recorded from focal and non-focal areas in epilepsy. Our results indicate that RCMFEσ offers complementary information to that revealed by classical coarse-graining approaches and that it has superior performance to distinguish different types of physiological activity. △ Less

Submitted 3 May, 2017; v1 submitted 8 February, 2016; originally announced February 2016.