Showing 1–7 of 7 results for author: Formoso, M

Conservative Exploration for Policy Optimization via Off-Policy Policy Evaluation

Authors: Paul Daoudi, Mathias Formoso, Othman Gaizi, Achraf Azize, Evrard Garcelon

Abstract: A precondition for the deployment of a Reinforcement Learning agent to a real-world system is to provide guarantees on the learning process. While a learning algorithm will eventually converge to a good policy, there are no guarantees on the performance of the exploratory policies. We study the problem of conservative exploration, where the learner must at least be able to guarantee its performanc… ▽ More A precondition for the deployment of a Reinforcement Learning agent to a real-world system is to provide guarantees on the learning process. While a learning algorithm will eventually converge to a good policy, there are no guarantees on the performance of the exploratory policies. We study the problem of conservative exploration, where the learner must at least be able to guarantee its performance is at least as good as a baseline policy. We propose the first conservative provably efficient model-free algorithm for policy optimization in continuous finite-horizon problems. We leverage importance sampling techniques to counterfactually evaluate the conservative condition from the data self-generated by the algorithm. We derive a regret bound and show that (w.h.p.) the conservative constraint is never violated during learning. Finally, we leverage these insights to build a general schema for conservative exploration in DeepRL via off-policy policy evaluation techniques. We show empirically the effectiveness of our methods. △ Less

Submitted 24 December, 2023; originally announced December 2023.

Neural source/sink phase connectivity in developmental dyslexia by means of interchannel causality

Authors: I. RodrÍguez-RodrÍguez, A. Ortiz, N. J. Gallego-Molina, M. A. Formoso, W. L. Woo

Abstract: While the brain connectivity network can inform the understanding and diagnosis of developmental dyslexia, its cause-effect relationships have not yet enough been examined. Employing electroencephalography signals and band-limited white noise stimulus at 4.8 Hz (prosodic-syllabic frequency), we measure the phase Granger causalities among channels to identify differences between dyslexic learners a… ▽ More While the brain connectivity network can inform the understanding and diagnosis of developmental dyslexia, its cause-effect relationships have not yet enough been examined. Employing electroencephalography signals and band-limited white noise stimulus at 4.8 Hz (prosodic-syllabic frequency), we measure the phase Granger causalities among channels to identify differences between dyslexic learners and controls, thereby proposing a method to calculate directional connectivity. As causal relationships run in both directions, we explore three scenarios, namely channels' activity as sources, as sinks, and in total. Our proposed method can be used for both classification and exploratory analysis. In all scenarios, we find confirmation of the established right-lateralized Theta sampling network anomaly, in line with the temporal sampling framework's assumption of oscillatory differences in the Theta and Gamma bands. Further, we show that this anomaly primarily occurs in the causal relationships of channels acting as sinks, where it is significantly more pronounced than when only total activity is observed. In the sink scenario, our classifier obtains 0.84 and 0.88 accuracy and 0.87 and 0.93 AUC for the Theta and Gamma bands, respectively. △ Less

Submitted 2 January, 2023; originally announced January 2023.

Complex network modelling of EEG band coupling in dyslexia: an exploratory analysis of auditory processing and diagnosis

Authors: Nicolás J. Gallego-Molina, Andrés Ortiz, Francisco J. Martínez-Murcia, Marco Formoso, Almudena Giménez

Abstract: Complex network analysis has an increasing relevance in the study of neurological disorders, enhancing the knowledge of brain's structural and functional organization. Network structure and efficiency reveal different brain states along with different ways of processing the information. This work is structured around the exploratory analysis of the brain processes involved in low-level auditory pr… ▽ More Complex network analysis has an increasing relevance in the study of neurological disorders, enhancing the knowledge of brain's structural and functional organization. Network structure and efficiency reveal different brain states along with different ways of processing the information. This work is structured around the exploratory analysis of the brain processes involved in low-level auditory processing. A complex network analysis was performed on the basis of brain coupling obtained from Electroencephalography (EEG) data, while different auditory stimuli were presented to the subjects. This coupling is inferred from the Phase-Amplitude coupling (PAC) from different EEG electrodes to explore differences between controls and dyslexic subjects. Coupling data allows the construction of a graph, and then, graph theory is used to study the characteristics of the complex networks throughout time for controls and dyslexics. This results in a set of metrics including clustering coefficient, path length and small-worldness. From this, different characteristics linked to the temporal evolution of networks and coupling are pointed out for dyslexics. Our study revealed patterns related to Dyslexia as losing the small-world topology. Finally, these graph-based features are used to classify between controls and dyslexic subjects by means of a Support Vector Machine (SVM). △ Less

Submitted 21 July, 2021; v1 submitted 28 June, 2021; originally announced June 2021.

Temporal EigenPAC for dyslexia diagnosis

Authors: Nicolás Gallego-Molina, Marco Formoso, Andrés Ortiz, Francisco J. Martínez-Murcia, Juan L. Luque

Abstract: Electroencephalography signals allow to explore the functional activity of the brain cortex in a non-invasive way. However, the analysis of these signals is not straightforward due to the presence of different artifacts and the very low signal-to-noise ratio. Cross-Frequency Coupling (CFC) methods provide a way to extract information from EEG, related to the synchronization among frequency bands.… ▽ More Electroencephalography signals allow to explore the functional activity of the brain cortex in a non-invasive way. However, the analysis of these signals is not straightforward due to the presence of different artifacts and the very low signal-to-noise ratio. Cross-Frequency Coupling (CFC) methods provide a way to extract information from EEG, related to the synchronization among frequency bands. However, CFC methods are usually applied in a local way, computing the interaction between phase and amplitude at the same electrode. In this work we show a method to compute PAC features among electrodes to study the functional connectivity. Moreover, this has been applied jointly with Principal Component Analysis to explore patterns related to Dyslexia in 7-years-old children. The developed methodology reveals the temporal evolution of PAC-based connectivity. Directions of greatest variance computed by PCA are called eigenPACs here, since they resemble the classical \textit{eigenfaces} representation. The projection of PAC data onto the eigenPACs provide a set of features that has demonstrates their discriminative capability, specifically in the Beta-Gamma bands. △ Less

Submitted 13 April, 2021; originally announced April 2021.

Modelling Brain Connectivity Networks by Graph Embedding for Dyslexia Diagnosis

Authors: Marco A. Formoso, Andrés Ortiz, Francisco J. Martínez-Murcia, Nicolás Gallego-Molina, Juan L. Luque

Abstract: Several methods have been developed to extract information from electroencephalograms (EEG). One of them is Phase-Amplitude Coupling (PAC) which is a type of Cross-Frequency Coupling (CFC) method, consisting in measure the synchronization of phase and amplitude for the different EEG bands and electrodes. This provides information regarding brain areas that are synchronously activated, and eventual… ▽ More Several methods have been developed to extract information from electroencephalograms (EEG). One of them is Phase-Amplitude Coupling (PAC) which is a type of Cross-Frequency Coupling (CFC) method, consisting in measure the synchronization of phase and amplitude for the different EEG bands and electrodes. This provides information regarding brain areas that are synchronously activated, and eventually, a marker of functional connectivity between these areas. In this work, intra and inter electrode PAC is computed obtaining the relationship among different electrodes used in EEG. The connectivity information is then treated as a graph in which the different nodes are the electrodes and the edges PAC values between them. These structures are embedded to create a feature vector that can be further used to classify multichannel EEG samples. The proposed method has been applied to classified EEG samples acquired using specific auditory stimuli in a task designed for dyslexia disorder diagnosis in seven years old children EEG's. The proposed method provides AUC values up to 0.73 and allows selecting the most discriminant electrodes and EEG bands. △ Less

Submitted 12 April, 2021; originally announced April 2021.

Dyslexia detection from EEG signals using SSA component correlation and Convolutional Neural Networks

Authors: Andrés Ortiz, Francisco J. Martinez-Murcia, Marco A. Formoso, Juan Luis Luque, Auxiliadora Sánchez

Abstract: Objective dyslexia diagnosis is not a straighforward task since it is traditionally performed by means of the intepretation of different behavioural tests. Moreover, these tests are only applicable to readers. This way, early diagnosis requires the use of specific tasks not only related to reading. Thus, the use of Electroencephalography (EEG) constitutes an alternative for an objective and early… ▽ More Objective dyslexia diagnosis is not a straighforward task since it is traditionally performed by means of the intepretation of different behavioural tests. Moreover, these tests are only applicable to readers. This way, early diagnosis requires the use of specific tasks not only related to reading. Thus, the use of Electroencephalography (EEG) constitutes an alternative for an objective and early diagnosis that can be used with pre-readers. In this way, the extraction of relevant features in EEG signals results crucial for classification. However, the identification of the most relevant features is not straighforward, and predefined statistics in the time or frequency domain are not always discriminant enough. On the other hand, classical processing of EEG signals based on extracting EEG bands frequency descriptors, usually make some assumptions on the raw signals that could cause indormation loosing. In this work we propose an alternative for analysis in the frequency domain based on Singluar Spectrum Analysis (SSA) to split the raw signal into components representing different oscillatory modes. Moreover, correlation matrices obtained for each component among EEG channels are classfied using a Convolutional Neural network. △ Less

Submitted 26 October, 2020; originally announced October 2020.

Comments: 11 pages, 7 figures. Submitted to conference

Journal ref: HAIS 2020: Hybrid Artificial Intelligent Systems. LNCS 12344. pp 655-664

A Neural Approach to Ordinal Regression for the Preventive Assessment of Developmental Dyslexia

Authors: F. J. Martinez-Murcia, A. Ortiz, Marco A. Formoso, M. Lopez-Zamora, J. L. Luque, A. Giménez

Abstract: Developmental Dyslexia (DD) is a learning disability related to the acquisition of reading skills that affects about 5% of the population. DD can have an enormous impact on the intellectual and personal development of affected children, so early detection is key to implementing preventive strategies for teaching language. Research has shown that there may be biological underpinnings to DD that aff… ▽ More Developmental Dyslexia (DD) is a learning disability related to the acquisition of reading skills that affects about 5% of the population. DD can have an enormous impact on the intellectual and personal development of affected children, so early detection is key to implementing preventive strategies for teaching language. Research has shown that there may be biological underpinnings to DD that affect phoneme processing, and hence these symptoms may be identifiable before reading ability is acquired, allowing for early intervention. In this paper we propose a new methodology to assess the risk of DD before students learn to read. For this purpose, we propose a mixed neural model that calculates risk levels of dyslexia from tests that can be completed at the age of 5 years. Our method first trains an auto-encoder, and then combines the trained encoder with an optimized ordinal regression neural network devised to ensure consistency of predictions. Our experiments show that the system is able to detect unaffected subjects two years before it can assess the risk of DD based mainly on phonological processing, giving a specificity of 0.969 and a correct rate of more than 0.92. In addition, the trained encoder can be used to transform test results into an interpretable subject spatial distribution that facilitates risk assessment and validates methodology. △ Less

Submitted 20 October, 2020; v1 submitted 6 February, 2020; originally announced February 2020.

Comments: 12 pages, 4 figures