Skip to main content

Showing 1–19 of 19 results for author: Farrugia, N

Searching in archive cs. Search in all archives.
.
  1. arXiv:2403.15438  [pdf, ps, other

    eess.SP cs.LG

    Unsupervised Adaptive Deep Learning Method For BCI Motor Imagery Decoding

    Authors: Yassine El Ouahidi, Giulia Lioi, Nicolas Farrugia, Bastien Pasdeloup, Vincent Gripon

    Abstract: In the context of Brain-Computer Interfaces, we propose an adaptive method that reaches offline performance level while being usable online without requiring supervision. Interestingly, our method does not require retraining the model, as it consists in using a frozen efficient deep learning backbone while continuously realigning data, both at input and latent spaces, based on streaming observatio… ▽ More

    Submitted 15 March, 2024; originally announced March 2024.

  2. arXiv:2403.09598  [pdf, other

    cs.SD cs.LG eess.AS

    Mixture of Mixups for Multi-label Classification of Rare Anuran Sounds

    Authors: Ilyass Moummad, Nicolas Farrugia, Romain Serizel, Jeremy Froidevaux, Vincent Lostanlen

    Abstract: Multi-label imbalanced classification poses a significant challenge in machine learning, particularly evident in bioacoustics where animal sounds often co-occur, and certain sounds are much less frequent than others. This paper focuses on the specific case of classifying anuran species sounds using the dataset AnuraSet, that contains both class imbalance and multi-label examples. To address these… ▽ More

    Submitted 21 June, 2024; v1 submitted 14 March, 2024; originally announced March 2024.

  3. arXiv:2312.15824  [pdf, ps, other

    cs.SD cs.LG eess.AS

    Self-Supervised Learning for Few-Shot Bird Sound Classification

    Authors: Ilyass Moummad, Romain Serizel, Nicolas Farrugia

    Abstract: Self-supervised learning (SSL) in audio holds significant potential across various domains, particularly in situations where abundant, unlabeled data is readily available at no cost. This is pertinent in bioacoustics, where biologists routinely collect extensive sound datasets from the natural environment. In this study, we demonstrate that SSL is capable of acquiring meaningful representations of… ▽ More

    Submitted 9 February, 2024; v1 submitted 25 December, 2023; originally announced December 2023.

  4. arXiv:2312.08933  [pdf, other

    cs.LG physics.ao-ph physics.comp-ph

    Multi-Modal Learning-based Reconstruction of High-Resolution Spatial Wind Speed Fields

    Authors: Matteo Zambra, Nicolas Farrugia, Dorian Cazau, Alexandre Gensse, Ronan Fablet

    Abstract: Wind speed at sea surface is a key quantity for a variety of scientific applications and human activities. Due to the non-linearity of the phenomenon, a complete description of such variable is made infeasible on both the small scale and large spatial extents. Methods relying on Data Assimilation techniques, despite being the state-of-the-art for Numerical Weather Prediction, can not provide the r… ▽ More

    Submitted 14 December, 2023; originally announced December 2023.

    Comments: 22 pages, 13 figures. This work is to be submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

  5. arXiv:2309.08971  [pdf, other

    cs.SD cs.LG eess.AS

    Regularized Contrastive Pre-training for Few-shot Bioacoustic Sound Detection

    Authors: Ilyass Moummad, Romain Serizel, Nicolas Farrugia

    Abstract: Bioacoustic sound event detection allows for better understanding of animal behavior and for better monitoring biodiversity using audio. Deep learning systems can help achieve this goal, however it is difficult to acquire sufficient annotated data to train these systems from scratch. To address this limitation, the Detection and Classification of Acoustic Scenes and Events (DCASE) community has re… ▽ More

    Submitted 17 January, 2024; v1 submitted 16 September, 2023; originally announced September 2023.

  6. arXiv:2309.07159  [pdf, other

    eess.SP cs.LG q-bio.NC

    A Strong and Simple Deep Learning Baseline for BCI MI Decoding

    Authors: Yassine El Ouahidi, Vincent Gripon, Bastien Pasdeloup, Ghaith Bouallegue, Nicolas Farrugia, Giulia Lioi

    Abstract: We propose EEG-SimpleConv, a straightforward 1D convolutional neural network for Motor Imagery decoding in BCI. Our main motivation is to propose a simple and performing baseline to compare to, using only very standard ingredients from the literature. We evaluate its performance on four EEG Motor Imagery datasets, including simulated online setups, and compare it to recent Deep Learning and Machin… ▽ More

    Submitted 25 January, 2024; v1 submitted 11 September, 2023; originally announced September 2023.

  7. arXiv:2309.00878  [pdf, other

    cs.SD cs.LG eess.AS

    Pretraining Representations for Bioacoustic Few-shot Detection using Supervised Contrastive Learning

    Authors: Ilyass Moummad, Romain Serizel, Nicolas Farrugia

    Abstract: Deep learning has been widely used recently for sound event detection and classification. Its success is linked to the availability of sufficiently large datasets, possibly with corresponding annotations when supervised learning is considered. In bioacoustic applications, most tasks come with few labelled training data, because annotating long recordings is time consuming and costly. Therefore sup… ▽ More

    Submitted 2 September, 2023; originally announced September 2023.

  8. arXiv:2211.02624  [pdf, other

    eess.SP cs.LG

    Spatial Graph Signal Interpolation with an Application for Merging BCI Datasets with Various Dimensionalities

    Authors: Yassine El Ouahidi, Lucas Drumetz, Giulia Lioi, Nicolas Farrugia, Bastien Pasdeloup, Vincent Gripon

    Abstract: BCI Motor Imagery datasets usually are small and have different electrodes setups. When training a Deep Neural Network, one may want to capitalize on all these datasets to increase the amount of data available and hence obtain good generalization results. To this end, we introduce a spatial graph signal interpolation technique, that allows to interpolate efficiently multiple electrodes. We conduct… ▽ More

    Submitted 28 October, 2022; originally announced November 2022.

    Comments: Submitted to the 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023)

  9. arXiv:2210.16192  [pdf, other

    cs.SD cs.LG eess.AS

    Pretraining Respiratory Sound Representations using Metadata and Contrastive Learning

    Authors: Ilyass Moummad, Nicolas Farrugia

    Abstract: Methods based on supervised learning using annotations in an end-to-end fashion have been the state-of-the-art for classification problems. However, they may be limited in their generalization capability, especially in the low data regime. In this study, we address this issue using supervised contrastive learning combined with available metadata to solve multiple pretext tasks that learn a good re… ▽ More

    Submitted 11 August, 2023; v1 submitted 27 October, 2022; originally announced October 2022.

  10. arXiv:2208.08912  [pdf, other

    cs.LG physics.ao-ph physics.comp-ph

    Learning-based estimation of in-situ wind speed from underwater acoustics

    Authors: Matteo Zambra, Dorian Cazau, Nicolas Farrugia, Alexandre Gensse, Sara Pensieri, Roberto Bozzano, Ronan Fablet

    Abstract: Wind speed retrieval at sea surface is of primary importance for scientific and operational applications. Besides weather models, in-situ measurements and remote sensing technologies, especially satellite sensors, provide complementary means to monitor wind speed. As sea surface winds produce sounds that propagate underwater, underwater acoustics recordings can also deliver fine-grained wind-relat… ▽ More

    Submitted 18 August, 2022; originally announced August 2022.

    Comments: 13 pages, 5 figures

  11. arXiv:2203.04455  [pdf, other

    cs.LG eess.SP

    Pruning Graph Convolutional Networks to select meaningful graph frequencies for fMRI decoding

    Authors: Yassine El Ouahidi, Hugo Tessier, Giulia Lioi, Nicolas Farrugia, Bastien Pasdeloup, Vincent Gripon

    Abstract: Graph Signal Processing is a promising framework to manipulate brain signals as it allows to encompass the spatial dependencies between the activity in regions of interest in the brain. In this work, we are interested in better understanding what are the graph frequencies that are the most useful to decode fMRI signals. To this end, we introduce a deep learning architecture and adapt a pruning met… ▽ More

    Submitted 8 March, 2022; originally announced March 2022.

    Comments: Submitted to the 30th European Signal Processing Conference, EUSIPCO 2022

  12. arXiv:2108.10427  [pdf, other

    cs.LG

    Graph-LDA: Graph Structure Priors to Improve the Accuracy in Few-Shot Classification

    Authors: Myriam Bontonou, Nicolas Farrugia, Vincent Gripon

    Abstract: It is very common to face classification problems where the number of available labeled samples is small compared to their dimension. These conditions are likely to cause underdetermined settings, with high risk of overfitting. To improve the generalization ability of trained classifiers, common solutions include using priors about the data distribution. Among many options, data structure priors,… ▽ More

    Submitted 23 August, 2021; originally announced August 2021.

  13. arXiv:2010.12500  [pdf, other

    cs.LG

    Few-shot Decoding of Brain Activation Maps

    Authors: Myriam Bontonou, Giulia Lioi, Nicolas Farrugia, Vincent Gripon

    Abstract: Few-shot learning addresses problems for which a limited number of training examples are available. So far, the field has been mostly driven by applications in computer vision. Here, we are interested in adapting recently introduced few-shot methods to solve problems dealing with neuroimaging data, a promising application field. To this end, we create a neuroimaging benchmark dataset for few-shot… ▽ More

    Submitted 19 May, 2021; v1 submitted 23 October, 2020; originally announced October 2020.

    Comments: 5 pages. Updated title and minor modifications

  14. arXiv:1911.07847  [pdf, ps, other

    cs.CV

    Efficient Hardware Implementation of Incremental Learning and Inference on Chip

    Authors: Ghouthi Boukli Hacene, Vincent Gripon, Nicolas Farrugia, Matthieu Arzel, Michel Jezequel

    Abstract: In this paper, we tackle the problem of incrementally learning a classifier, one example at a time, directly on chip. To this end, we propose an efficient hardware implementation of a recently introduced incremental learning procedure that achieves state-of-the-art performance by combining transfer learning with majority votes and quantization techniques. The proposed design is able to accommodate… ▽ More

    Submitted 17 November, 2019; originally announced November 2019.

    Comments: In 2019 IEEE International NEWCAS Conference

  15. arXiv:1910.05149  [pdf, other

    cs.LG cs.CV eess.IV

    Spectral Graph Wavelet Transform as Feature Extractor for Machine Learning in Neuroimaging

    Authors: Yusuf Pilavci, Nicolas Farrugia

    Abstract: Graph Signal Processing has become a very useful framework for signal operations and representations defined on irregular domains. Exploiting transformations that are defined on graph models can be highly beneficial when the graph encodes relationships between signals. In this work, we present the benefits of using Spectral Graph Wavelet Transform (SGWT) as a feature extractor for machine learning… ▽ More

    Submitted 11 October, 2019; originally announced October 2019.

    Journal ref: International Conference on Acoustics, Speech, and Signal Processing, May 2019, Brighton, United Kingdom

  16. arXiv:1908.06868  [pdf, other

    eess.SP cs.LG

    Comparing linear structure-based and data-driven latent spatial representations for sequence prediction

    Authors: Myriam Bontonou, Carlos Lassance, Vincent Gripon, Nicolas Farrugia

    Abstract: Predicting the future of Graph-supported Time Series (GTS) is a key challenge in many domains, such as climate monitoring, finance or neuroimaging. Yet it is a highly difficult problem as it requires to account jointly for time and graph (spatial) dependencies. To simplify this process, it is common to use a two-step procedure in which spatial and time dependencies are dealt with separately. In th… ▽ More

    Submitted 19 August, 2019; originally announced August 2019.

    Journal ref: Wavelets and Sparsity XVIII, Aug 2019, San Diego, United States

  17. arXiv:1812.11337  [pdf, ps, other

    cs.LG cs.CV cs.NE

    Quantized Guided Pruning for Efficient Hardware Implementations of Convolutional Neural Networks

    Authors: Ghouthi Boukli Hacene, Vincent Gripon, Matthieu Arzel, Nicolas Farrugia, Yoshua Bengio

    Abstract: Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and strongly limits their usability in budget-constrained devices such as embedded devices. In this paper, we propose a combination of a new pruning technique and a quan… ▽ More

    Submitted 29 December, 2018; originally announced December 2018.

  18. arXiv:1810.02020  [pdf, ps, other

    cs.CV cs.LG

    Transfer Incremental Learning using Data Augmentation

    Authors: Ghouthi Boukli Hacene, Vincent Gripon, Nicolas Farrugia, Matthieu Arzel, Michel Jezequel

    Abstract: Deep learning-based methods have reached state of the art performances, relying on large quantity of available data and computational power. Such methods still remain highly inappropriate when facing a major open machine learning problem, which consists of learning incrementally new classes and examples over time. Combining the outstanding performances of Deep Neural Networks (DNNs) with the flexi… ▽ More

    Submitted 3 October, 2018; originally announced October 2018.

  19. arXiv:1703.01842  [pdf, other

    cs.CV q-bio.NC stat.ML

    Evaluating Graph Signal Processing for Neuroimaging Through Classification and Dimensionality Reduction

    Authors: Mathilde Ménoret, Nicolas Farrugia, Bastien Pasdeloup, Vincent Gripon

    Abstract: Graph Signal Processing (GSP) is a promising framework to analyze multi-dimensional neuroimaging datasets, while taking into account both the spatial and functional dependencies between brain signals. In the present work, we apply dimensionality reduction techniques based on graph representations of the brain to decode brain activity from real and simulated fMRI datasets. We introduce seven graphs… ▽ More

    Submitted 28 August, 2017; v1 submitted 6 March, 2017; originally announced March 2017.

    Comments: 5 pages, GlobalSIP 2017