-
Operator Learning with Neural Fields: Tackling PDEs on General Geometries
Authors:
Louis Serrano,
Lise Le Boudec,
Armand Kassaï Koupaï,
Thomas X Wang,
Yuan Yin,
Jean-Noël Vittaut,
Patrick Gallinari
Abstract:
Machine learning approaches for solving partial differential equations require learning map**s between function spaces. While convolutional or graph neural networks are constrained to discretized functions, neural operators present a promising milestone toward map** functions directly. Despite impressive results they still face challenges with respect to the domain geometry and typically rely…
▽ More
Machine learning approaches for solving partial differential equations require learning map**s between function spaces. While convolutional or graph neural networks are constrained to discretized functions, neural operators present a promising milestone toward map** functions directly. Despite impressive results they still face challenges with respect to the domain geometry and typically rely on some form of discretization. In order to alleviate such limitations, we present CORAL, a new method that leverages coordinate-based networks for solving PDEs on general geometries. CORAL is designed to remove constraints on the input mesh, making it applicable to any spatial sampling and geometry. Its ability extends to diverse problem domains, including PDE solving, spatio-temporal forecasting, and inverse problems like geometric design. CORAL demonstrates robust performance across multiple resolutions and performs well in both convex and non-convex domains, surpassing or performing on par with state-of-the-art models.
△ Less
Submitted 30 November, 2023; v1 submitted 12 June, 2023;
originally announced June 2023.
-
Privacy in Multimodal Federated Human Activity Recognition
Authors:
Alex Iacob,
Pedro P. B. Gusmão,
Nicholas D. Lane,
Armand K. Koupai,
Mohammud J. Bocus,
Raúl Santos-Rodríguez,
Robert J. Piechocki,
Ryan McConville
Abstract:
Human Activity Recognition (HAR) training data is often privacy-sensitive or held by non-cooperative entities. Federated Learning (FL) addresses such concerns by training ML models on edge clients. This work studies the impact of privacy in federated HAR at a user, environment, and sensor level. We show that the performance of FL for HAR depends on the assumed privacy level of the FL system and pr…
▽ More
Human Activity Recognition (HAR) training data is often privacy-sensitive or held by non-cooperative entities. Federated Learning (FL) addresses such concerns by training ML models on edge clients. This work studies the impact of privacy in federated HAR at a user, environment, and sensor level. We show that the performance of FL for HAR depends on the assumed privacy level of the FL system and primarily upon the colocation of data from different sensors. By avoiding data sharing and assuming privacy at the human or environment level, as prior works have done, the accuracy decreases by 5-7%. However, extending this to the modality level and strictly separating sensor data between multiple clients may decrease the accuracy by 19-42%. As this form of privacy is necessary for the ethical utilisation of passive sensing methods in HAR, we implement a system where clients mutually train both a general FL model and a group-level one per modality. Our evaluation shows that this method leads to only a 7-13% decrease in accuracy, making it possible to build HAR systems with diverse hardware.
△ Less
Submitted 2 June, 2023; v1 submitted 20 May, 2023;
originally announced May 2023.
-
Self-Supervised Multimodal Fusion Transformer for Passive Activity Recognition
Authors:
Armand K. Koupai,
Mohammud J. Bocus,
Raul Santos-Rodriguez,
Robert J. Piechocki,
Ryan McConville
Abstract:
The pervasiveness of Wi-Fi signals provides significant opportunities for human sensing and activity recognition in fields such as healthcare. The sensors most commonly used for passive Wi-Fi sensing are based on passive Wi-Fi radar (PWR) and channel state information (CSI) data, however current systems do not effectively exploit the information acquired through multiple sensors to recognise the d…
▽ More
The pervasiveness of Wi-Fi signals provides significant opportunities for human sensing and activity recognition in fields such as healthcare. The sensors most commonly used for passive Wi-Fi sensing are based on passive Wi-Fi radar (PWR) and channel state information (CSI) data, however current systems do not effectively exploit the information acquired through multiple sensors to recognise the different activities. In this paper, we explore new properties of the Transformer architecture for multimodal sensor fusion. We study different signal processing techniques to extract multiple image-based features from PWR and CSI data such as spectrograms, scalograms and Markov transition field (MTF). We first propose the Fusion Transformer, an attention-based model for multimodal and multi-sensor fusion. Experimental results show that our Fusion Transformer approach can achieve competitive results compared to a ResNet architecture but with much fewer resources. To further improve our model, we propose a simple and effective framework for multimodal and multi-sensor self-supervised learning (SSL). The self-supervised Fusion Transformer outperforms the baselines, achieving a F1-score of 95.9%. Finally, we show how this approach significantly outperforms the others when trained with as little as 1% (2 minutes) of labelled training data to 20% (40 minutes) of labelled training data.
△ Less
Submitted 15 August, 2022;
originally announced September 2022.
