-
Fantastyc: Blockchain-based Federated Learning Made Secure and Practical
Authors:
William Boitier,
Antonella Del Pozzo,
Álvaro García-Pérez,
Stephane Gazut,
Pierre Jobic,
Alexis Lemaire,
Erwan Mahe,
Aurelien Mayoue,
Maxence Perion,
Deepika Singh,
Tuanir Franca Rezende,
Sara Tucci-Piergiovanni
Abstract:
Federated Learning is a decentralized framework that enables multiple clients to collaboratively train a machine learning model under the orchestration of a central server without sharing their local data. The centrality of this framework represents a point of failure which is addressed in literature by blockchain-based federated learning approaches. While ensuring a fully-decentralized solution w…
▽ More
Federated Learning is a decentralized framework that enables multiple clients to collaboratively train a machine learning model under the orchestration of a central server without sharing their local data. The centrality of this framework represents a point of failure which is addressed in literature by blockchain-based federated learning approaches. While ensuring a fully-decentralized solution with traceability, such approaches still face several challenges about integrity, confidentiality and scalability to be practically deployed. In this paper, we propose Fantastyc, a solution designed to address these challenges that have been never met together in the state of the art.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
Federated Dataset Dictionary Learning for Multi-Source Domain Adaptation
Authors:
Fabiola Espinoza Castellon,
Eduardo Fernandes Montesuma,
Fred Ngolè Mboula,
Aurélien Mayoue,
Antoine Souloumiac,
Cédric Gouy-Pailler
Abstract:
In this article, we propose an approach for federated domain adaptation, a setting where distributional shift exists among clients and some have unlabeled data. The proposed framework, FedDaDiL, tackles the resulting challenge through dictionary learning of empirical distributions. In our setting, clients' distributions represent particular domains, and FedDaDiL collectively trains a federated dic…
▽ More
In this article, we propose an approach for federated domain adaptation, a setting where distributional shift exists among clients and some have unlabeled data. The proposed framework, FedDaDiL, tackles the resulting challenge through dictionary learning of empirical distributions. In our setting, clients' distributions represent particular domains, and FedDaDiL collectively trains a federated dictionary of empirical distributions. In particular, we build upon the Dataset Dictionary Learning framework by designing collaborative communication protocols and aggregation operations. The chosen protocols keep clients' data private, thus enhancing overall privacy compared to its centralized counterpart. We empirically demonstrate that our approach successfully generates labeled data on the target domain with extensive experiments on (i) Caltech-Office, (ii) TEP, and (iii) CWRU benchmarks. Furthermore, we compare our method to its centralized counterpart and other benchmarks in federated domain adaptation.
△ Less
Submitted 8 November, 2023; v1 submitted 14 September, 2023;
originally announced September 2023.
-
Federated learning with incremental clustering for heterogeneous data
Authors:
Fabiola Espinoza Castellon,
Aurelien Mayoue,
Jacques-Henri Sublemontier,
Cedric Gouy-Pailler
Abstract:
Federated learning enables different parties to collaboratively build a global model under the orchestration of a server while kee** the training data on clients' devices. However, performance is affected when clients have heterogeneous data. To cope with this problem, we assume that despite data heterogeneity, there are groups of clients who have similar data distributions that can be clustered…
▽ More
Federated learning enables different parties to collaboratively build a global model under the orchestration of a server while kee** the training data on clients' devices. However, performance is affected when clients have heterogeneous data. To cope with this problem, we assume that despite data heterogeneity, there are groups of clients who have similar data distributions that can be clustered. In previous approaches, in order to cluster clients the server requires clients to send their parameters simultaneously. However, this can be problematic in a context where there is a significant number of participants that may have limited availability. To prevent such a bottleneck, we propose FLIC (Federated Learning with Incremental Clustering), in which the server exploits the updates sent by clients during federated training instead of asking them to send their parameters simultaneously. Hence no additional communications between the server and the clients are necessary other than what classical federated learning requires. We empirically demonstrate for various non-IID cases that our approach successfully splits clients into groups following the same data distributions. We also identify the limitations of FLIC by studying its capability to partition clients at the early stages of the federated learning process efficiently. We further address attacks on models as a form of data heterogeneity and empirically show that FLIC is a robust defense against poisoning attacks even when the proportion of malicious clients is higher than 50\%.
△ Less
Submitted 17 June, 2022;
originally announced June 2022.
