Fantastyc: Blockchain-based Federated Learning Made Secure and Practical
Authors:
William Boitier,
Antonella Del Pozzo,
Álvaro García-Pérez,
Stephane Gazut,
Pierre Jobic,
Alexis Lemaire,
Erwan Mahe,
Aurelien Mayoue,
Maxence Perion,
Deepika Singh,
Tuanir Franca Rezende,
Sara Tucci-Piergiovanni
Abstract:
Federated Learning is a decentralized framework that enables multiple clients to collaboratively train a machine learning model under the orchestration of a central server without sharing their local data. The centrality of this framework represents a point of failure which is addressed in literature by blockchain-based federated learning approaches. While ensuring a fully-decentralized solution w…
▽ More
Federated Learning is a decentralized framework that enables multiple clients to collaboratively train a machine learning model under the orchestration of a central server without sharing their local data. The centrality of this framework represents a point of failure which is addressed in literature by blockchain-based federated learning approaches. While ensuring a fully-decentralized solution with traceability, such approaches still face several challenges about integrity, confidentiality and scalability to be practically deployed. In this paper, we propose Fantastyc, a solution designed to address these challenges that have been never met together in the state of the art.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
Federated Learning with Nonvacuous Generalisation Bounds
Authors:
Pierre Jobic,
Maxime Haddouche,
Benjamin Guedj
Abstract:
We introduce a novel strategy to train randomised predictors in federated learning, where each node of the network aims at preserving its privacy by releasing a local predictor but kee** secret its training dataset with respect to the other nodes. We then build a global randomised predictor which inherits the properties of the local private predictors in the sense of a PAC-Bayesian generalisatio…
▽ More
We introduce a novel strategy to train randomised predictors in federated learning, where each node of the network aims at preserving its privacy by releasing a local predictor but kee** secret its training dataset with respect to the other nodes. We then build a global randomised predictor which inherits the properties of the local private predictors in the sense of a PAC-Bayesian generalisation bound. We consider the synchronous case where all nodes share the same training objective (derived from a generalisation bound), and the asynchronous case where each node may have its own personalised training objective. We show through a series of numerical experiments that our approach achieves a comparable predictive performance to that of the batch approach where all datasets are shared across nodes. Moreover the predictors are supported by numerically nonvacuous generalisation bounds while preserving privacy for each node. We explicitly compute the increment on predictive performance and generalisation bounds between batch and federated settings, highlighting the price to pay to preserve privacy.
△ Less
Submitted 17 October, 2023;
originally announced October 2023.
