@inproceedings{
allouah2024finetuning,
title={Fine-Tuning Personalization in Federated Learning to Mitigate Adversarial Clients},
author={Youssef Allouah and Abdellah El Mrini and Rachid Guerraoui and Nirupam Gupta and Rafael Pinot},
booktitle={The Thirty-eighth Annual Conference on Neural Information Processing Systems},
year={2024},
url={https://openreview.net/forum?id=WBLPlszJI5}
}
Federated learning (FL) is an appealing paradigm that allows a group of machines
(a.k.a. clients) to learn collectively while keeping their data local. However, due
to the heterogeneity between the clients’ data distributions, the model obtained
through the use of FL algorithms may perform poorly on some client’s data.
Personalization addresses this issue by enabling each client to have a different
model tailored to their own data while simultaneously benefiting from the other
clients’ data. We consider an FL setting where some clients can be adversarial, and
we derive conditions under which full collaboration fails. Specifically, we analyze
the generalization performance of an interpolated personalized FL framework in the
presence of adversarial clients, and we precisely characterize situations when full
collaboration performs strictly worse than fine-tuned personalization. Our analysis
determines how much we should scale down the level of collaboration, according
to data heterogeneity and the tolerable fraction of adversarial clients. We support
our findings with empirical results on mean estimation and binary classification
problems, considering synthetic and benchmark image classification datasets
Fine-Tuning Personalization in Federated Learning to Mitigate Adversarial Clients
Youssef Allouah Abdellah El Mrini Rachid Guerraoui Nirupam Gupta Rafael Pinot