Abstract
We propose SwiftAgg, a novel secure aggregation protocol for federated learning systems, where a central server aggregates local models of N distributed users, each of size L, trained on their local data, in a privacy-preserving manner. Compared with state-of-the-art secure aggregation protocols, SwiftAgg significantly reduces the communication overheads without any compromise on security. Specifically, in presence of at most D dropout users, SwiftAgg achieves a server communication load of (T +1)L and a per-user communication load of up to (T+D+1)L, with a worst-case information-theoretic security guarantee, against any subset of up to T semi-honest users who may also collude with the curious server. The key idea of SwiftAgg is to partition the users into groups of size T+D+1, then in the first phase, secret sharing and aggregation of the individual models are performed within each group, and then in the second phase, model aggregation is performed on T +D+1 sequences of users across the groups. If a user in a sequence drops out in the second phase, the rest of the sequence remains silent. This design allows only a subset of users to communicate with each other, and only the users in a single group to directly communicate with the server, eliminating the requirements of 1) all-to-all communication network across users; and 2) all users communicating with the server, for other secure aggregation protocols. This helps to substantially slash the communication costs of the system.
Original language | English (US) |
---|---|
Title of host publication | 2022 IEEE International Symposium on Information Theory, ISIT 2022 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 103-108 |
Number of pages | 6 |
ISBN (Electronic) | 9781665421591 |
DOIs | |
State | Published - 2022 |
Externally published | Yes |
Event | 2022 IEEE International Symposium on Information Theory, ISIT 2022 - Espoo, Finland Duration: Jun 26 2022 → Jul 1 2022 |
Publication series
Name | IEEE International Symposium on Information Theory - Proceedings |
---|---|
Volume | 2022-June |
ISSN (Print) | 2157-8095 |
Conference
Conference | 2022 IEEE International Symposium on Information Theory, ISIT 2022 |
---|---|
Country/Territory | Finland |
City | Espoo |
Period | 6/26/22 → 7/1/22 |
Bibliographical note
Publisher Copyright:© 2022 IEEE.
Keywords
- Communication-efficient secure aggregation
- Dropout resiliency
- Federated learning
- Secret sharing