Abstract
The Alternating Directions Methods of Multipliers (ADMM) has witnessed a resurgence of interest over the past few years fueled by the ever increasing demand for scalable optimization techniques to tackle real-world statistical learning problems. However, despite its success in several application settings the applicability of the traditional centralized ADMM is limited by its communication requirement to a global fusion center, which might not be always feasible. Its decentralized variant D-CADMM, on the other hand, while it alleviates this need, it does so at the expense of significantly slower convergence in cases of adverse underlying network topologies. To address the aforementioned limitations, in this work we consider the presence of multiple fusion centers and we propose a unifying framework that allows leveraging the structure of the communication network to accelerate the decentralized ADMM even in cases where it is not practical to resort to its fully centralized counterpart. We prove the linear convergence rate of the proposed approach and we verify its promising performance by carrying out numerical tests on both real and synthetic networks.
Original language | English (US) |
---|---|
Title of host publication | 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Proceedings |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 3829-3833 |
Number of pages | 5 |
Volume | 2018-April |
ISBN (Print) | 9781538646588 |
DOIs | |
State | Published - Sep 10 2018 |
Event | 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 - Calgary, Canada Duration: Apr 15 2018 → Apr 20 2018 |
Publication series
Name | ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings |
---|---|
Volume | 2018-April |
ISSN (Print) | 1520-6149 |
Other
Other | 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2018 |
---|---|
Country/Territory | Canada |
City | Calgary |
Period | 4/15/18 → 4/20/18 |
Bibliographical note
Publisher Copyright:© 2018 IEEE.
Keywords
- Distributed optimization
- ADMM algorithm
- Decentralized Learning
- Consensus algorithm
- multi-agent networks