TY - JOUR
T1 - Adaptive robust distributed learning in diffusion sensor networks
AU - Chouvardas, Symeon
AU - Slavakis, Konstantinos
AU - Theodoridis, Sergios
PY - 2011/10/1
Y1 - 2011/10/1
N2 - In this paper, the problem of adaptive distributed learning in diffusion networks is considered. The algorithms are developed within the convex set theoretic framework. More specifically, they are based on computationally simple geometric projections onto closed convex sets. The paper suggests a novel combine-project-adapt protocol for cooperation among the nodes of the network; such a protocol fits naturally with the philosophy that underlies the projection-based rationale. Moreover, the possibility that some of the nodes may fail is also considered and it is addressed by employing robust statistics loss functions. Such loss functions can easily be accommodated in the adopted algorithmic framework; all that is required from a loss function is convexity. Under some mild assumptions, the proposed algorithms enjoy monotonicity, asymptotic optimality, asymptotic consensus, strong convergence and linear complexity with respect to the number of unknown parameters. Finally, experiments in the context of the system-identification task verify the validity of the proposed algorithmic schemes, which are compared to other recent algorithms that have been developed for adaptive distributed learning.
AB - In this paper, the problem of adaptive distributed learning in diffusion networks is considered. The algorithms are developed within the convex set theoretic framework. More specifically, they are based on computationally simple geometric projections onto closed convex sets. The paper suggests a novel combine-project-adapt protocol for cooperation among the nodes of the network; such a protocol fits naturally with the philosophy that underlies the projection-based rationale. Moreover, the possibility that some of the nodes may fail is also considered and it is addressed by employing robust statistics loss functions. Such loss functions can easily be accommodated in the adopted algorithmic framework; all that is required from a loss function is convexity. Under some mild assumptions, the proposed algorithms enjoy monotonicity, asymptotic optimality, asymptotic consensus, strong convergence and linear complexity with respect to the number of unknown parameters. Finally, experiments in the context of the system-identification task verify the validity of the proposed algorithmic schemes, which are compared to other recent algorithms that have been developed for adaptive distributed learning.
KW - Adaptive filtering
KW - adaptive projected subgradient method
KW - consensus
KW - diffusion networks
KW - distributed learning
UR - http://www.scopus.com/inward/record.url?scp=80052873979&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=80052873979&partnerID=8YFLogxK
U2 - 10.1109/TSP.2011.2161474
DO - 10.1109/TSP.2011.2161474
M3 - Article
AN - SCOPUS:80052873979
VL - 59
SP - 4692
EP - 4707
JO - IEEE Transactions on Signal Processing
JF - IEEE Transactions on Signal Processing
SN - 1053-587X
IS - 10
M1 - 5948418
ER -