Wang, Chengcheng
Zhang, Yonggang
Ying, Bicheng
Sayed, Ali H.
Coordinate-Descent Diffusion Learning by Networked Agents
IEEE Transactions on Signal Processing
IEEE Transactions on Signal Processing
IEEE Transactions on Signal Processing
IEEE Transactions on Signal Processing
16
66
2
Coordinate descent
stochastic partial update
computational complexity
diffusion strategies
stochastic gradient algorithms
strongly-convex cost
2018
2018
This paper examines the mean-square error performance of diffusion stochastic algorithms under a generalized coordinate-descent scheme. In this setting, the adaptation step by each agent is limited to a random subset of the coordinates of its stochastic gradient vector. The selection of coordinates varies randomly from iteration to iteration and from agent to agent across the network. Such schemes are useful in reducing computational complexity at each iteration in power-intensive large data applications. They are also useful in modeling situations where some partial gradient information may be missing at random. Interestingly, the results show that the steady-state performance of the learning strategy is not always degraded, while the convergence rate suffers some degradation. The results provide yet another indication of the resilience and robustness of adaptive distributed strategies.
Ieee-Inst Electrical Electronics Engineers Inc
1941-0476
IEEE Transactions on Signal Processing
Journal Articles
10.1109/TSP.2017.2757903