Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Coordinate-Descent Diffusion Learning by Networked Agents
 
research article

Coordinate-Descent Diffusion Learning by Networked Agents

Wang, Chengcheng
•
Zhang, Yonggang
•
Ying, Bicheng
Show more
2018
IEEE Transactions on Signal Processing

This paper examines the mean-square error performance of diffusion stochastic algorithms under a generalized coordinate-descent scheme. In this setting, the adaptation step by each agent is limited to a random subset of the coordinates of its stochastic gradient vector. The selection of coordinates varies randomly from iteration to iteration and from agent to agent across the network. Such schemes are useful in reducing computational complexity at each iteration in power-intensive large data applications. They are also useful in modeling situations where some partial gradient information may be missing at random. Interestingly, the results show that the steady-state performance of the learning strategy is not always degraded, while the convergence rate suffers some degradation. The results provide yet another indication of the resilience and robustness of adaptive distributed strategies.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TSP.2017.2757903
Web of Science ID

WOS:000418854700006

ArXiv ID

1607.01838

Author(s)
Wang, Chengcheng
Zhang, Yonggang
Ying, Bicheng
Sayed, Ali H.  
Date Issued

2018

Publisher

Ieee-Inst Electrical Electronics Engineers Inc

Published in
IEEE Transactions on Signal Processing
Volume

66

Issue

2

Start page

352

End page

367

Subjects

Coordinate descent

•

stochastic partial update

•

computational complexity

•

diffusion strategies

•

stochastic gradient algorithms

•

strongly-convex cost

Editorial or Peer reviewed

REVIEWED

Written at

OTHER

EPFL units
ASL  
Available on Infoscience
December 19, 2017
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/143424
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés