Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. On the generalization ability of distributed online learners
 
conference paper

On the generalization ability of distributed online learners

Towfic, Zaid J.
•
Chen, Jianshu
•
Sayed, Ali H.  
2012
IEEE International Workshop on Machine Learning for Signal Processing
International Workshop on Machine Learning for Signal Processing (MLSP)

We propose a fully-distributed stochastic-gradient strategy based on diffusion adaptation techniques. We show that, for strongly convex risk functions, the excess-risk at every node decays at the rate of O(1/Ni), where N is the number of learners and i is the iteration index. In this way, the distributed diffusion strategy, which relies only on local interactions, is able to achieve the same convergence rate as centralized strategies that have access to all data from the nodes at every iteration. We also show that every learner is able to improve its excess-risk in comparison to the non-cooperative mode of operation where each learner would operate independently of the other learners.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/MLSP.2012.6349778
Author(s)
Towfic, Zaid J.
Chen, Jianshu
Sayed, Ali H.  
Date Issued

2012

Publisher

IEEE

Published in
IEEE International Workshop on Machine Learning for Signal Processing
Start page

1

End page

6

Editorial or Peer reviewed

REVIEWED

Written at

OTHER

EPFL units
ASL  
Event nameEvent placeEvent date
International Workshop on Machine Learning for Signal Processing (MLSP)

Santander, Spain

September 23-26, 2012

Available on Infoscience
December 19, 2017
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/143311
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés