Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Online learning and adaptation over networks: More information is not necessarily better
 
conference paper

Online learning and adaptation over networks: More information is not necessarily better

Sayed, Ali H.  
•
Tu, Sheng-Yuan
•
Chen, Jianshu
2013
Information Theory and Applications Workshop (ITA)
Information Theory and Applications Workshop (ITA 2013)

We examine the performance of stochastic-gradient learners over connected networks for global optimization problems involving risk functions that are not necessarily quadratic. We consider two well-studied classes of distributed schemes including consensus strategies and diffusion strategies. We quantify how the mean-square-error and the convergence rate of the network vary with the combination policy and with the fraction of informed agents. Several combination policies are considered including doubly-stochastic rules, the averaging rule, Metropolis rule, and the Hastings rule. It will be seen that the performance of the network does not necessarily improve with a larger proportion of informed agents. A strategy to counter the degradation in performance is presented.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/ITA.2013.6502975
Author(s)
Sayed, Ali H.  
Tu, Sheng-Yuan
Chen, Jianshu
Date Issued

2013

Publisher

IEEE

Published in
Information Theory and Applications Workshop (ITA)
Start page

1

End page

8

Editorial or Peer reviewed

REVIEWED

Written at

OTHER

EPFL units
ASL  
Event nameEvent placeEvent date
Information Theory and Applications Workshop (ITA 2013)

San Diego, CA

February 10-15, 2013

Available on Infoscience
December 19, 2017
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/143314
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés