Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Learning Over Multitask Graphs-Part II: Performance Analysis
 
research article

Learning Over Multitask Graphs-Part II: Performance Analysis

Nassif, Roula  
•
Vlaski, Stefan  
•
Richard, Cedric
Show more
January 1, 2020
Ieee Open Journal Of Signal Processing

Part I of this paper formulated a multitask optimization problem where agents in the network have individual objectives to meet, or individual parameter vectors to estimate, subject to a smoothness condition over the graph. A diffusion strategy was devised that responds to streaming data and employs stochastic approximations in place of actual gradient vectors, which are generally unavailable. The approach relied on minimizing a global cost consisting of the aggregate sum of individual costs regularized by a term that promotes smoothness. We examined the first-order, the second-order, and the fourth-order stability of the multitask learning algorithm. The results identified conditions on the step-size parameter, regularization strength, and data characteristics in order to ensure stability. This Part II examines steady-state performance of the strategy. The results reveal explicitly the influence of the network topology and the regularization strength on the network performance and provide insights into the design of effective multitask strategies for distributed inference over networks.

  • Details
  • Metrics
Type
research article
DOI
10.1109/OJSP.2020.2989031
Web of Science ID

WOS:000722891600005

Author(s)
Nassif, Roula  
Vlaski, Stefan  
Richard, Cedric
Sayed, Ali H.  
Date Issued

2020-01-01

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Published in
Ieee Open Journal Of Signal Processing
Volume

1

Start page

46

End page

63

Subjects

Engineering, Electrical & Electronic

•

Engineering

•

multitask distributed inference

•

diffusion strategy

•

smoothness prior

•

graph laplacian regularization

•

gradient noise

•

steady-state performance

•

networks

•

algorithms

•

behavior

•

lms

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
ASL  
Available on Infoscience
December 18, 2021
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/183897
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés