Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Adaptation and Learning Over Networks Under Subspace Constraints-Part I: Stability Analysis
 
research article

Adaptation and Learning Over Networks Under Subspace Constraints-Part I: Stability Analysis

Nassif, Roula  
•
Vlaski, Stefan  
•
Sayed, Ali H.  
January 1, 2020
Ieee Transactions On Signal Processing

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in low-dimensional subspaces. This constrained formulation includes consensus optimization as a special case, and allows for more general task relatedness models such as smoothness. While such formulations can be solved via projected gradient descent, the resulting algorithm is not distributed. Starting from the centralized solution, we propose an iterative and distributed implementation of the projection step, which runs in parallel with the stochastic gradient descent update. We establish in this Part I of the work that, for small step-sizes $\mu$, the proposed distributed adaptive strategy leads to small estimation errors on the order of $\mu$. We examine in the accompanying Part II (R. Nassif, S. Vlaski, and A. H. Sayed, 2019) the steady-state performance. The results will reveal explicitly the influence of the gradient noise, data characteristics, and subspace constraints, on the network performance. The results will also show that in the small step-size regime, the iterates generated by the distributed algorithm achieve the centralized steady-state performance.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TSP.2020.2970336
Web of Science ID

WOS:000526718500007

Author(s)
Nassif, Roula  
Vlaski, Stefan  
Sayed, Ali H.  
Date Issued

2020-01-01

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Published in
Ieee Transactions On Signal Processing
Volume

68

Start page

1346

End page

1360

Subjects

Engineering, Electrical & Electronic

•

Engineering

•

distributed optimization

•

subspace projection

•

gradient noise

•

stability analysis

•

sensor networks

•

algorithms

•

beamformer

•

lms

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
ASL  
Available on Infoscience
May 2, 2020
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/168521
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés