Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Finite Bit Quantization For Decentralized Learning Under Subspace Constraints
 
conference paper

Finite Bit Quantization For Decentralized Learning Under Subspace Constraints

Nassif, Roula  
•
Vlaski, Stefan  
•
Antonini, Marc
Show more
January 1, 2022
2022 30Th European Signal Processing Conference (Eusipco 2022)
30th European Signal Processing Conference (EUSIPCO)

In this paper, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This constrained formulation includes consensus optimization as special case, and allows for more general task relatedness models such as multitask smoothness and coupled optimization. In order to cope with communication constraints, we propose and study a quantized differential based approach where the communicated estimates among agents are quantized. The analysis shows that, under some general conditions on the quantization noise, and for sufficiently small step-sizes mu, the strategy is stable in the mean-square error sense. The analysis also reveals the influence of the gradient and quantization noises on the performance.

  • Details
  • Metrics
Type
conference paper
DOI
10.23919/EUSIPCO55093.2022.9909791
Web of Science ID

WOS:000918827600363

Author(s)
Nassif, Roula  
Vlaski, Stefan  
Antonini, Marc
Carpentiero, Marco
Matta, Vincenzo
Sayed, Ali H.  
Date Issued

2022-01-01

Publisher

IEEE

Publisher place

New York

Published in
2022 30Th European Signal Processing Conference (Eusipco 2022)
ISBN of the book

978-90-827970-9-1

Series title/Series vol.

European Signal Processing Conference

Start page

1851

End page

1855

Subjects

Acoustics

•

Computer Science, Software Engineering

•

Engineering, Electrical & Electronic

•

Imaging Science & Photographic Technology

•

Telecommunications

•

Computer Science

•

Engineering

•

decentralized stochastic optimization

•

subspace projection

•

quantization effects

•

distributed subgradient methods

•

adaptation

•

networks

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
ASL  
Event nameEvent placeEvent date
30th European Signal Processing Conference (EUSIPCO)

Belgrade, SERBIA

Aug 29-Sep 02, 2022

Available on Infoscience
February 27, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/195252
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés