Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Random extrapolation for primal-dual coordinate descent
 
conference paper

Random extrapolation for primal-dual coordinate descent

Alacaoglu, Ahmet  
•
Fercoq, Olivier
•
Cevher, Volkan  orcid-logo
2020
Proceedings of the 37th International Conference on Machine Learning (ICML)
37th International Conference on Machine Learning (ICML 2020)

We introduce a randomly extrapolated primal-dual coordinate descent method that adapts to sparsity of the data matrix and the favorable structures of the objective function. Our method updates only a subset of primal and dual variables with sparse data, and it uses large step sizes with dense data, retaining the benefits of the specific methods designed for each case. In addition to adapting to sparsity, our method attains fast convergence guarantees in favorable cases \textit{without any modifications}. In particular, we prove linear convergence under metric subregularity, which applies to strongly convex-strongly concave problems, linear programs and piecewise linear quadratic functions. We show almost sure convergence of the sequence and optimal sublinear convergence rates for the primal-dual gap and objective values, in the general convex-concave case. Numerical evidence demonstrates the state-of-the-art empirical performance of our method in sparse and dense settings, matching and improving the existing methods.

  • Files
  • Details
  • Metrics
Type
conference paper
Web of Science ID

WOS:000683178500019

Author(s)
Alacaoglu, Ahmet  
Fercoq, Olivier
Cevher, Volkan  orcid-logo
Date Issued

2020

Publisher

JMLR-JOURNAL MACHINE LEARNING RESEARCH

Publisher place

San Diego

Published in
Proceedings of the 37th International Conference on Machine Learning (ICML)
Series title/Series vol.

Proceedings of Machine Learning Research

Volume

119

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LIONS  
Event nameEvent placeEvent date
37th International Conference on Machine Learning (ICML 2020)

Online

July 13-18, 2020

Available on Infoscience
July 13, 2020
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/170041
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés