Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Approximate Steepest Coordinate Descent
 
conference paper

Approximate Steepest Coordinate Descent

Stich, Sebastian Urban  
•
Raj, Anant
•
Jaggi, Martin  
2017
ICML 2017 - Proceedings of the 34rd International Conference on Machine Learning
ICML 2017 - International Conference on Machine Learning

We propose a new selection rule for the coordinate selection in coordinate descent methods for huge-scale optimization. The efficiency of this novel scheme is provably better than the efficiency of uniformly random selection, and can reach the efficiency of steepest coordinate descent (SCD), enabling an acceleration of a factor of up to $n$, the number of coordinates. In many practical applications, our scheme can be implemented at no extra cost and computational efficiency very close to the faster uniform selection. Numerical experiments with Lasso and Ridge regression show promising improvements, in line with our theoretical guarantees.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

stich17a-supp.pdf

Type

Publisher's Version

Version

Published version

Access type

openaccess

License Condition

CC BY

Size

1.5 MB

Format

Adobe PDF

Checksum (MD5)

c9d597bfe6c77ce43c5c703e1f9e351b

Loading...
Thumbnail Image
Name

1706.08427.pdf

Access type

openaccess

License Condition

CC BY

Size

1.53 MB

Format

Adobe PDF

Checksum (MD5)

c7e66a7df79754752d05cdd651b8de93

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés