Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Error scaling laws for kernel classification under source and capacity conditions
 
research article

Error scaling laws for kernel classification under source and capacity conditions

Cui, Hugo Chao  
•
Loureiro, Bruno  
•
Krzakala, Florent  
Show more
2023
IOPscience

In this manuscript we consider the problem of kernel classification. While worst-case bounds on the decay rate of the prediction error with the number of samples are known for some classifiers, they often fail to accurately describe the learning curves of real data sets. In this work, we consider the important class of data sets satisfying the standard source and capacity conditions, comprising a number of real data sets as we show numerically. Under the Gaussian design, we derive the decay rates for the misclassification (prediction) error as a function of the source and capacity coefficients. We do so for two standard kernel classification settings, namely margin-maximizing support vector machines and ridge classification, and contrast the two methods. We find that our rates tightly describe the learning curves for this class of data sets, and are also observed on real data. Our results can also be seen as an explicit prediction of the exponents of a scaling law for kernel classification that is accurate on some real datasets.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

Cui_2023_Mach._Learn. _Sci._Technol._4_035033.pdf

Type

Publisher

Version

Published version

Access type

openaccess

License Condition

CC BY

Size

1.25 MB

Format

Adobe PDF

Checksum (MD5)

80b3f08a8d0001ed2e879f2597674a3f

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés