Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. High-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization
 
conference paper not in proceedings

High-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization

Chen, Yihang
•
Liu, Fanghui  
•
Suzuki, Taiji
Show more
2024
12th International Conference on Learning Representations (ICLR 2024)

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate shifts. By a bias-variance decomposition, we theoretically demonstrate that the re-weighting strategy allows for decreasing the variance. For bias, we analyze the regularization of the arbitrary or well-chosen scale, showing that the bias can behave very differently under different regularization scales. In our analysis, the bias and variance can be characterized by the spectral decay of a data-dependent regularized kernel: the original kernel matrix associated with an additional re-weighting matrix, and thus the re-weighting strategy can be regarded as a data-dependent regularization for better understanding. Besides, our analysis provides asymptotic expansion of kernel functions/vectors under covariate shift, which has its own interest.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

ICLR 2024_high_dimensional_kernel_method.pdf

Type

Postprint

Version

Accepted version

Access type

openaccess

License Condition

copyright

Size

623.58 KB

Format

Adobe PDF

Checksum (MD5)

44b53bd58fbedbfa1e290c8b517a64fe

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés