Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. High-dimensional Asymptotics of Denoising Autoencoders
 
conference paper

High-dimensional Asymptotics of Denoising Autoencoders

Cui, Hugo Chao  
•
Zdeborová, Lenka  
December 11, 2023
Advances in Neural Information Processing Systems 36 (NeurIPS 2023)

We address the problem of denoising data from a Gaussian mixture using a twolayer non-linear autoencoder with tied weights and a skip connection. We consider the high-dimensional limit where the number of training samples and the input dimension jointly tend to infinity while the number of hidden units remains bounded. We provide closed-form expressions for the denoising mean-squared test error. Building on this result, we quantitatively characterize the advantage of the considered architecture over the autoencoder without the skip connection that relates closely to principal component analysis. We further show that our results accurately capture the learning curves on a range of real data sets.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

NeurIPS-2023-high-dimensional-asymptotics-of-denoising-autoencoders-Paper-Conference.pdf

Type

Supplementary Material/information

Version

Not Applicable (or Unknown)

Access type

openaccess

License Condition

N/A

Size

786.82 KB

Format

Adobe PDF

Checksum (MD5)

9114628bc4a3d48f76b729106d027322

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés