Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Subspace clustering in high-dimensions: Phase transitions & Statistical-to-Computational gap
 
conference paper not in proceedings

Subspace clustering in high-dimensions: Phase transitions & Statistical-to-Computational gap

Pesce, Luca  
•
Loureiro, Bruno  
•
Krzakala, Florent  
Show more
2022
36th Conference on Neural Information Processing Systems (NeurIPS 2022)

A simple model to study subspace clustering is the high-dimensional k -Gaussian mixture model where the cluster means are sparse vectors. Here we provide an exact asymptotic characterization of the statistically optimal reconstruction error in this model in the high-dimensional regime with extensive sparsity, i.e. when the fraction of non-zero components of the cluster means ⇢ , as well as the ratio ↵ between the number of samples and the dimension are fixed, while the dimension diverges. We identify the information-theoretic threshold below which obtaining a positive correlation with the true cluster means is statistically impossible. Additionally, we investigate the performance of the approximate message passing (AMP) algorithm analyzed via its state evolution, which is conjectured to be optimal among polynomial algorithm for this task. We identify in particular the existence of a statistical-to-computational gap between the algorithm that requires a signal-to-noise ratio alg k/p↵ to perform better than random, and the information theoretic threshold at it ⇡ pk⇢ log ⇢/p↵ . Finally, we discuss the case of sub-extensive sparsity ⇢ by comparing the performance of the AMP with other sparsity-enhancing algorithms, such as sparse-PCA and diagonal thresholding.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

NeurIPS-2022-subspace-clustering-in-high-dimensions-phase-transitions-statistical-to-computational-gap-Paper-Conference.pdf

Type

N/a

Access type

openaccess

License Condition

n/a

Size

715.28 KB

Format

Adobe PDF

Checksum (MD5)

afda1d2c24bc892e99825ebca1671fc6

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés