Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Analysis of Diffusion Models for Manifold Data
 
conference paper

Analysis of Diffusion Models for Manifold Data

George, Anand Jerry  
•
Veiga, Rodrigo  
•
Macris, Nicolas  
June 22, 2025
2025 IEEE International Symposium on Information Theory (ISIT)
2025 IEEE International Symposium on Information Theory

We analyze the time reversed dynamics of generative diffusion models. If the exact empirical score function is used in a regime of large dimension and exponentially large number of samples, these models are known to undergo transitions between distinct dynamical regimes. We extend this analysis and compute the transitions for an analytically tractable manifold model where the statistical model for the data is a mixture of lower dimensional Gaussians embedded in higher dimensional space. We compute the so-called speciation and collapse transition times, as a function of the ratio of manifold-to-ambient space dimensions, and other characteristics of the data model. An important tool used in our analysis is the exact formula for the mutual information (or free energy) of Generalized Linear Models.

  • Details
  • Metrics
Type
conference paper
DOI
10.1109/isit63088.2025.11195641
Author(s)
George, Anand Jerry  

École Polytechnique Fédérale de Lausanne

Veiga, Rodrigo  

École Polytechnique Fédérale de Lausanne

Macris, Nicolas  

École Polytechnique Fédérale de Lausanne

Date Issued

2025-06-22

Publisher

IEEE

Published in
2025 IEEE International Symposium on Information Theory (ISIT)
ISBN of the book

979-8-3315-4399-0

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
SMILS  
Event nameEvent acronymEvent placeEvent date
2025 IEEE International Symposium on Information Theory

ISIT 2025

Ann Arbor, MI, USA

2025-06-22 - 2025-06-27

FunderFunding(s)Grant NumberGrant URL

Swiss National Science Foundation

200021204119

Available on Infoscience
October 22, 2025
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/255174
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés