Analysis of Learning a Flow-Based Generative Model From Limited Sample Complexity
We study the problem of training a flow-based generative model, parametrized by a two-layer autoencoder, to sample from a high-dimensional Gaussian mixture. We provide a sharp end-to-end analysis of the problem. First, we provide a tight closed-form characterization of the learnt velocity field, when parametrized by a shallow denoising auto-encoder trained on a finite number n of samples from the target distribution. Building on this analysis, we provide a sharp description of the corresponding generative flow, which pushes the base Gaussian density forward to an approximation of the target density. In particular, we provide closed-form formulae for the distance between the means of the generated mixture and the mean of the target mixture, which we show decays as Θ n (1 /n). Finally, this rate is shown to be in fact Bayes-optimal.
Cite this item
Cui, H. C., Krzakala, F., Vanden-Eijnden, E., & Zdeborová, L. (2024, January 16). Analysis of Learning a Flow-Based Generative Model From Limited Sample Complexity. 12th International Conference on Learning Representations (ICLR 2024), Vienna, Austria, May 7, 2024. https://infoscience.epfl.ch/handle/20.500.14299/256263
Click Copy to copy the citation, or select the text manually.
1747_Analysis_of_Learning_a_Fl.pdf
Main Document
Submitted version (Preprint)
openaccess
N/A
884.2 KB
Adobe PDF
c68350b9b64f6833737787c73010963d