Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. RG-Flow: a hierarchical and explainable flow model based on renormalization group and sparse prior
 
Loading...
Thumbnail Image
research article

RG-Flow: a hierarchical and explainable flow model based on renormalization group and sparse prior

Hu, Hong-Ye
•
Wu, Dian  
•
You, Yi-Zhuang
Show more
September 1, 2022
Machine Learning-Science And Technology

Flow-based generative models have become an important class of unsupervised learning approaches. In this work, we incorporate the key ideas of renormalization group (RG) and sparse prior distribution to design a hierarchical flow-based generative model, RG-Flow, which can separate information at different scales of images and extract disentangled representations at each scale. We demonstrate our method on synthetic multi-scale image datasets and the CelebA dataset, showing that the disentangled representations enable semantic manipulation and style mixing of the images at different scales. To visualize the latent representations, we introduce receptive fields for flow-based models and show that the receptive fields of RG-Flow are similar to those of convolutional neural networks. In addition, we replace the widely adopted isotropic Gaussian prior distribution by the sparse Laplacian distribution to further enhance the disentanglement of representations. From a theoretical perspective, our proposed method has O(log L) complexity for inpainting of an image with edge length L, compared to previous generative models with O(L-2) complexity.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1088/2632-2153/ac8393
Web of Science ID

WOS:000835786600001

Author(s)
Hu, Hong-Ye
•
Wu, Dian  
•
You, Yi-Zhuang
•
Olshausen, Bruno
•
Chen, Yubei
Date Issued

2022-09-01

Publisher

IOP Publishing Ltd

Published in
Machine Learning-Science And Technology
Volume

3

Issue

3

Article Number

035009

Subjects

Computer Science, Artificial Intelligence

•

Computer Science, Interdisciplinary Applications

•

Multidisciplinary Sciences

•

Computer Science

•

Science & Technology - Other Topics

•

renormalization group

•

normalizing flows

•

hierarchical model

•

sparse prior

•

unsupervised representation disentanglement

Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
CQSL  
Available on Infoscience
August 15, 2022
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/190040
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés