Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Exploiting the Signal-Leak Bias in Diffusion Models
 
conference paper not in proceedings

Exploiting the Signal-Leak Bias in Diffusion Models

Everaert, Martin Nicolas  
•
Fitsios, Athanasios  
•
Bocchio, Marco
Show more
January 2024
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2024)

There is a bias in the inference pipeline of most diffusion models. This bias arises from a signal leak whose distribution deviates from the noise distribution, creating a discrepancy between training and inference processes. We demonstrate that this signal-leak bias is particularly significant when models are tuned to a specific style, causing sub-optimal style matching. Recent research tries to avoid the signal leakage during training. We instead show how we can exploit this signal-leak bias in existing diffusion models to allow more control over the generated images. This enables us to generate images with more varied brightness, and images that better match a desired style or color. By modeling the distribution of the signal leak in the spatial frequency and pixel domains, and including a signal leak in the initial latent, we generate images that better match expected results without any additional training.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

2309.15842.pdf

Type

Preprint

Version

http://purl.org/coar/version/c_71e4c1898caa6e32

Access type

openaccess

License Condition

n/a

Size

3.13 MB

Format

Adobe PDF

Checksum (MD5)

80194b282b4e7da694e1457f2b1022bb

Loading...
Thumbnail Image
Name

supplementary.pdf

Type

Preprint

Version

http://purl.org/coar/version/c_71e4c1898caa6e32

Access type

openaccess

License Condition

n/a

Size

17.46 MB

Format

Adobe PDF

Checksum (MD5)

a8b0d4d4257bf19f19218261ecc45af1

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés