Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. An Efficient Sampling Algorithm for Non-smooth Composite Potentials
 
Loading...
Thumbnail Image
research article

An Efficient Sampling Algorithm for Non-smooth Composite Potentials

Mou, Wenlong
•
Flammarion, Nicolas  
•
Wainwright, Martin J.
Show more
January 1, 2022
Journal Of Machine Learning Research

We consider the problem of sampling from a density of the form p(x) ? exp(-f (x) - g(x)), where f : Rd-+ R is a smooth function and g : R-d-+ R is a convex and Lipschitz function. We propose a new algorithm based on the Metropolis-Hastings framework. Under certain isoperimetric inequalities on the target density, we prove that the algorithm mixes to within total variation (TV) distance e of the target density in at most O(d log(d/e)) iterations. This guarantee extends previous results on sampling from distributions with smooth log densities (g = 0) to the more general composite non-smooth case, with the same mixing time up to a multiple of the condition number. Our method is based on a novel proximal-based proposal distribution that can be efficiently computed for a large class of non-smooth functions g. Simulation results on posterior sampling problems that arise from the Bayesian Lasso show empirical advantage over previous proposal distributions.

  • Details
  • Metrics
Type
research article
Web of Science ID

WOS:001008489800001

Author(s)
Mou, Wenlong
•
Flammarion, Nicolas  
•
Wainwright, Martin J.
•
Bartlett, Peter L.
Date Issued

2022-01-01

Publisher

MICROTOME PUBL

Published in
Journal Of Machine Learning Research
Volume

23

Subjects

Automation & Control Systems

•

Computer Science, Artificial Intelligence

•

Computer Science

•

markov chain monte carlo

•

mixing time

•

metropolis-hastings algorithms

•

langevin diffusion

•

non-smooth functions

•

bayesian inference

•

monte-carlo

•

geometric-convergence

•

hastings

•

inequality

•

ergodicity

•

simulation

•

regression

•

langevin

•

bounds

•

rates

Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
TML  
Available on Infoscience
July 3, 2023
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/198690
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés