Fast Dual Variational Inference for Non-Conjugate Latent Gaussian Models

Latent Gaussian models (LGMs) are widely used in statistics and machine learning. Bayesian inference in non-conjugate LGMs is difficult due to intractable integrals in- volving the Gaussian prior and non-conjugate likelihoods. Algorithms based on variational Gaussian (VG) approximations are widely employed since they strike a favorable bal- ance between accuracy, generality, speed, and ease of use. However, the structure of the optimization problems associated with these approximations remains poorly understood, and standard solvers take too long to con- verge. We derive a novel dual variational in- ference approach that exploits the convexity property of the VG approximations. We ob- tain an algorithm that solves a convex op- timization problem, reduces the number of variational parameters, and converges much faster than previous methods. Using real- world data, we demonstrate these advantages on a variety of LGMs, including Gaussian process classification, and latent Gaussian Markov random fields.

Published in:
Proceedings of the 30th International Conference on Machine Learning
Presented at:
30th International Conference on Machine Learning, Atlanta, Georgia, June 16-21, 2013
Omni Press

 Record created 2013-05-31, last modified 2018-03-17

Download fulltext

Rate this document:

Rate this document:
(Not yet reviewed)