Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Inference for Generalized Linear Models via Alternating Directions and Bethe Free Energy Minimization
 
research article

Inference for Generalized Linear Models via Alternating Directions and Bethe Free Energy Minimization

Rangan, S.
•
Fletcher, A.K.
•
Schniter, P.
Show more
2017
IEEE Transactions on Information Theory

Generalized linear models, where a random vector x is observed through a noisy, possibly nonlinear, function of a linear transform z = A x, arise in a range of applications in nonlinear filtering and regression. Approximate message passing (AMP) methods, based on loopy belief propagation, are a promising class of approaches for approximate inference in these models. AMP methods are computationally simple, general, and admit precise analyses with testable conditions for optimality for large i.i.d. transforms A. However, the algorithms can diverge for general A. This paper presents a convergent approach to the generalized AMP (GAMP) algorithm based on direct minimization of a large-system limit approximation of the Bethe free energy (LSL-BFE). The proposed method uses a double-loop procedure, where the outer loop successively linearizes the LSL-BFE and the inner loop minimizes the linearized LSL-BFE using the alternating direction method of multipliers (ADMM). The proposed method, called ADMM-GAMP, is similar in structure to the original GAMP method, but with an additional least-squares minimization. It is shown that for strictly convex, smooth penalties, ADMM-GAMP is guaranteed to converge to a local minimum of the LSL-BFE, thus providing a convergent alternative to GAMP that is stable under arbitrary transforms. Simulations are also presented that demonstrate the robustness of the method for non-convex penalties as well.

  • Details
  • Metrics
Type
research article
DOI
10.1109/TIT.2016.2619373
Web of Science ID

WOS:000391740000039

Author(s)
Rangan, S.
Fletcher, A.K.
Schniter, P.
Kamilov, U.S.
Date Issued

2017

Publisher

IEEE

Published in
IEEE Transactions on Information Theory
Volume

63

Issue

1

Start page

676

End page

697

URL

URL

http://bigwww.epfl.ch/publications/rangan1701.html

URL

http://bigwww.epfl.ch/publications/rangan1701.pdf

URL

http://bigwww.epfl.ch/publications/rangan1701.ps
Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LIB  
Available on Infoscience
March 2, 2017
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/134928
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés