Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Parallel retrieval of correlated patterns: From Hopfield networks to Boltzmann machines
 
research article

Parallel retrieval of correlated patterns: From Hopfield networks to Boltzmann machines

Agliari, Elena
•
Barra, Adriano
•
De Antoni, Andrea  
Show more
2013
Neural Networks

In this work, we first revise some extensions of the standard Hopfield model in the low storage limit, namely the correlated attractor case and the multitasking case recently introduced by the authors. The former case is based on a modification of the Hebbian prescription, which induces a coupling between consecutive patterns and this effect is tuned by a parameter a. In the latter case, dilution is introduced in pattern entries, in such a way that a fraction d of them is blank. Then, we merge these two extensions to obtain a system able to retrieve several patterns in parallel and the quality of retrieval, encoded by the set of Mattis magnetizations {m(mu)}, is reminiscent of the correlation among patterns. By tuning the parameters d and a, qualitatively different outputs emerge, ranging from highly hierarchical to symmetric. The investigations are accomplished by means of both numerical simulations and statistical mechanics analysis, properly adapting a novel technique originally developed for spin glasses, i.e. the Hamilton-Jacobi interpolation, with excellent agreement. Finally, we show the thermodynamical equivalence of this associative network with a (restricted) Boltzmann machine and study its stochastic dynamics to obtain even a dynamical picture, perfectly consistent with the static scenario earlier discussed. (c) 2012 Elsevier Ltd. All rights reserved.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1016/j.neunet.2012.11.010
Web of Science ID

WOS:000314388600005

Author(s)
Agliari, Elena
Barra, Adriano
De Antoni, Andrea  
Galluzzi, Andrea
Date Issued

2013

Publisher

Elsevier

Published in
Neural Networks
Volume

38

Start page

52

End page

63

Subjects

Neural networks

•

Boltzmann machines

•

Pattern retrieval

•

Multitasking networks

•

Correlated patterns

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LCN  
Available on Infoscience
March 28, 2013
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/90832
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés