Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Exponentially long orbits in Hopfield neural networks
 
research article

Exponentially long orbits in Hopfield neural networks

Muscinelli, Samuel Pavio  
•
Gerstner, Wulfram  
•
Brea, Johanni Michael  
2017
Neural Computation

We show that Hopfield neural networks with synchronous dynamics and asymmetric weights admit stable orbits that form sequences of maximal length. For N units, these sequences have length T = 2^N; that is, they cover the full state space. We present a mathematical proof that maximal length orbits exist for all N, and we provide a method to construct both the sequence and the weight matrix that allow its production. The orbit is relatively robust to dynamical noise, and perturbations of the optimal weights reveal other periodic orbits that are not maximal but typically still very long. We discuss how the resulting dynamics on slow timescales can be used to generate desired output sequences.

  • Details
  • Metrics
Type
research article
DOI
10.1162/NECO_a_00919
Web of Science ID

WOS:000394439100007

Author(s)
Muscinelli, Samuel Pavio  
Gerstner, Wulfram  
Brea, Johanni Michael  
Date Issued

2017

Publisher

Massachusetts Institute of Technology Press

Published in
Neural Computation
Volume

29

Issue

2

Start page

458

End page

484

Subjects

Hopfield networks

•

Sequence learning

•

Recurrent neural networks

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LCN  
Available on Infoscience
March 20, 2017
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/135588
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés