Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Journal articles
  4. Noise facilitation in associative memories of exponential capacity
 
research article

Noise facilitation in associative memories of exponential capacity

Karbasi, Amin  
•
Salavati, Amir Hesam  
•
Varshney, Lav R.
Show more
2014
Journal of Neural Computation

Recent advances in associative memory design through structured pattern sets and graph-based inference al- gorithms have allowed reliable learning and recall of an exponential number of patterns. Although these designs correct external errors in recall, they assume neurons that compute noiselessly, in contrast to the highly variable neurons in brain regions thought to operate associatively such as hippocampus and olfactory cortex. Here we consider associative memories with noisy internal computations and analytically characterize performance. As long as the internal noise level is below a specified threshold, the error probability in the recall phase can be made exceedingly small. More surprisingly, we show that internal noise actually improves the performance of the recall phase while the pattern retrieval capacity remains intact, i.e., the number of stored patterns does not reduce with noise (up to a threshold). Computational experiments lend additional support to our theoretical analysis. This work suggests a functional benefit to noisy neurons in biological neuronal networks.

  • Files
  • Details
  • Metrics
Type
research article
DOI
10.1162/NECO_a_00655
Web of Science ID

WOS:000343186700006

Author(s)
Karbasi, Amin  
Salavati, Amir Hesam  
Varshney, Lav R.
Shokrollahi, Amin  
Date Issued

2014

Publisher

Mit Press

Published in
Journal of Neural Computation
Volume

26

Issue

11

Start page

2493

End page

2526

Subjects

Neural Associative memory

•

Internal noise

•

Density evolution technique

•

Circuit noise

•

algoweb_bio

Note

The simulation code for this paper is available at the https://github.com/saloot/NeuralAssociativeMemory/tree/master/Codes Used in Papers/Noise-enhanced associative memories (NIPS 2013)

URL

URL

https://github.com/saloot/NeuralAssociativeMemory/tree/master/Codes%20Used%20in%20Papers/Noise-enhanced%20associative%20memories%20(NIPS%202013)
Editorial or Peer reviewed

NON-REVIEWED

Written at

EPFL

EPFL units
ALGO  
LCAV  
LTHC  
Available on Infoscience
June 9, 2014
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/104075
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés