Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Evolving Neuromodulatory Topologies for Reinforcement Learning-like Problems
 
conference paper

Evolving Neuromodulatory Topologies for Reinforcement Learning-like Problems

Soltoggio, Andrea
•
Dürr, Peter  
•
Mattiussi, Claudio  
Show more
2007
Proceedings of the 2007 IEEE Congress on Evolutionary Computation
IEEE Congress on Evolutionary Computation (CEC 2007) 25-28 Sept. 2007

Environments with varying reward contingencies constitute a challenge to many living creatures. In such conditions, animals capable of adaptation and learning derive an advantage. Recent studies suggest that neuromodulatory dynamics are a key factor in regulating learning and adaptivity when reward conditions are subject to variability. In biological neural networks, specific circuits generate modulatory signals, particularly in situations that involve learning cues such as a reward or novel stimuli. Modulatory signals are then broadcast and applied onto target synapses to activate or regulate synaptic plasticity. Artificial neural models that include modulatory dynamics could prove their potential in uncertain environments when online learning is required. However, a topology that synthesises and delivers modulatory signals to target synapses must be devised. So far, only handcrafted architectures of such kind have been attempted. Here we show that modulatory topologies can be designed autonomously by artificial evolution and achieve superior learning capabilities than traditional fixed-weight or Hebbian networks. In our experiments, we show that simulated bees autonomously evolved a modulatory network to maximise the reward in a reinforcement learning-like environment.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

SoltoggioDuerrMattiussiFloreano2007.pdf

Access type

openaccess

Size

273.12 KB

Format

Adobe PDF

Checksum (MD5)

3c45b7228a81c199d5ca6278ac3b9142

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés