Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Stress, noradrenaline, and realistic prediction of mouse behaviour using reinforcement learning
 
conference paper

Stress, noradrenaline, and realistic prediction of mouse behaviour using reinforcement learning

Luksys, Gediminas
•
Sandi, Carmen  
•
Gerstner, Wulfram
Show more
2009
Advances in Neural Information Processing Systems (NIPS) 21
22nd Annual Conference on Neural Information Processing Systems (NIPS)

Suppose we train an animal in a conditioning experiment. Can one predict how a given animal, under given experimental conditions, would perform the task? Since various factors such as stress, motivation, genetic background, and previous errors in task performance can influence animal behavior, this appears to be a very challenging aim. Reinforcement learning (RL) models have been successful in modeling animal (and human) behavior, but their success has been limited because of uncertainty as to how to set meta-parameters (such as learning rate, exploitation-exploration balance and future reward discount factor) that strongly influence model performance. We show that a simple RL model whose meta- parameters are controlled by an artificial neural network, fed with inputs such as stress, affective phenotype, previous task performance, and even neuromodulatory manipulations, can successfully predict mouse behavior in the "hole-box" - a simple conditioning task. Our results also provide important insights on how stress and anxiety affect animal learning, performance accuracy, and discounting of future rewards, and on how noradrenergic systems can interact with these processes

  • Details
  • Metrics
Type
conference paper
Author(s)
Luksys, Gediminas
Sandi, Carmen  
Gerstner, Wulfram
Koller, D.
Date Issued

2009

Publisher

Curran Associates, Inc.

Published in
Advances in Neural Information Processing Systems (NIPS) 21
Series title/Series vol.

Advances in Neural Information Processing Systems; 21

Volume

21

Start page

1001

End page

8

Editorial or Peer reviewed

REVIEWED

Written at

EPFL

EPFL units
LGC  
Event nameEvent placeEvent date
22nd Annual Conference on Neural Information Processing Systems (NIPS)

Vancouver, British Columbia, Canada

8-10 December 2008

Available on Infoscience
September 30, 2009
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/42980
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés