Stress, noradrenaline, and realistic prediction of mouse behaviour using reinforcement learning

Suppose we train an animal in a conditioning experiment. Can one predict how a given animal, under given experimental conditions, would perform the task? Since various factors such as stress, motivation, genetic background, and previous errors in task performance can influence animal behavior, this appears to be a very challenging aim. Reinforcement learning (RL) models have been successful in modeling animal (and human) behavior, but their success has been limited because of uncertainty as to how to set meta-parameters (such as learning rate, exploitation-exploration balance and future reward discount factor) that strongly influence model performance. We show that a simple RL model whose meta- parameters are controlled by an artificial neural network, fed with inputs such as stress, affective phenotype, previous task performance, and even neuromodulatory manipulations, can successfully predict mouse behavior in the "hole-box" - a simple conditioning task. Our results also provide important insights on how stress and anxiety affect animal learning, performance accuracy, and discounting of future rewards, and on how noradrenergic systems can interact with these processes


Published in:
Advances in Neural Information Processing Systems (NIPS) 21, 21, 1001-8
Presented at:
22nd Annual Conference on Neural Information Processing Systems (NIPS), Vancouver, British Columbia, Canada, 8-10 December 2008
Year:
2009
Publisher:
Curran Associates, Inc.
Laboratories:




 Record created 2009-09-30, last modified 2018-03-17


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)