Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. EPFL thesis
  4. Stress, individual differences, and norepinephrine in reinforcement learning-based prediction of mouse behavior in conditioning and spatial learning
 
doctoral thesis

Stress, individual differences, and norepinephrine in reinforcement learning-based prediction of mouse behavior in conditioning and spatial learning

Luksys, Gediminas  
•
Sandi, Carmen  
2009

Acute stress regulates different aspects of behavioral learning through the action of stress hormones and neuromodulators. Stress effects depend on stressor's type, intensity, timing, and the learning paradigm. In addition, genetic background of animals might be an important factor in determining how stress influences their performance. To study these effects I performed conditioning and spatial learning experiments, exposing 2 different genetic strains of mice (C57BL/6 and DBA/2) to a variety of different stressors such as elevated platform, uncertainty in food delivery or in escape platform location, food deprivation, and low water temperature. I first show that these factors have diverse effects on animal behavior in these tasks, often exhibiting nonlinear inter-factor relationships. Mouse behavior in such tasks can be formalized and studied using reinforcement learning (RL) models. In this framework, the effects of stress and genetic background on learning and memory could be attributed to differential dynamics of model meta-parameters (such as learning rate, balance between exploitation and exploration, and future reward discounting), which are thought to be related to the activity of different brain systems, particularly the neuromodulators. In both conditioning and spatial learning experiments, RL models were shown to be flexible enough to reproduce differences in learning and performance that are present between different experimental groups. In order to consider how the combination of modulatory factors such as stress, genetic strain, motivation, anxiety, and manipulations of norepinephrine levels affect animal behavior, I developed a black-box model, which can be trained to use these modulatory factors for determining the suitable meta-parameters of the RL model. Such RL model can successfully predict individual animal behavior in the hole-box conditioning task, given the information about current modulatory factors and animal's previous task performance. In order to study neurobiological correlates, I also performed pharmacological manipulations of adrenergic alpha-2 receptors. Results from these manipulations provide computational insights into how norepinephrine affects performance accuracy and future reward discounting to produce the inverted-U-shape relation between norepinephrine levels and behavioral performance. Such approach makes it possible to understand how genetic strain, acute stress, motivation, uncertainty, and norepinephrine affect learning intensity, performance accuracy, and future reward discounting.

  • Files
  • Details
  • Metrics
Loading...
Thumbnail Image
Name

EPFL_TH4278.pdf

Access type

restricted

Size

2.76 MB

Format

Adobe PDF

Checksum (MD5)

e3515e933911b2d3a881d14cc0ea33cd

Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés