Repository logo

Infoscience

  • English
  • French
Log In
Logo EPFL, École polytechnique fédérale de Lausanne

Infoscience

  • English
  • French
Log In
  1. Home
  2. Academic and Research Output
  3. Conferences, Workshops, Symposiums, and Seminars
  4. Budgeted Knowledge Transfer for State-wise Heterogeneous RL Agents
 
Loading...
Thumbnail Image
conference paper

Budgeted Knowledge Transfer for State-wise Heterogeneous RL Agents

Farshidian, Farbod
•
Talebpour, Zeynab  
•
Nili Ahmadabadi, Majid
Huang, Tingwen
•
Zeng, Zhigang
Show more
2012
Neural Information Processing
19th International Conference, ICONIP 2012

In this paper we introduce a budgeted knowledge transfer algorithm for non-homogeneous reinforcement learning agents. Here the source and the target agents are completely identical except in their state representations. The algorithm uses functional space (Q-value space) as the transfer-learning media. In this method, the target agent’s functional points (Q-values) are estimated in an automatically selected lower-dimension subspace in order to accelerate knowledge transfer. The target agent searches that subspace using an exploration policy and selects actions accordingly during the period of its knowledge transfer in order to facilitate gaining an appropriate estimate of its Q-table. We show both analytically and empirically that this method decreases the required learning budget for the target agent.

  • Files
  • Details
  • Metrics
Type
conference paper
DOI
10.1007/978-3-642-34475-6_53
Author(s)
Farshidian, Farbod
•
Talebpour, Zeynab  
•
Nili Ahmadabadi, Majid
Editors
Huang, Tingwen
•
Zeng, Zhigang
•
Li, Chuandong
•
Leung, Chi Sing
Date Issued

2012

Publisher

Springer

Publisher place

Berlin Heidelberg

Published in
Neural Information Processing
ISBN of the book

978-3-642-34474-9

Series title/Series vol.

Lecture Notes in Computer Science; 7663

Start page

439

End page

446

Subjects

Reinforcement Learning

•

Knowledge Transfer

•

Dimension Reduction

•

Exploration Policy

Peer reviewed

REVIEWED

Written at

OTHER

EPFL units
DISAL  
Event nameEvent placeEvent date
19th International Conference, ICONIP 2012

Doha, Qatar

November 12-15, 2012

Available on Infoscience
May 17, 2016
Use this identifier to reference this record
https://infoscience.epfl.ch/handle/20.500.14299/126135
Logo EPFL, École polytechnique fédérale de Lausanne
  • Contact
  • infoscience@epfl.ch

  • Follow us on Facebook
  • Follow us on Instagram
  • Follow us on LinkedIn
  • Follow us on X
  • Follow us on Youtube
AccessibilityLegal noticePrivacy policyCookie settingsEnd User AgreementGet helpFeedback

Infoscience is a service managed and provided by the Library and IT Services of EPFL. © EPFL, tous droits réservés