Showing 1–2 of 2 results for author: Kwee, I

Gradient-based Reinforcement Planning in Policy-Search Methods

Authors: Ivo Kwee, Marcus Hutter, Juergen Schmidhuber

Abstract: We introduce a learning method called ``gradient-based reinforcement planning'' (GREP). Unlike traditional DP methods that improve their policy backwards in time, GREP is a gradient-based method that plans ahead and improves its policy before it actually acts in the environment. We derive formulas for the exact policy gradient that maximizes the expected future reward and confirm our ideas with… ▽ More We introduce a learning method called ``gradient-based reinforcement planning'' (GREP). Unlike traditional DP methods that improve their policy backwards in time, GREP is a gradient-based method that plans ahead and improves its policy before it actually acts in the environment. We derive formulas for the exact policy gradient that maximizes the expected future reward and confirm our ideas with numerical experiments. △ Less

Submitted 28 November, 2001; originally announced November 2001.

Comments: This is an extended version of the paper presented at the EWRL 2001 in Utrecht (The Netherlands)

Report number: 14-01 ACM Class: I.2; I.2.6; I.2.8

Market-Based Reinforcement Learning in Partially Observable Worlds

Authors: Ivo Kwee, Marcus Hutter, Juergen Schmidhuber

Abstract: Unlike traditional reinforcement learning (RL), market-based RL is in principle applicable to worlds described by partially observable Markov Decision Processes (POMDPs), where an agent needs to learn short-term memories of relevant previous events in order to execute optimal actions. Most previous work, however, has focused on reactive settings (MDPs) instead of POMDPs. Here we reimplement a re… ▽ More Unlike traditional reinforcement learning (RL), market-based RL is in principle applicable to worlds described by partially observable Markov Decision Processes (POMDPs), where an agent needs to learn short-term memories of relevant previous events in order to execute optimal actions. Most previous work, however, has focused on reactive settings (MDPs) instead of POMDPs. Here we reimplement a recent approach to market-based RL and for the first time evaluate it in a toy POMDP setting. △ Less

Submitted 15 May, 2001; originally announced May 2001.

Comments: 8 LaTeX pages, 2 postscript figures

Report number: IDSIA-10-01 ACM Class: I.2

Journal ref: Lecture Notes in Computer Science (LNCS 2130), Proceeding of the International Conference on Artificial Neural Networks ICANN (2001) 865-873