• Classified by Topic • Classified by Publication Type • Sorted by Date • Sorted by First Author Last Name • Classified by Funding Source •
Compositional Models for Reinforcement Learning.
Nicholas
K. Jong and Peter Stone.
In The European Conference on Machine Learning
and Principles and Practice of Knowledge Discovery in Databases, September 2009.
[PDF]173.0kB [postscript]431.7kB
Innovations such as optimistic exploration, function approximation, and hierarchical decomposition have helped scale reinforcement learning to more complex environments, but these three ideas have rarely been studied together. This paper develops a unified framework that formalizes these algorithmic contributions as operators on learned models of the environment. Our formalism reveals some synergies among these innovations, and it suggests a straightforward way to compose them. The resulting algorithm, Fitted R-MAXQ, is the first to combine the function approximation of fitted algorithms, the efficient model-based exploration of R-MAX, and the hierarchical decompostion of MAXQ.
@InProceedings{ECML09-jong,
author="Nicholas K. Jong and Peter Stone",
title="Compositional Models for Reinforcement Learning",
booktitle="The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases",
month="September",year="2009",
abstract={Innovations such as optimistic exploration, function
approximation, and hierarchical decomposition have
helped scale reinforcement learning to more complex
environments, but these three ideas have rarely been
studied together. This paper develops a unified
framework that formalizes these algorithmic
contributions as operators on learned models of the
environment. Our formalism reveals some synergies
among these innovations, and it suggests a
straightforward way to compose them. The resulting
algorithm, Fitted R-MAXQ, is the first to combine
the function approximation of fitted algorithms, the
efficient model-based exploration of R-MAX, and the
hierarchical decompostion of MAXQ.},
}
Generated by bib2html.pl (written by Patrick Riley ) on Sun Nov 24, 2024 20:24:56