OREGON STATE UNIVERSITY

You are here

Automatic Discovery and Transfer of Task Hierarchies in Reinforcement Learning

TitleAutomatic Discovery and Transfer of Task Hierarchies in Reinforcement Learning
Publication TypeMagazine Article
Year of Publication2011
AuthorsMehta, N., S. Ray, P. Tadepalli, and T. G. Dietterich
MagazineAI Magazine
Volume32
Issue Number1
Date Published2011
Abstract

Sequential decision tasks present many opportunities for the study of transfer learning. A principal one among them is the existence of multiple domains that share the same underlying causal structure for actions. We describe an approach that exploits this shared causal structure to discover a hierarchical task structure in a source domain, which in turn speeds up learning of task execution knowledge in a new target domain. Our approach is theoretically justified and compares favorably to manually designed task hierarchies in learning efficiency in the target domain. We demonstrate that causally motivated task hierarchies transfer more robustly than other kinds of detailed knowledge that depend on the idiosyncrasies of the source domain and are hence less transferable.

URLhttp://www.aaai.org/ojs/index.php/aimagazine/article/view/2342