OREGON STATE UNIVERSITY

You are here

A Relational Hierarchical Model for Decision-Theoretic Assistance

TitleA Relational Hierarchical Model for Decision-Theoretic Assistance
Publication TypeConference Paper
Year of Publication2007
AuthorsNatarajan, S., P. Tadepalli, and A. Fern
Conference NameInternational Joint Conference on Artificial Intelligence (IJCAI-2007)
Pagination175-190
Date Published01/2007
Conference LocationHyderabad, India
Abstract

Markov models are commonly used for joint inference of label sequences. Unfortunately, inference scales quadratically in the number of labels, which is problematic for training methods where inference is repeatedly preformed and is the primary computational bottleneck for large label sets. Recent work has used output coding to address this issue by converting a problem with many labels to a set of problems with binary labels. Models were independently trained for each binary problem, at a much reduced computational cost, and then combined for joint inference over the original labels. Here we revisit this idea and show through experiments on synthetic and benchmark data sets that the approach can perform poorly when it is critical to explicitly capture the Markovian transition structure of the large-label problem. We then describe a simple cascade-training approach and show that it can improve performance on such problems with negligible computational overhead.