Tell me more? The Effects of Mental Model Soundness on Personalizing an Intelligent Agent

TitleTell me more? The Effects of Mental Model Soundness on Personalizing an Intelligent Agent
Publication TypeConference Paper
Year of Publication2012
AuthorsKulesza, T., S. Stumpf, M. M. Burnett, and I. Kwan
Tertiary AuthorsKonstan, J. A., E. H. Chi, and K. Höök
Conference Name2012 ACM annual conference on Human Factors in Computing Systems - CHI '12
Pagination1-10
Date Published05/2012
PublisherACM Press
Conference LocationAustin, Texas
ISBN Number9781450310154
Abstract

What does a user need to know to productively work with an intelligent agent? Intelligent agents and recommender systems are gaining widespread use, potentially creating a need for end users to understand how these systems operate in order to fix their agent's personalized behavior. This paper explores the effects of mental model soundness on such personalization by providing structural knowledge of a music recommender system in an empirical study. Our findings show that participants were able to quickly build sound mental models of the recommender system's reasoning, and that participants who most improved their mental models during the study were significantly more likely to make the recommender operate to their satisfaction. These results suggest that by helping end users understand a system's reasoning, intelligent agents may elicit more and better feedback, thus more closely aligning their output with each user's intentions.

Notes

Best Paper honorable mention

DOI10.1145/2207676.2207678