You can manage bookmarks using lists, please log in to your user account for this.
Media type:
E-Article
Title:
Local Decision Pitfalls in Interactive Machine Learning : An Investigation into Feature Selection in Sentiment Analysis
:
An Investigation into Feature Selection in Sentiment Analysis
Contributor:
Wu, Tongshuang;
Weld, Daniel S.;
Heer, Jeffrey
imprint:
Association for Computing Machinery (ACM), 2019
Published in:ACM Transactions on Computer-Human Interaction
Language:
English
DOI:
10.1145/3319616
ISSN:
1073-0516;
1557-7325
Origination:
Footnote:
Description:
<jats:p>Tools for Interactive Machine Learning (IML) enable end users to update models in a “rapid, focused, and incremental”—yet local—manner. In this work, we study the question of local decision making in an IML context around feature selection for a sentiment classification task. Specifically, we characterize the utility of interactive feature selection through a combination of human-subjects experiments and computational simulations. We find that, in expectation, interactive modification fails to improve model performance and may hamper generalization due to overfitting. We examine how these trends are affected by the dataset, learning algorithm, and the training set size. Across these factors we observe consistent generalization issues. Our results suggest that rapid iterations with IML systems can be dangerous if they encourage local actions divorced from global context, degrading overall model performance. We conclude by discussing the implications of our feature selection results to the broader area of IML systems and research.</jats:p>