> Details

Nguyen, Thi Huyen [Author]; Nguyen, Hoang H. [Author]; Ahmadi, Zahra [Author]; Hoang, Tuan-Anh [Author]; Doan, Thanh-Nam [Author]; He, Jing [Author]; Unland, Rainer [Author]; Santos Jr., Eugene [Author]; Tao, Xiaohui [Author]; Purohit, Hemant [Author]; van den Heuvel, Willem-Jan [Author]; Yearwood, John [Author]; Cao, Jie [Author]

On the Impact of Dataset Size: A Twitter Classification Case Study - [published Version]

Reference
management

Bookmarks

Remove from
bookmarks

Share this on Whatsapp

Close

Bookmarks



You can manage bookmarks using lists, please log in to your user account for this.
  • Media type: E-Article; Text
  • Title: On the Impact of Dataset Size: A Twitter Classification Case Study
  • Contributor: Nguyen, Thi Huyen [Author]; Nguyen, Hoang H. [Author]; Ahmadi, Zahra [Author]; Hoang, Tuan-Anh [Author]; Doan, Thanh-Nam [Author]; He, Jing [Author]; Unland, Rainer [Author]; Santos Jr., Eugene [Author]; Tao, Xiaohui [Author]; Purohit, Hemant [Author]; van den Heuvel, Willem-Jan [Author]; Yearwood, John [Author]; Cao, Jie [Author]
  • Published: New York,NY,United States : Association for Computing Machinery, 2021
  • Published in: IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology ; ACM Digital Library
  • Issue: published Version
  • Language: English
  • DOI: https://doi.org/10.15488/15576; https://doi.org/10.1145/3486622.3493960
  • ISBN: 978-1-4503-9115-3
  • Keywords: Konferenzschrift ; extrapolation methods ; Twitter classification ; neural network ; dataset size ; empirical study ; machine learning
  • Origination:
  • Footnote: Diese Datenquelle enthält auch Bestandsnachweise, die nicht zu einem Volltext führen.
  • Description: The recent advent and evolution of deep learning models and pre-trained embedding techniques have created a breakthrough in supervised learning. Typically, we expect that adding more labeled data improves the predictive performance of supervised models. On the other hand, collecting more labeled data is not an easy task due to several difficulties, such as manual labor costs, data privacy, and computational constraint. Hence, a comprehensive study on the relation between training set size and the classification performance of different methods could be essentially useful in the selection of a learning model for a specific task. However, the literature lacks such a thorough and systematic study. In this paper, we concentrate on this relationship in the context of short, noisy texts from Twitter. We design a systematic mechanism to comprehensively observe the performance improvement of supervised learning models with the increase of data sizes on three well-known Twitter tasks: sentiment analysis, informativeness detection, and information relevance. Besides, we study how significantly better the recent deep learning models are compared to traditional machine learning approaches in the case of various data sizes. Our extensive experiments show (a) recent pre-trained models have overcome big data requirements, (b) a good choice of text representation has more impact than adding more data, and (c) adding more data is not always beneficial in supervised learning.
  • Access State: Open Access
  • Rights information: Attribution (CC BY)