Enhancing sentiment classification on small datasets through data augmentation and transfer learning

Read full text
Authors: Mahmoud S. Mayaleh, Samer A. Mayaleh
Cited by: 1
References: 16

Abstract

Small-scale sentiment classification often suffers from data scarcity, which limits the generalization ability of the models. This study evaluates and compares the effectiveness of three data augmentation strategies: Easy Data Augmentation (EDA), back-translation, and contextual token substitution (nlpaug-style), with both traditional machine learning classifiers (Logistic Regression, Random Forest) and transformer-based models (BERT). We perform a comprehensive empirical comparison with low-resource sentiment datasets by summarizing the results of recent studies and performing targeted head-to-head experiments. Our findings indicate that all augmentation methods improve performance. Contextual augmentation yields the most consistent gains for BERT models, while EDA and back-translation provide greater benefits for traditional classifiers. These insights help guide the selection of data augmentation techniques tailored to model type and dataset size, filling a critical gap in research on data augmentation for sentiment classification on small datasets.

Fields of Study & Subjects

Sentiment Analysis and Opinion Mining Emotion and Mood Recognition Text and Document Classification Technologies

Publication details

Journal / source
Discover Artificial Intelligence
Publisher
Springer Science and Business Media LLC
Volume
6
Issue
1
Publication date
18 January 2026
Language
EN