e-ISSN: Applied
editor@ijaida.com | editor.ijaida@gmail.com

Deep Learning-Based Text Augmentation for Robust Text Classification

Abstract

The effectiveness and predictive performance of text classification models depend significantly on the availability of large, diverse, and accurately labeled datasets, which enable machine learning algorithms to learn meaningful linguistic patterns and achieve robust generalization across different domains. However, acquiring high-quality labeled textual data is often expensive, time-consuming, and domain-dependent. Data augmentation has emerged as an effective solution to address data scarcity by generating additional training samples that improve model generalization. Among various augmentation techniques, autoencoders to learn latent semantic representations and generate meaningful synthetic text samples. This research presents a comprehensive study of data augmentation for text classification using autoencoders. The proposed framework employs an encoder-decoder architecture to generate semantically similar text representations that enrich training datasets and improve classification performance. The study discusses the theoretical foundations, implementation methodology, evaluation metrics, advantages, challenges, and future research opportunities associated with autoencoder-based text augmentation. Experimental observations indicate that incorporating augmented textual data enhances classification accuracy, reduces overfitting, and improves model robustness, particularly in low-resource and imbalanced dataset scenarios.

Keywords

Text Classification, Data Augmentation, Autoencoders, Natural Language Processing, Deep Learning, Synthetic Data Generation, Machine Learning, Neural Networks

Citation of this Article

Deepika S. Agrawal. (2026). Deep Learning-Based Text Augmentation for Robust Text Classification. International Journal of Artificial Intelligence and Data Analytics, 1(1), 8-14. DOI: https://doi.org/10.47001/IJAIDA/2026.101002

References

Hinton, G. E., & Salakhutdinov, R. R. (2006). "Reducing the Dimensionality of Data with Neural Networks." Science, 313(5786), 504–507.
Kingma, D. P., & Welling, M. (2014). "Auto-Encoding Variational Bayes." International Conference on Learning Representations (ICLR).
Wei, J., & Zou, K. (2019). "EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks." Proceedings of EMNLP-IJCNLP, 6382–6388.
Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep Learning. MIT Press.
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). "Efficient Estimation of Word Representations in Vector Space." ICLR Workshop Papers.
Pennington, J., Socher, R., & Manning, C. D. (2014). "GloVe: Global Vectors for Word Representation." Proceedings of EMNLP, 1532–1543.
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding." Proceedings of NAACL-HLT, 4171–4186.
Sutskever, I., Vinyals, O., & Le, Q. V. (2014). "Sequence to Sequence Learning with Neural Networks." Advances in Neural Information Processing Systems, 27.
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A. M., Jozefowicz, R., & Bengio, S. (2016). "Generating Sentences from a Continuous Space." Proceedings of CoNLL, 10–21.
Jurafsky, D., & Martin, J. H. (2023). Speech and Language Processing (3rd Edition Draft). Stanford University.
Shorten, C., Khoshgoftaar, T. M., & Furht, B. (2021). "Text Data Augmentation for Deep Learning." Journal of Big Data, 8, 101. https://doi.org/10.1186/s40537-021-00492-0.
Feng, S. Y., Gangal, V., Wei, J., Chandar, S., Vosoughi, S., Mitamura, T., & Hovy, E. (2021). "A Survey of Data Augmentation Approaches for NLP." Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, 968–988.
Bayer, M., Kaufhold, M.-A., & Reuter, C. (2021). "A Survey on Data Augmentation for Text Classification." ACM Computing Surveys.
Karimi, A., Rossi, L., & Prati, A. (2021). "AEDA: An Easier Data Augmentation Technique for Text Classification." Findings of the Association for Computational Linguistics: EMNLP 2021, 2748–2754. https://doi.org/10.18653/v1/2021.findings-emnlp.234.
Kumar, V., Choudhary, A., & Cho, E. (2020). "Data Augmentation Using Pre-trained Transformer Models." arXiv preprint arXiv:2003.02245.
Tang, H., Kamei, S., & Morimoto, Y. (2023). "Data Augmentation Methods for Enhancing Robustness in Text Classification Tasks." Algorithms, 16(1), 59. https://doi.org/10.3390/a16010059.
Gao, F., Zhu, J., Wu, L., Xia, Y., Qin, T., Cheng, X., Zhou, W., & Liu, T.-Y. (2019). "Soft Contextual Data Augmentation for Neural Machine Translation." Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 5539–5544. https://doi.org/10.18653/v1/P19-1555.
Garg, S., & Ramakrishnan, G. (2020). "BAE: BERT-Based Adversarial Examples for Text Classification." Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 6174–6181. https://doi.org/10.18653/v1/2020.emnlp-main.498.
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding." Proceedings of NAACL-HLT 2019, 4171–4186. https://doi.org/10.18653/v1/N19-1423.
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). "Efficient Estimation of Word Representations in Vector Space." arXiv preprint arXiv:1301.3781.
Pennington, J., Socher, R., & Manning, C. D. (2014). "GloVe: Global Vectors for Word Representation." Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1532–1543. https://doi.org/10.3115/v1/D14-1162.
Zhang, X., Zhao, J., & LeCun, Y. (2015). "Character-Level Convolutional Networks for Text Classification." Advances in Neural Information Processing Systems, 28.
License: This article is published under the Creative Commons Attribution 4.0 International License (CC BY 4.0).