APPLICATION OF FINE-TUNED MODELS IN SENTIMENT ANALYSIS OF NEWS: A SYSTEMATIC LITERATURE REVIEW

Roni Habibi, Raul Mahya Komaran

Abstract


This study aims to examine the application of fine-tuned models in news sentiment analysis through the Systematic Literature Review (SLR) approach. The main focus is directed at three aspects: improving accuracy (RQ1), implementation challenges (RQ2), and computational efficiency (RQ3). The problems identified include high computational requirements, limited annotated data, and difficulties in handling language and dialect diversity. As a solution, various optimization techniques have been explored, such as domain-specific fine-tuning, knowledge distillation, quantization, and hybrid approaches that combine fine-tuned models with lexical methods. The results of the review show that fine-tuned models, especially BERT, are capable of significantly improving sentiment analysis accuracy compared to traditional machine learning models, although they still face limitations in terms of efficiency and scalability. This study provides an important foundation for the development of more accurate, efficient, and applicable models in real-world scenarios, including news media monitoring and automated content moderation systems.

Keywords


Fine-tuned models; Sentiment analysis; BERT; Computational efficiency; Systematic literature review

Full Text:

Link Download

References


?trimaitis, R., Stefanović, P., Ramanauskaitė, S., & Slotkienė, A. (2021). Financial Context News Sentiment Analysis for the Lithuanian Language. Applied Sciences.

de Oliveira, N. R., Pisa, P. S., Lopez, M. A., de Medeiros, D. S., & Mattos, D. M. (2021). Identifying Fake News on Social Networks Based on Natural Language Processing Trends and Challenges. Information.

Tang, D. Q. (2015). Document modeling with gated recurrent neural networks for sentiment classification. EMNLP, 1422–1432.

Yadav, R., Kumar, A. V., & Kumar, A. News-based supervised sentiment analysis for prediction of futures buying behaviour. IIMB Management Review.

Shen, W. (2020). BERT-based dynamic multi-scale graph neural network for multi-hop reasoning question answering. EMNLP, 7041–7051.

Taboada, M., & Grieve, J. (2011). Lexicon-based methods for sentiment analysis. Computational Linguistics, 267–307.

Kiritchenko, S., & Zhu, X. (2014). Sentiment analysis of short informal texts. Journal of Artificial Intelligence Research, 50, 723–762.

Strubell, E., Ganesh, A., & McCallum, A. (2019). Energy and policy considerations for deep learning in NLP. ACL, 3645–3650.

Yu, L., & Yang, L. (2024). News media in crisis: A sentiment and emotion analysis of US news articles on unemployment in the COVID-19 pandemic. Humanities and Social Sciences Communications.

Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780.

Bengio, Y., Simard, P., & Frasconi, P. (1994). Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2), 157–166.

Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555.

Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2020). ALBERT: A lite BERT for self-supervised learning of language representations. ICLR.

Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI Blog, 1(8), 9.

Gbaje, E. S., Agwu, C., Odigie, I. O., & Dauda Yani, S. (2023). Curtailing fake news creation and dissemination in Nigeria Twitter social network and sentiment analysis approaches. Journal of Information Science.

César, I., Pereira, I., Rodrigues, F., Miguéis, V. L., Nicola, S., Madureira, A., & Oliveira, D. A. (2024). A Systematic Review on Responsible Multimodal Sentiment Analysis in Marketing Applications. IEEE Access.

Tiwari, D., Nagpal, B., Bhati, B. S., Mishra, A., & Kumar, M. (2023). A systematic review of social network sentiment analysis with comparative study of ensemble-based techniques. Artificial Intelligence Review.

Costola, M., Hinz, O., Nofer, M., & Pelizzon, L. (2023). Machine learning sentiment analysis, COVID-19 news and stock market reactions. Research in International Business and Finance.

Alshuwaier, F., Areshey, A., & Poon, J. (2022). Applications and Enhancement of Document-Based Sentiment Analysis in Deep Learning Methods: A Systematic Literature Review. Intelligent Systems with Applications.

Ranathunga, S., & Liyanage, I. U. (2021). Sentiment Analysis of Sinhala News Comments. ACM Transactions on Asian and Low-Resource Language Information Processing.

Zhao, W., Zhang, G., Yuan, G., Liu, J., Shan, H., & Zhang, S. (2020). The Study on the Text Classification for Financial News Based on Partial Information. IEEE Access.

Matrane, Y., Benabbou, F., & Sael, N. (2023). A systematic literature review of Arabic dialect sentiment analysis. Journal of King Saud University - Computer and Information Sciences.

Wang, J., Wei, J., Tian, F., & Wei, Y. (2024). A comparative study of machine learning models for sentiment analysis of transboundary rivers news media articles. Soft Computing.

Ligthart, A., Catal, C., & Tekinerdogan, B. (2021). Systematic reviews in sentiment analysis: A tertiary study. Artificial Intelligence Review.

Gite, S., Khatavkar, H., Kotecha, K., Srivastava, S., Maheshwari, P., & Pandey, N. (2021). Explainable stock prices prediction from financial news articles using sentiment analysis. PeerJ Computer Science.

Dridi, A., Atzeni, M., & Reforgiato Recupero, D. (2018). FineNews: Fine-grained semantic sentiment analysis on financial microblogs and news. International Journal of Machine Learning and Cybernetics.

Rani, S., & Kumar, P. (2018). A journey of Indian languages over sentiment analysis: A systematic review. Artificial Intelligence Review.

Powers, D. M. W. (2011). Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation. Journal of Machine Learning Technologies, 2(1).




DOI: http://dx.doi.org/10.35671/telematika.v18i2.3181

Refbacks



 


Indexed by:

   

Telematika
ISSN: 2442-4528 (online) | ISSN: 1979-925X (print)
Published by : Universitas Amikom Purwokerto
Jl. Let. Jend. POL SUMARTO Watumas, Purwonegoro - Purwokerto, Indonesia


Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License .