Enhancement of Support Vector Machine utilizing RoBERTa applied to Sentiment Analysis of Facebook Data

References

[1] Zainuddin, N., & Selamat, A. (2014, September). Sentiment analysis using support vector machine. In 2014 international conference on computer, communications, and control technology (I4CT) (pp. 333-337). IEEE.

[2] Mullen, T., & Collier, N. (2004, July). Sentiment analysis using support vector machines with diverse information sources. In Proceedings of the 2004 conference on empirical methods in natural language processing (pp. 412-418).

[3] Cervantes, J., Garcia-Lamont, F., Rodríguez- Mazahua, L., & Lopez, A. (2020). A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing, 408, 189-215.

[4] Li, H. X., Yang, J. L., Zhang, G., & Fan, B. (2013). Probabilistic support vector machines for classification of noise affected data. Information Sciences, 221, 60-71.

[5] Kumar, B. P., & Sadanandam, M. (2023). A Fusion Architecture of BERT and RoBERTa for Enhanced Performance of Sentiment Analysis of Social Media Platforms.

[6] Devika, M., Sunitha, C., & Ganesh, A. (2016, January 1). Sentiment Analysis: A Comparative Study on Different Approaches. Procedia Computer Science. https://

[7] Anyim, J. A. (2014). A comparative evaluation of sentiment analysis techniques on Facebook data using three machine learning algorithms: Naïve Bayes, maximum entropy and support vector machines (Doctoral dissertation).

[8] Mahtab, S. A., Islam, N., & Rahaman, M. M. (2018, September). Sentiment analysis on bangladesh cricket with support vector machine. In 2018 international conference on Bangla speech and language processing (ICBSLP) (pp. 1-4). IEEE

[9] Cervantes, J., Garcia-Lamont, F., Rodríguez- Mazahua, L., & Lopez, A. (2020). A comprehensive survey on support vector machine classification: Applications, challenges and trends. Neurocomputing, 408, 189-215.

[10] Li, H. X., Yang, J. L., Zhang, G., & Fan, B. (2013). Probabilistic support vector machines for classification of noise affected data. Information Sciences, 221, 60-71.

[11] Balakrishnan, V., Shi, Z., Law, C. L., Lim, R., Teh, L. L., & Fan, Y. (2022). A deep learning approach in predicting products’ sentiment ratings: a comparative analysis. The Journal of Supercomputing, 78(5), 7206-7226.

[12] Zhao, L., Li, L., Zheng, X., & Zhang, J. (2021, May). A BERT based sentiment analysis and key entity detection approach for online financial texts. In 2021 IEEE 24th International conference on computer supported cooperative work in design (CSCWD) (pp. 1233-1238). IEEE.

[13] Sennrich, R., Haddow, B., & Birch, A. (2016, June 9). Edinburgh Neural Machine Translation Systems for WMT 16. arXiv.org. https://arxiv.org/abs/1606.02891

[14] Van Os, R., (2022) Lexical Substitution with Transformers-based Language Models (Doctoral dissertation, tilburg university).

[15] Azizah, S. F. N., Cahyono, H. D., Sihwi, S. W., & Widiarto, W. (2023, August 9). Performance Analysis of Transformer Based Models (BERT, ALBERT and RoBERTa) in Fake News Detection. arXiv.org. https://arxiv.org/abs/2308.04950

@article{1705811,
      author = {Patricia Mae A. Samson, Eunna Jazrel M. Arcilla, Raymund M. Dioses; Florencio V. Contreras Jr., Richard C. Regala; Jonathan C. Morano, Leisyl M. Mahusay; Jamillah S. Guialil},
      title = {Enhancement of Support Vector Machine utilizing RoBERTa applied to Sentiment Analysis of Facebook Data},
      journal = {Iconic Research And Engineering Journals},
      year = {2024},
      volume = {7},
      number = {11},
      pages = {386-391},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1705811.pdf},
      abstract = {Many people are using social media sites like Facebook to express their opinions, experiences, or whatever they want to post online. Understanding user sentiment has become crucial for various applications, ranging from marketing to public opinion analysis. Researchers use natural language processing (NLP) and machine learning algorithms to evaluate textual information from Facebook posts and classify sentiments as positive, negative, or neutral. This study delves into sentiment analysis of Facebook data to better understand how users express their emotions. Additionally, the method addresses the limitations of sentiment analysis on social media due to informal language, slang, and context-dependent phrases. The study aims to develop an enhanced Support Vector Machine algorithm for sentiment analysis of Facebook data by utilizing the RoBERTa (A Robustly optimized BERT) model. To enhance sentiment accuracy, thus the performance of the traditional SVM algorithm, the proposed approach uses VADER to predict initial sentiment labels, loads a pre-trained RoBERTa model as preprocessing techniques, fine-tunes the RoBERTa model and extracts RoBERTa embeddings to optimize the SVM algorithm. This improves the model's capacity to handle imbalanced datasets and efficiently manage larger datasets while filtering out noisy or irrelevant characteristics. To analyze the performance of the proposed technique, results are compared with the result of existing algorithms. The enhanced SVM algorithm significantly outperforms the existing approach in terms of accuracy, precision, recall, and F1-score, with a 4% to 8% improvement in accuracy over the previous algorithm. This research highlights the potential of integrating RoBERTa techniques with SVM for enhanced sentiment analysis.},
      keywords = {Sentiment Analysis, Support Vector Machine, RoBERTa, Facebook},
      month = {May},
  }