BiLAT: A BiLSTM Attention Transformer Model with Hyperparameter Optimization for Robust Fake News Detection

References

[1] M. Q. Alnabhan and P. Branco, "Fake News Detection Using Deep Learning: A Systematic Literature Review," in IEEE Access, vol. 12, pp. 114435-114459, 2024

[2] Kumari, Shweta & Singh, Maheshwari. (2024). A Deep Learning Multimodal Framework for Fake News Detection. Engineering, Technology & Applied Science Research. 14. 16527-16533. 10.48084/etasr.8170.

[3] Vinita Nair, Dr. Jyoti Pareek, Sanskruti Bhatt, A Knowledge Based Deep Learning Approach for Automatic Fake News Detection using BERT on Twitter, Procedia Computer Science, Volume 235, 2024, Pages 1870 1882, ISSN 1877-0509.

[4] Yan, Y.; Fu, H.; Wu, F. Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism. Electronics 2024, 13, 3700.

[5] Zhu, P., Hua, J., Tang, K. et al. Multimodal fake news detection through intra-modality feature aggregation and inter-modality semantic fusion. Complex Intell. Syst. 10, 5851–5863 (2024).

[6] M, G.K., Faizz Ahmad, K., Pamidimukkala, S.G. et al. Hybrid optimization driven fake news detection using reinforced transformer models. Sci Rep 15, 14782 (2025).

[7] Sallah, E. A. Abdellaoui Alaoui, S. Agoujil, M. A. Wani, M. Hammad, Y. Maleh, and A. A. Abd El-Latif, "Fine Tuned Understanding: Enhancing Social Bot Detection With Transformer Based Classification," IEEE Access, vol. 12, pp. 118250–118269, 2024.

[8] Di Huang, Jinbao Song, Xingyu Zhang, Semi-Supervised Social Bot Detection with Relational Graph Attention Transformers and Characteristics of the social environment, Information Fusion, Volume 118, 2025, 102956, ISSN 1566-2535.

[9] S. Koca and I. Cicekli, "Fake Detection for Tweets and News with Different Domain Datasets," 2024 Innovations in Intelligent Systems and Applications Conference (ASYU), Ankara, Turkiye, 2024, pp. 1-6.

[10] E.Almandouh, M., Alrahmawy, M.F., Eisa, M. et al. Ensemble based high performance deep learning models for fake news detection. Sci Rep 14, 26591 (2024).

[11] Kayato Soga, Soh Yoshida, Mitsuji Muneyasu, Exploiting stance similarity and graph neural networks for fake news detection, Pattern Recognition Letters, Volume 177, 2024, Pages 26-32, ISSN 0167-8655.

[12] M. F. Mridha, A. J. Keya, M. A. Hamid, M. M. Monowar, and M. S. Rahman, "A comprehensive review on fake news detection with deep learning," IEEE Access, vol. 9, pp. 1, Nov. 2021.

[13] R. Budiarto, H. Setiawan, and R. N. Yasa, "Text preprocessing for optimal accuracy in Indonesian sentiment analysis using a deep learning model with word embedding," AIP Conference Proceedings, vol. 2601, Aug. 2021..

[14] Ahmed, S.F., Alam, M.S.B., Hassan, M. et al. Deep learning modelling techniques: current progress, applications, advantages, and challenges. Artif Intell Rev 56, 13521–13617 (2023).

[15] M. Massaoudi, H. Abu-Rub, S. S. Refaat, I. Chihi and F. S. Oueslati, "Deep Learning in Smart Grid Technology: A Review of Recent Advancements and Future Prospects," in IEEE Access, vol. 9, pp. 54558-54578, 2021.

[16] Nasir, J. A., Khan, O. S., & Varlamis, I., "Fake news detection: A hybrid CNN-RNN based deep learning approach," International Journal of Information Management Data Insights, vol. 1, no. 1, Article 100007, Apr. 2021.

[17] Al-alshaqi, M.; Rawat, D.B.; Liu, C. A BERT-Based Multimodal Framework for Enhanced Fake News Detection Using Text and Image Data Fusion. Computers 2025, 14,237.

[18] T. Bhatia, B. Manaskasemsak, and A. Rungsawang, "Detecting fake news sources on Twitter using deep neural network," in Proc. 2023 11th International Conference on Information and Education Technology (ICIET), Mar. 2023.

[19] S. Khan and E. Guzmán, “A hybrid LSTM-Transformer framework for accurate fake news detection on Twitter,” available at SSRN, SSRN: 5674494, 2023.

[20] .M. A. K. Raiaan, S. Sakib, N. M. Fahad, A. A. Mamun, M. A. Rahman, S. Shatabda and M. S. H. Mukta, “A systematic review of hyperparameter optimization techniques in Convolutional Neural Networks,” Decision Analytics Journal, vol. 11, Art. no. 100470, 2024.

[21] Jaber, Y.; Dharmasena, P.; Nassif, A.; Nassif, N. Hyperparameter Optimization of Neural Networks Using Grid Search for Predicting HVAC Heating Coil Performance. Buildings 2025, 15, 2753.

[22] Zulfiqar, M.; Gamage, K.A.A.; Kamran, M.; Rasheed, M.B. Hyperparameter Optimization of Bayesian Neural Network Using Bayesian Optimization and Intelligent Feature Engineering for Load Forecasting. Sensors 2022, 22, 4446.

[23] M. Massaoudi, H. Abu-Rub, S. S. Refaat, I. Chihi and F. S. Oueslati, "Deep Learning in Smart Grid Technology: A Review of Recent Advancements and Future Prospects," in IEEE Access, vol. 9, pp. 54558-54578, 2021.

@article{1714856,
      author = {T. Poornima},
      title = {BiLAT: A BiLSTM Attention Transformer Model with Hyperparameter Optimization for Robust Fake News Detection},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {9},
      number = {9},
      pages = {385-402},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1714856.pdf},
      abstract = {The rapid spread of misinformation on social media, particularly Twitter, poses major problems to information reliability and public trust.   This paper includes a complete comparative examination of six deep learning models such as RNN, CNN, BERT, GRU, LSTM, and a suggested BiLSTM Attention Transformer (BiLAT) assessed across three benchmark datasets: Fake and Real News, FakeNewsNet, and ISOT Fabricated News.   We systematically test five hyperparameter optimisation methods (Grid Search (GS), Random Search (RS), Bayesian Optimisation (BO), Genetic Algorithm (GA), and BOHB) to see how they affect model performance.  Results reveal that transformer-based architectures greatly outperform traditional models, with BiLAT obtaining state-of-the-art performance, including 99% accuracy on FakeNewsNet under BOHB optimization.   BOHB consistently gives the best performance gains across all models and datasets, with an accuracy boost of 2–5% over traditional optimisation methods.  The findings suggest that integrating advanced transformer topologies with efficient hyperparameter optimization considerably boosts the ability to grasp linguistic intricacies inherent in disinformation.   This paper shows the importance of architectural design and optimization technique in constructing effective, scalable fake news detection systems for social media contexts.},
      keywords = {Fake News Detection, Deep Learning Models, Hyperparameter Optimization, Transformer Architectures, BOHB},
      month = {March},
      doi = {https://doi.org/10.64388/IREV9I9-1714856}
  }