YorùbáNER-X: An Explainable Hybrid Transformer–Linguistic Framework for Robust Named Entity Recognition in Low-Resource Yorùbá Text

References

[1] Adeboje OA, et al. (2025). Bridging gaps in natural language processing for Yorùbá: A systematic review of a decade of progress and prospects. Natural Language Processing Journal, 13, 100194. https://doi.org/10.1016/j.nlp.2025.100194

[2] Adelani DI, Abbott J, Neubig G, D’Souza D, Kreutzer J, Lignos C, et al. (2021). MasakhaNER: Named entity recognition for African languages. Transactions of the Association for Computational Linguistics, 9, 1116–1131.

[3] Adelani DI, Neubig G, Ruder S, Rijhwani S, Beukman M, Palen-Michel C, Lignos C, Alabi JO, Muhammad SH, Nabende P, et al. (2022). MasakhaNER 2.0: Africa-centric transfer learning for named entity recognition. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 4488–4508.

[4] Adelani DI, Liu H, Shen X, Vassilyev N, Alabi J, Mao Y, et al. (2024). SIB-200: A simple, inclusive, and big evaluation dataset for topic classification in 200+ languages and dialects. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 226-245).

[5] Ahia O, Aremu A, Abagyan D, Gonen H, Adelani DI, Abolade D, Smith NA, Tsvetkov Y (2024). Voices unheard: NLP resources and models for Yorùbá regional dialects. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 4392–4409. https://doi.org/10.18653/v1/2024.emnlp-main.251

[6] Asahiah FO, Odejobi OA, Adagunodo ER (2017). Restoring tone-marks in standard Yorùbá electronic text: improved model. Computer Science, 18(3).

[7] Babatunde AN, Ajao JF, Kayode AA, Babatunde RS, Isiaka SO, Ogundokun RO, Lee CC (2026). Sentiment classification in the Yoruba language using multilingual Bidirectional Encoder Representations from Transformers (mBERT). International Journal of Speech Technology, 29(1), 9.

[8] Conneau A, Khandelwal K, Goyal N, Chaudhary V, Wenzek G, Guzmán F, Grave E, Ott M, Zettlemoyer L, Stoyanov V (2020). Unsupervised cross-lingual representation learning at scale. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 8440–8451.

[9] Falola PB, Alabi J, Akinola SO, Ogunajo FT, Alabi EO, Adelani DI (2026). YoNER: A new Yorùbá multi-domain named entity recognition dataset. Proceedings of the Fifteenth Language Resources and Evaluation Conference, 7137–7148. https://doi.org/10.63317/4o6m2hzpy7gs

[10] Fanni SC, Febi M, Aghakhanyan G, Neri E (2023). Natural language processing. In Introduction to artificial intelligence (pp. 87-99). Cham: Springer International Publishing.

[11] Kong X, Chen Z, Liu W, Ning K, Zhang L, Muhammad Marier S, et al. (2025). Deep learning for time series forecasting: a survey. International Journal of Machine Learning and Cybernetics, 16(7), 5079–5112.

[12] Ogueji K, Zhu Y, Lin J (2021). Small data? No problem! Exploring the viability of pretrained multilingual language models for low-resourced languages. Proceedings of the 3rd Workshop on Multilingual Representation Learning, 116–126.

[13] Saadu T, Oyèwọlé JA (2025). Enhancing Yorùbá language education with technology. Ondo Journal of Arts (OJA), 1(1), 177–198.

@article{1724658,
      author = {Jelili Olalekan AMOO PhD},
      title = {YorùbáNER-X: An Explainable Hybrid Transformer–Linguistic Framework for Robust Named Entity Recognition in Low-Resource Yorùbá Text},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {10},
      number = {5},
      pages = {1151-1162},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1724658.pdf},
      abstract = {Named Entity Recognition (NER) is a key activity in Natural Language Processing; it facilitates information extraction, search, answering questions, building knowledge bases, and other downstream applications. Yorùbá NER is still hindered by a lack of labelled data, domain variation, orthographic inconsistency, and variations between standard and regional versions, despite recent advancements in African-language NLP. The empirical foundation for Yorùbá NER has been significantly strengthened by recent resources, especially MasakhaNER 2.0 and the multi-domain YoNER dataset. Nevertheless, recent data also indicate that transformer models suffer performance loss when transported across domains. In this paper, we propose YorùbáNER-X, an explainable hybrid framework that combines explicit Yorùbá linguistic features with transformer contextual representations and Association Rule Mining (ARM). The framework represents orthographic, character-level, lexical, contextual, and entity-indicative information alongside contextual transformer embedding; ARM is used as a supplementary evidence mechanism for recurring linguistic and contextual patterns rather than as a substitute for neural prediction; the framework is assessed using a controlled experimental design that includes standard NER evaluation, diacritic-variation tests, cross-domain evaluation, component ablation, statistical comparison, error analysis, and explainability analysis. The main baselines are XLM-R, an Africa-centric transformer, and OyoBERT. The study offers a repeatable methodological framework for examining whether pre-trained contextual representations in low-resource African-language NER can be enhanced by explicit language-specific information and statistical connections. In this publication, numerical experimental results are purposefully left out and will be added after implementation and assessment.},
      keywords = {Low-resource NLP; Named Entity Recognition; OyoBERT; Transformer; XLM-R},
      month = {November},
  }