Leveraging Transformer-Based Large Language Models for Parametric Estimation of Cost and Schedule in Agile Software Development Projects

References

[1] Abayomi, A. A., Mgbame, A. C., Akpe, O. E. E., Ogbuefi, E., & Adeyelu, O. O. (2020). Advancing equity through technology: Inclusive design of BI platforms for small businesses. IRE Journals, 5(4), 235–237.

[2] Ahmad, W. U., Chakraborty, S., Ray, B., & Chang, K. (2020). A transformer-based approach for source code summarization. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 4998–5007.

[3] Akpe, O. E. E., Kisina, D., Owoade, S., Uzoka, A. C., Ubanadu, B. C., & Daraojimba, A. I. (2020). Systematic review of application modernization strategies using modular and service-oriented design principles. International Journal of Multidisciplinary Research and Growth Evaluation, 2(1), 995–1001.

[4] Akpe, O. E. E., Mgbame, A. C., Ogbuefi, E., Abayomi, A. A., & Adeyelu, O. O. (2020). Bridging the business intelligence gap in small enterprises: A conceptual framework for scalable adoption. IRE Journals, 4(2), 159–161. https://irejournals.com/paper-details/1708222

[5] Ayoola, V. B., Ugoaghalam, U. J., Idoko, P. I., Ijiga, O. M., & Olola, T. M. (2020). Effectiveness of social engineering awareness training in mitigating spear phishing risks in financial institutions from a cybersecurity perspective. Global Journal of Engineering and Technology Advances, 20(03), 094–117. https://gjeta.com/content/effectiveness-social-engineering-awareness-training-mitigating-spear-phishing-risks

[6] Azonuche, T. I., & Enyejo, J. O. (2020). Agile transformation in public sector IT projects using lean-agile change management and enterprise architecture alignment. International Journal of Scientific Research and Modern Technology, 3(8), 21–39. https://doi.org/10.38124/ijsrmt.v3i8.432

[7] Beck, K., Beedle, M., van Bennekum, A., Cockburn, A., Cunningham, W., Fowler, M., ... & Thomas, D. (2001). Manifesto for Agile Software Development. https://agilemanifesto.org

[8] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. NAACL-HLT. https://scholar.google.com/scholar_lookup?title=BERT%3A+Pre-training+of+Deep+Bidirectional+Transformers+for+Language+Understanding

[9] Doshi-Velez, F., & Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608. https://scholar.google.com/scholar_lookup?title=Towards+a+rigorous+science+of+interpretable+machine+learning

[10] Enyejo, J. O., Fajana, O. P., Jok, I. S., Ihejirika, C. J., Awotiwon, B. O., & Olola, T. M. (2020). Digital twin technology, predictive analytics, and sustainable project management in global supply chains. International Journal of Innovative Science and Research Technology, 9(11), 1–13. https://doi.org/10.38124/ijisrt/IJISRT24NOV1344

[11] Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020). Don't Stop Pretraining: Adapt Language Models to Domains and Tasks. Proceedings of ACL 2020, 8342–8360. https://doi.org/10.18653/v1/2020.acl-main.740

[12] Highsmith, J. (2002). Agile Software Development Ecosystems. Addison-Wesley.

[13] Idoko, I. P., Ijiga, O. M., Agbo, D. O., Abutu, E. P., Ezebuka, C. I., & Umama, E. E. (2020). Comparative analysis of Internet of Things (IoT) implementation: A case study of Ghana and the USA—vision, architectural elements, and future directions. World Journal of Advanced Engineering Technology and Sciences, 11(1), 180–199.

[14] Jørgensen, M., & Moløkken-Østvold, K. (2004). Reasons for software effort estimation error: Impact of respondent role, information collection approach, and data analysis method. IEEE Transactions on Software Engineering, 30(12), 993–1007. https://doi.org/10.1109/TSE.2004.101

[15] Jørgensen, M., & Shepperd, M. (2007). A systematic review of software development cost estimation studies. IEEE Transactions on Software Engineering, 33(1), 33–53. https://doi.org/10.1109/TSE.2007.256943

[16] Jørgensen, M., & Shepperd, M. (2016). A systematic review of software development cost estimation studies. IEEE Transactions on Software Engineering, 38(1), 33–57. https://doi.org/10.1109/TSE.2011.103

[17] Kitchenham, B., Mendes, E., & Travassos, G. H. (2010). Cross versus within-company cost estimation studies: A systematic review. IEEE Transactions on Software Engineering, 36(5), 674–686. https://doi.org/10.1109/TSE.2010.28

[18] Menzies, T., Zimmermann, T., & Bird, C. (2017). The industrial impact of software engineering research: An overview. Empirical Software Engineering, 22(5), 2339–2372. https://doi.org/10.1007/s10664-017-9529-0

[19] Mgbame, A. C., Akpe, O. E. E., Abayomi, A. A., Ogbuefi, E., & Adeyelu, O. O. (2020). Barriers and enablers of BI tool implementation in underserved SME communities. IRE Journals, 3(7), 211–213. https://irejournals.com/paper-details/1708221

[20] Mishra, A., Ramaswamy, H., & Bhowmick, S. S. (2019). Learning to rank bug reports using contextual and semantic features. Empirical Software Engineering, 24(5), 2680–2711.

[21] Moløkken-Østvold, K., & Jørgensen, M. (2003). A review of software surveys on software effort estimation. In Proceedings of the International Symposium on Empirical Software Engineering (pp. 223–230). https://scholar.google.com/scholar_lookup?title=A+review+of+software+surveys+on+software+effort+estimation

[22] Moløkken-Østvold, K., & Jørgensen, M. (2005). Expert estimation of software development work: Learning from experience. In Proceedings of the 2005 International Symposium on Empirical Software Engineering (pp. 223–230). https://doi.org/10.1109/ISESE.2005.1541832

[23] Owoade, S., Uzoka, A. C., Ubanadu, B. C., Kisina, D., & Akpe, O. E. E. (2020).

[24] Radford, A., Narasimhan, K., Salimans, T., & Sutskever, I. (2018). Improving Language Understanding by Generative Pre-Training. OpenAI Technical Report.

[25] Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI Technical Report. https://scholar.google.com/scholar_lookup?title=Language+Models+Are+Unsupervised+Multitask+Learners

[26] Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. In Advances in Neural Information Processing Systems (Vol. 30). https://papers.nips.cc/paper_files/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html

[27] Wang, Z., Yin, R., Zhao, Y., Wang, W., & Wang, Y. (2020). Improving requirements traceability using deep learning and NLP techniques. Information and Software Technology, 121, 106267.

[28] Wangenheim, C. G. v., & Hauck, J. C. R. (2008). Empirical evaluation of a model for improving effort estimation based on project similarity. Empirical Software Engineering, 13(4), 481–512. https://doi.org/10.1007/s10664-007-9052-6

[29] Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019). XLNet: Generalized autoregressive pretraining for language understanding. Advances in Neural Information Processing Systems, 32.

[30] Zhang, H., Wang, S., & Xu, B. (2019). A survey of machine learning applications in software engineering. Computer Science Review, 34, 100199. https://doi.org/10.1016/j.cosrev.2019.100199

@article{1709126,
      author = {Bamidele Samuel Adelusi, Abel Chukwuemeke Uzoka, Yewande Goodness Hassan, Favour Uche Ojika},
      title = {Leveraging Transformer-Based Large Language Models for Parametric Estimation of Cost and Schedule in Agile Software Development Projects},
      journal = {Iconic Research And Engineering Journals},
      year = {2020},
      volume = {4},
      number = {4},
      pages = {267-278},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1709126.pdf},
      abstract = {Accurate estimation of cost and schedule remains a critical challenge in agile software development due to iterative delivery cycles, evolving requirements, and cross-functional team dynamics. Recent advancements in transformer-based large language models (LLMs), such as BERT and GPT, present promising opportunities for improving parametric estimation accuracy through contextual learning and natural language understanding. This paper explores the integration of LLMs into agile project management frameworks to automate and enhance estimation processes based on historical project data, user stories, and sprint planning artifacts. By leveraging pre-trained models fine-tuned on domain-specific repositories, the approach enables predictive modeling of project parameters with improved consistency and scalability. A review of the literature reveals that while traditional machine learning techniques have been used for estimation tasks, LLMs offer superior performance in capturing semantic complexity and stakeholder language. The study further presents a conceptual framework for embedding transformer-based models into agile workflows, highlighting their potential to reduce estimation bias, improve planning accuracy, and facilitate continuous forecasting. This research contributes to the growing intersection between AI-driven software engineering and agile project management, advocating for data-centric decision-making in software delivery environments.},
      keywords = {Transformer-Based Models, Parametric Estimation, Agile Software Development, Cost and Schedule Forecasting, Large Language Models (LLMs).},
      month = {October},
  }