Home / Current Issue / Paper 1708319
Innovations in Data Modeling and Transformation for Scalable Business Intelligence on Modern Cloud Platforms
Subject area: Science,Engineering and Technology · Area of research: Cloud-based Business Intelligence (BI)
Abstract
This paper explores innovations in data modeling and transformation frameworks that enable scalable Business Intelligence (BI) on modern cloud platforms. As organizations increasingly rely on cloud environments to process and analyze large datasets, the limitations of traditional on-premises BI systems have become evident. The paper examines key advances in cloud-based BI, including semantic and logical data modeling, decentralized approaches such as data mesh and domain-oriented design, and real-time streaming data models. Additionally, the role of modern ELT pipelines, serverless computing, and DataOps in automating and optimizing data transformation workflows is discussed. The paper also highlights the integration of artificial intelligence (AI) in enhancing data quality through anomaly detection and auto-mapping. These innovations collectively empower organizations to scale their BI capabilities, streamline data governance, and achieve faster, more agile decision-making. Finally, the paper identifies key directions for future research, including unified metadata layers, AI-augmented BI, and adaptive cloud cost modeling. These advancements are pivotal in shaping the future of BI on cloud platforms, offering unprecedented flexibility, scalability, and operational efficiency.
Keywords
Cloud-based Business Intelligence (BI), Data Modeling, Data Mesh, ELT Pipelines, Serverless Computing, AI-enhanced Data Transformation
References
[1] [1]D. Larson and V. Chang, "A review and future direction of agile, business intelligence, analytics and data science," International Journal of Information Management, vol. 36, no. 5, pp. 700-710, 2016.
[2] [2]G. Bazzani, "Business intelligence technologies for marketing and sales: customer data management and analysis at welocalize lifesciences."
[3] [3]B.-J. Chang, "Agile business intelligence: Combining big data and business intelligence to responsive decision model," Journal of Internet Technology, vol. 19, no. 6, pp. 1699-1706, 2018.
[4] [4]Y. Luo, "New OLI advantages in digital globalization," International Business Review, vol. 30, no. 2, p. 101797, 2021.
[5] [5]S. Erik and L. Emma, "Real-Time Analytics with Event-Driven Architectures: Powering Next-Gen Business Intelligence," International Journal of Trend in Scientific Research and Development, vol. 2, no. 4, pp. 3097-3111, 2018.
[6] [6]D. Stodder, "BI and Analytics in the Age of AI and Big Data," TWDI Best Practices Report, 2018.
[7] [7]V. Grover, R. H. Chiang, T.-P. Liang, and D. Zhang, "Creating strategic business value from big data analytics: A research framework," Journal of management information systems, vol. 35, no. 2, pp. 388-423, 2018.
[8] [8]D. Zburivsky and L. Partner, Designing Cloud Data Platforms. Simon and Schuster, 2021.
[9] [9]R. H. Chowdhury, "Cloud-Based Data Engineering for Scalable Business Analytics Solutions: Designing Scalable Cloud Architectures to Enhance the Efficiency of Big Data Analytics in Enterprise Settings," Journal of Technological Science & Engineering (JTSE), vol. 2, no. 1, pp. 21-33, 2021.
[10] [10]P. M. D. da Costa Innecco, "The Implications of Cloud Computing and Big Data on the Roadmap towards Business Intelligence," De Montfort University Leicester Leicester, UK, 2015.
[11] [11]A. Sunyaev and A. Sunyaev, "Cloud computing," Internet computing: Principles of distributed systems and emerging internet-based technologies, pp. 195-236, 2020.
[12] [12]R. B. S. More, "The Evolution of Cloud Computing: Key Trends and Future Directions," 2021.
[13] [13]H. Chawla and P. Khattar, Data Lake Analytics on Microsoft Azure. Springer, 2020.
[14] [14]A. Mohamed, M. K. Najafabadi, Y. B. Wah, E. A. K. Zaman, and R. Maskat, "The state of the art and taxonomy of big data analytics: view from new big data framework," Artificial intelligence review, vol. 53, pp. 989-1037, 2020.
[15] [15]A. Thusoo and J. Sarma, Creating a data-driven enterprise with DataOps. O'Reilly Media, Incorporated, 2017.
[16] [16]S. Khan, K. A. Shakil, and M. Alam, "Big data computing using cloud-based technologies: Challenges and future perspectives," Networks of the Future, pp. 393-414, 2017.
[17] [17]V. Donselaar, "Low latency asynchronous database synchronization and data transformation using the replication log," University of Twente, 2015.
[18] [18]H. Cai, B. Xu, L. Jiang, and A. V. Vasilakos, "IoT-based big data storage systems in cloud computing: perspectives and challenges," IEEE Internet of Things Journal, vol. 4, no. 1, pp. 75-87, 2016.
[19] [19]S. Gupta, "Real-Time Big Data Analytics," 2016.
[20] [20]D. Mourtzis, "Towards the 5th industrial revolution: A literature review and a framework for process optimization based on big data analytics and semantics," Journal of Machine Engineering, vol. 21, no. 3, 2021.
[21] [21]C. Yang, Q. Huang, Z. Li, K. Liu, and F. Hu, "Big Data and cloud computing: innovation opportunities and challenges," International Journal of Digital Earth, vol. 10, no. 1, pp. 13-53, 2017.
[22] [22] A. A. Hussain, F. Al-Turjman, and M. Sah, "Semantic web and business intelligence in big-data and cloud computing era," in Innovations in Smart Cities Applications Volume 4: The Proceedings of the 5th International Conference on Smart City Applications, 2021: Springer, pp. 1418-1432.
[23] [23]J. Thomas and P. Mantri, "Axiomatic cloud computing architectural design," in Design Engineering and Science: Springer, 2021, pp. 605-657.
[24] [24]M. Hamdaqa, "An integrated modeling framework for managing the deployment and operation of cloud applications," 2016.
[25] [25]I. A. Machado, "Proposal of an Approach for the Design and Implementation of a Data Mesh," Universidade do Minho (Portugal), 2021.
[26] [26]D. Seenivasan, "Transforming Data Warehousing: Strategic Approaches and Challenges in Migrating from On-Premises to Cloud Environments," 2021.
[27] [27]P. Chima and J. Ahmadu, "Implementation of resettlement policy strategies and community members' felt-need in the federal capital territory, Abuja, Nigeria," Academic journal of economic studies, vol. 5, no. 1, pp. 63-73, 2019.
[28] [28]B. I. Adekunle, E. C. Chukwuma-Eke, E. D. Balogun, and K. O. Ogunsola, "Predictive Analytics for Demand Forecasting: Enhancing Business Resource Allocation Through Time Series Models," 2021.
[29] [29]E. O. Alonge, N. L. Eyo-Udo, B. C. Ubanadu, A. I. Daraojimba, E. D. Balogun, and K. O. Ogunsola, "Enhancing Data Security with Machine Learning: A Study on Fraud Detection Algorithms," Journal of Data Security and Fraud Prevention, vol. 7, no. 2, pp. 105-118, 2021.
[30] [30]O. O. Agbede, E. E. Akhigbe, A. J. Ajayi, and N. S. Egbuhuzor, "Assessing economic risks and returns of energy transitions with quantitative financial approaches," International Journal of Multidisciplinary Research and Growth Evaluation, vol. 2, no. 1, pp. 552-566, 2021.
[31] [31]E. O. ALONGE, N. L. EYO-UDO, B. CHIBUNNA, A. I. D. UBANADU, E. D. BALOGUN, and K. O. OGUNSOLA, "Digital Transformation in Retail Banking to Enhance Customer Experience and Profitability," 2021.
[32] [32]A. S. Ogunmokun, E. D. Balogun, and K. O. Ogunsola, "A Conceptual Framework for AI-Driven Financial Risk Management and Corporate Governance Optimization," 2021.
[33] [33]J. P. Onoja, O. Hamza, A. Collins, U. B. Chibunna, A. Eweja, and A. I. Daraojimba, "Digital Transformation and Data Governance: Strategies for Regulatory Compliance and Secure AI-Driven Business Operations," 2021.
[34] [34]I. Oyeyipo et al., "A Conceptual Framework for Transforming Corporate Finance Through Strategic Growth, Profitability, and Risk Optimization."
[35] [35]C. O. Ozobu, F. E. Adikwu, O. O. Cynthia, F. O. Onyeke, and E. O. Nwulu, "Advancing Occupational Safety with AI-Powered Monitoring Systems: A Conceptual Framework for Hazard Detection and Exposure Control."
[36] [36]C. Okolie, O. Hamza, A. Eweje, A. Collins, and G. Babatunde, "Leveraging digital transformation and business analysis to improve healthcare provider portal. IRE Journals. 2021; 4 (10): 253-254," ed.
[37] [37]I. Oyeyipo et al., "Investigating the effectiveness of microlearning approaches in corporate training programs for skill enhancement."
[38] [38]B. A. Mayienga et al., "A Conceptual Model for Global Risk Management, Compliance, and Financial Governance in Multinational Corporations."
[39] [39]D. Nyangoma, E. M. Adaga, N. J. Sam-Bulya, and G. O. Achumie, "Long-Term Employer-Talent Partnerships: A Conceptual Model for Reducing Workforce Turnover and Enhancing Retention."
[40] [40]N. J. Isibor, V. Attipoe, I. Oyeyipo, D. C. Ayodeji, and B. Apiyo, "Analyzing Successful Content Marketing Strategies That Enhance Online Engagement and Sales for Digital Brands."
[41] [41]C. I. Lawal, S. C. Friday, D. C. Ayodeji, and A. Sobowale, "Strategic Framework for Transparent, Data-Driven Financial Decision-Making in Achieving Sustainable National Development Goals."
[42] [42]B. A. Ibitoye, R. AbdulWahab, and S. D. Mustapha, "Estimation of Drivers’ Critical Gap Acceptance and Follow-up Time at Four–Legged Unsignalized Intersection."
[43] [43]T. O. Igunma, A. K. Adeleke, and Z. S. Nwokediegwu, "Developing Nanometrology and non-destructive testing methods to ensure medical device manufacturing accuracy and safety."
[44] [44]O. Famoti et al., "Data-Driven Risk Management in US Financial Institutions: A Business Analytics Perspective on Process Optimization."
[45] [45]G. Fredson, B. Adebisi, O. B. Ayorinde, E. Cynthia, O. A. Onukwulu, and A. O. Ihechere, "Building Resilient Supply Chains in Emerging Markets: Sustainable Procurement and Stakeholder Engagement Strategies."
[46] [46]V. Attipoe, I. Oyeyipo, D. C. Ayodeji, N. J. Isibor, and B. Apiyo, "Economic Impacts of Employee Well-being Programs: A Review."
[47] [47]V. M. Chigboh, S. J. C. Zouo, and J. Olamijuwon, "Health data analytics for precision medicine: A review of current practices and future directions."
[48] [48]D. I. Ajiga, O. Hamza, A. Eweje, E. Kokogho, and P. E. Odio, "Data-Driven Strategies for Enhancing Student Success in Underserved US Communities."
[49] [49]E. O. ALONGE, "IMPACT OF ORGANIZATION LEARNING CULTURE ON ORGANIZATION PERFORMANCE: A CASE STUDY OF MTN TELECOMMUNICATION COMPANY IN NIGERIA."
[50] [50]A. Abisoye, J. I. Akerele, P. E. Odio, A. Collins, G. O. Babatunde, and S. D. Mustapha, "A Data-Driven Approach to Strengthening Cybersecurity Policies in Government Agencies: Best Practices and Case Studies," International Journal of Cybersecurity and Policy Studies.(pending publication).
[51] [51]A. S. Adebayo, N. Chukwurah, and O. O. Ajayi, "Proactive Ransomware Defense Frameworks Using Predictive Analytics and Early Detection Systems for Modern Enterprises."
[52] [52]A. K. Adeleke, T. O. Igunma, and Z. S. Nwokediegwu, "Modeling Advanced Numerical Control Systems to Enhance Precision in Next-Generation Coordinate Measuring Machine."
How to cite this paper
@article{1708319,
author = {Jeffrey Chidera Ogeawuchi, Abel Chukwuemeke Uzoka, Abraham Ayodeji Abayomi, Oluwademilade Aderemi Agboola, Toluwase Peter Gbenle; Olanrewaju Oluwaseun Ajayi},
title = {Innovations in Data Modeling and Transformation for Scalable Business Intelligence on Modern Cloud Platforms},
journal = {Iconic Research And Engineering Journals},
year = {2021},
volume = {5},
number = {5},
pages = {406-415},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1708319.pdf},
abstract = {This paper explores innovations in data modeling and transformation frameworks that enable scalable Business Intelligence (BI) on modern cloud platforms. As organizations increasingly rely on cloud environments to process and analyze large datasets, the limitations of traditional on-premises BI systems have become evident. The paper examines key advances in cloud-based BI, including semantic and logical data modeling, decentralized approaches such as data mesh and domain-oriented design, and real-time streaming data models. Additionally, the role of modern ELT pipelines, serverless computing, and DataOps in automating and optimizing data transformation workflows is discussed. The paper also highlights the integration of artificial intelligence (AI) in enhancing data quality through anomaly detection and auto-mapping. These innovations collectively empower organizations to scale their BI capabilities, streamline data governance, and achieve faster, more agile decision-making. Finally, the paper identifies key directions for future research, including unified metadata layers, AI-augmented BI, and adaptive cloud cost modeling. These advancements are pivotal in shaping the future of BI on cloud platforms, offering unprecedented flexibility, scalability, and operational efficiency.},
keywords = {Cloud-based Business Intelligence (BI), Data Modeling, Data Mesh, ELT Pipelines, Serverless Computing, AI-enhanced Data Transformation},
month = {November},
}