International Peer-Reviewed Journal•Open Access•ISSN 2456-8880
[email protected]•+91-7433024337

Home / Current Issue / Paper 1725270

1725270 Vol 10 · Issue 5 Download Paper

Performance Evaluation of SQL-on-Lake Engines and Traditional Data Warehouses for Analytical Workloads

Mission Franklin Onyedikachi Iheanacho Nnadi

Subject area: Science,Engineering and Technology  ·  Area of research: Data Engineering and Database Systems

Abstract

The rapid growth of big data and cloud computing has transformed the way organizations store, manage, and analyse large volumes of data. Among the emerging analytical platforms, SQL-on-Lake engines and traditional data warehouses have become widely adopted for supporting business intelligence and decision-making. However, selecting the most appropriate architecture remains challenging because each platform offers distinct advantages in terms of performance, scalability, and resource utilization. This study evaluated and compared the performance of SQL-on-Lake engines and traditional data warehouses for analytical workloads using an experimental approach. Performance evaluation was based on six metrics: query execution time, throughput, CPU utilization, memory utilization, scalability, and storage efficiency. The results showed that the traditional data warehouse consistently achieved lower query execution times, higher throughput, and more efficient CPU and memory utilization for structured analytical queries. In contrast, the SQL-on-Lake engine demonstrated superior scalability and storage efficiency, particularly as dataset size increased, making it more suitable for processing large-scale and heterogeneous datasets. The findings reveal that each architecture exhibits unique strengths depending on workload characteristics and operational requirements. The study concludes that neither architecture is universally superior for all analytical scenarios. It is therefore recommended that traditional data warehouses be adopted for latency-sensitive business intelligence applications, while SQL-on-Lake engines should be preferred for cloud-native environments requiring scalable, flexible, and cost-efficient analytics over diverse and rapidly growing datasets. The study contributes empirical evidence to support informed architectural decisions in modern data analytics.

Keywords

SQL-on-Lake, traditional data warehouse, analytical workloads, performance evaluation, query execution time, throughput, scalability, storage efficiency, cloud analytics, big data

References

[1] Armbrust M, Ghodsi A, Xin R, Zaharia M (2021). Lakehouse: A new generation of open platforms that unify data warehousing and advanced analytics. In: Proceedings of the Conference on Innovative Data Systems Research (CIDR).

[2] Azzabi S, Alfughi Z, Ouda A (2024). Data lakes: A survey of concepts and architectures. Computers, 13(7), 183. doi:10.3390/computers13070183

[3] Begoli E, Goethert I, Knight K (2021). A lakehouse architecture for the management and analysis of heterogeneous data for biomedical research and mega-biobanks. In: 2021 IEEE International Conference on Big Data. IEEE, pp. 4643–4651.

[4] Behm A, Palkar S, Agarwal U, Armstrong T, Cashman D, Dave A, et al. (2022). Photon: A fast query engine for lakehouse systems. In: Proceedings of the 2022 International Conference on Management of Data (SIGMOD ’22). ACM, pp. 2326–2339. doi:10.1145/3514221.3526054

[5] Chaudhuri S, Dayal U (1997). An overview of data warehousing and OLAP technology. ACM SIGMOD Record, 26(1), 65–74. doi:10.1145/248603.248616

[6] Errami SA, Hajji H, El Kadi KA, Badir H (2023). Spatial big data architecture: From data warehouses and data lakes to the LakeHouse. Journal of Parallel and Distributed Computing, 176, 70–79. doi:10.1016/j.jpdc.2023.02.007

[7] Hai R, Koutras C, Quix C, Jarke M (2023). Data lakes: A survey of functions and systems. IEEE Transactions on Knowledge and Data Engineering, 35(12), 12571–12590. doi:10.1109/TKDE.2023.3270101

[8] Harby AA, Zulkernine FH (2025). Data lakehouse: A survey and experimental study. Information Systems, 127, 102460. doi:10.1016/j.is.2024.102460

[9] Inmon WH (2005). Building the Data Warehouse (4th ed.). Indianapolis: Wiley.

[10] Kimball R, Ross M (2013). The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling (3rd ed.). Indianapolis: Wiley.

[11] Oliveira e Sá J, Gonçalves R, Kaldeich C (2024). Benchmark of market cloud data warehouse technologies. Procedia Computer Science, 246, 4077–4086.

[12] Sawadogo PN, Darmont J (2023). DLBench+: A benchmark for quantitative and qualitative data lake assessment. Data & Knowledge Engineering, 144, 102154. doi:10.1016/j.datak.2023.102154

[13] Schneider J, Gröger C, Lutsch A, Schwarz H, Mitschang B (2024). The lakehouse: State of the art on concepts and technologies. SN Computer Science, 5, 449. doi:10.1007/s42979-024-02737-0

[14] Stonebraker M, Abadi DJ, DeWitt DJ, Madden S, Paulson E, Pavlo A, Rasin A (2010). MapReduce and parallel DBMSs: Friends or foes? Communications of the ACM, 53(1), 64–71. doi:10.1145/1629175.1629197

[15] Szőke MA (2026). Modern alternatives to Hive: A systematic review and single-node benchmark of SQL-on-Hadoop and lakehouse engines. Information Systems, 136, 102635. doi:10.1016/j.is.2025.102635

[16] Zaharia M, Xin RS, Wendell P, Das T, Armbrust M, Dave A, et al. (2016). Apache Spark: A unified engine for big data processing. Communications of the ACM, 59(11), 56–65. doi:10.1145/2934664

How to cite this paper

Mission Franklin, Onyedikachi Iheanacho Nnadi "Performance Evaluation of SQL-on-Lake Engines and Traditional Data Warehouses for Analytical Workloads" Iconic Research And Engineering Journals Volume 10 Issue 5 2026 Page 3222-3234
Mission Franklin, Onyedikachi Iheanacho Nnadi "Performance Evaluation of SQL-on-Lake Engines and Traditional Data Warehouses for Analytical Workloads" Iconic Research And Engineering Journals, vol. 10, no. 5, Nov. 2026
Mission Franklin, Onyedikachi Iheanacho Nnadi (2026). Performance Evaluation of SQL-on-Lake Engines and Traditional Data Warehouses for Analytical Workloads. Iconic Research And Engineering Journals, 10(5).
Mission Franklin, Onyedikachi Iheanacho Nnadi "Performance Evaluation of SQL-on-Lake Engines and Traditional Data Warehouses for Analytical Workloads" Iconic Research And Engineering Journals, vol. 10, no. 5, Nov. 2026.
@article{1725270,
      author = {Mission Franklin, Onyedikachi Iheanacho Nnadi},
      title = {Performance Evaluation of SQL-on-Lake Engines and Traditional Data Warehouses for Analytical Workloads},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {10},
      number = {5},
      pages = {3222-3234},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1725270.pdf},
      abstract = {The rapid growth of big data and cloud computing has transformed the way organizations store, manage, and analyse large volumes of data. Among the emerging analytical platforms, SQL-on-Lake engines and traditional data warehouses have become widely adopted for supporting business intelligence and decision-making. However, selecting the most appropriate architecture remains challenging because each platform offers distinct advantages in terms of performance, scalability, and resource utilization. This study evaluated and compared the performance of SQL-on-Lake engines and traditional data warehouses for analytical workloads using an experimental approach. Performance evaluation was based on six metrics: query execution time, throughput, CPU utilization, memory utilization, scalability, and storage efficiency. The results showed that the traditional data warehouse consistently achieved lower query execution times, higher throughput, and more efficient CPU and memory utilization for structured analytical queries. In contrast, the SQL-on-Lake engine demonstrated superior scalability and storage efficiency, particularly as dataset size increased, making it more suitable for processing large-scale and heterogeneous datasets. The findings reveal that each architecture exhibits unique strengths depending on workload characteristics and operational requirements. The study concludes that neither architecture is universally superior for all analytical scenarios. It is therefore recommended that traditional data warehouses be adopted for latency-sensitive business intelligence applications, while SQL-on-Lake engines should be preferred for cloud-native environments requiring scalable, flexible, and cost-efficient analytics over diverse and rapidly growing datasets. The study contributes empirical evidence to support informed architectural decisions in modern data analytics.},
      keywords = {SQL-on-Lake, traditional data warehouse, analytical workloads, performance evaluation, query execution time, throughput, scalability, storage efficiency, cloud analytics, big data},
      month = {November},
  }