A Review of System Monitoring Architectures Using Prometheus, ELK Stack, and Custom Dashboards

• Author(s): Ejielo Ogbuefi ; Oyejide Timothy Odofin ; Abraham Ayodeji Abayomi ; Bolaji Iyanu Adekunle ; Oluwademilade Aderemi Agboola; Samuel Owoade
• Paper ID: 1708762
• Page: 408-419
• Published Date: 30-06-2021
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 4 Issue 12 June-2021

Abstract

System monitoring architectures play a critical role in ensuring the operational efficiency, performance, and security of modern IT infrastructures. This paper provides a comprehensive review of three prominent monitoring solutions—Prometheus, the ELK Stack (Elasticsearch, Logstash, and Kibana), and Custom Dashboards—evaluating their features, architecture, use cases, and benefits. Prometheus, an open-source time-series monitoring system, is ideal for large-scale, dynamic environments, particularly those utilizing microservices and cloud-native architectures. The ELK Stack offers a robust solution for log aggregation, search, and visualization, making it effective for security monitoring, log analysis, and performance management. Custom Dashboards, integrated with Prometheus or ELK, facilitate real-time visualization of key performance indicators, improving decision-making and responsiveness. Despite their strengths, these solutions present challenges, including scalability concerns, resource requirements, and integration complexities. The paper concludes with suggestions for future advancements in AI-driven monitoring, cross-platform integration, and automated configurations, aiming to enhance the adaptability and efficiency of monitoring systems in increasingly complex IT environments.

Keywords

System Monitoring, Prometheus, ELK Stack, Custom Dashboards, Real-Time Data Visualization, Log Aggregation

Citations

IRE Journals:
Ejielo Ogbuefi , Oyejide Timothy Odofin , Abraham Ayodeji Abayomi , Bolaji Iyanu Adekunle , Oluwademilade Aderemi Agboola; Samuel Owoade "A Review of System Monitoring Architectures Using Prometheus, ELK Stack, and Custom Dashboards" Iconic Research And Engineering Journals Volume 4 Issue 12 2021 Page 408-419

IEEE:
Ejielo Ogbuefi , Oyejide Timothy Odofin , Abraham Ayodeji Abayomi , Bolaji Iyanu Adekunle , Oluwademilade Aderemi Agboola; Samuel Owoade "A Review of System Monitoring Architectures Using Prometheus, ELK Stack, and Custom Dashboards" Iconic Research And Engineering Journals, 4(12)