Current Volume 9
Autonomous Data Mining Systems for Real-Time Big Data Streams in Edge AI: A Comprehensive Survey
Abstract
The exponential growth of real-time big data streams generated by IoT devices, cyber-physical systems, and distributed sensors has necessitated the evolution of autonomous data mining systems capable of operating efficiently at the network edge. Traditional cloud-centric analytics architectures suffer from high latency, bandwidth overhead, and privacy risks, limiting their suitability for time-sensitive applications. This survey presents a comprehensive review of autonomous data mining systems for real-time big data streams within Edge AI environments. The study systematically analyzes over 120 recent research contributions (2018–2025), categorizing approaches into stream mining algorithms, online learning frameworks, distributed edge intelligence models, federated mining strategies, and self-adaptive optimization mechanisms. Key statistical insights indicate that nearly 68% of recent frameworks employ deep learning–based stream processing models, while 54% integrate adaptive concept drift detection techniques to maintain model robustness in dynamic environments. Furthermore, approximately 47% of surveyed systems incorporate privacy-preserving mechanisms such as federated learning and differential privacy to address edge-level data security challenges. The survey evaluates methodologies based on latency performance, computational efficiency, scalability, autonomy level, and energy consumption. Comparative analysis reveals that hybrid adaptive mining architectures demonstrate up to 35% improvement in real-time decision latency compared to static edge models. The paper concludes by identifying open research challenges, including autonomous model orchestration, resource-aware self-optimization, explainable stream mining, and trust-aware decentralized intelligence. Future research directions emphasize integrating reinforcement learning–driven adaptability and lightweight generative models for continuous stream evolution. This survey provides a structured taxonomy, performance benchmarking synthesis, and a research roadmap to advance next-generation autonomous Edge AI data mining systems.
Keywords
Autonomous Data Mining, Real-Time Big Data Streams, Edge AI Stream Mining Algorithms, Concept Drift Detection, Federated Learning, Distributed Edge Intelligence.
Citations
IRE Journals:
A. Deepa, Dr. A. S. Naveen Kumar "Autonomous Data Mining Systems for Real-Time Big Data Streams in Edge AI: A Comprehensive Survey" Iconic Research And Engineering Journals Volume 9 Issue 12 2026 Page 1797-1814 https://doi.org/10.64388/IREV9I12-1719005
IEEE:
A. Deepa, Dr. A. S. Naveen Kumar
"Autonomous Data Mining Systems for Real-Time Big Data Streams in Edge AI: A Comprehensive Survey" Iconic Research And Engineering Journals, 9(12) https://doi.org/10.64388/IREV9I12-1719005
About IRE Journals
IRE Journals is an open access online journals established with an aim to publish high quality of research work in various diciplines. We have more than 6 years in publications. Over 2500+ papers already published.
Important Links
For Authors
Volume 8:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 7:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 6:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 5:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 4:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 3:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12