Home / Current Issue / Paper 1709475
Review on Deep Learning-Based Approach to Intelligent Video Surveillance Systems
Subject area: Science,Engineering and Technology · Area of research: Deep Learning
Abstract
In recent years, the demand for more robust and Intelligent Video Surveillance Systems (IVSS) has grown due to the increasing need for public safety and security in both urban and remote environments. This study investigates the application of various techniques like Deep Learning (DL) and Machine Learning (ML) techniques in enhancing video surveillance systems considering anomaly detection, human behaviour recognition, violence detection and weapon identification. A comprehensive literature review was conducted for the assessment of performance, advantages and limitations of existing intelligent surveillance systems which highlighted that the capabilities of advanced models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs) and hybrid deep learning architectures in automatically analysing video footage, learning complex patterns and detecting threats in dynamic environments significantly outperform traditional methods in terms of accuracy, adaptability and operational efficiency. The study concludes that the integration of DL and ML into surveillance systems presents a promising direction for modern security infrastructure, which not only reduces the burden on human operators but also enhance real-time threat detection and response, making them indispensable tools for future surveillance applications.
Keywords
Video Surveillance; Deep Learning (DL); Machine Learning (ML); CNN; RNN; Human Behaviour
References
[1] Abba, S., Bizi, A. M., Lee, J. A., Bakouri, S., & Crespo, M. L. (2024). Real-time object detection, tracking, and monitoring framework for security surveillance systems. Heliyon, 10, e34922. https://doi.org/10.1016/j.heliyon.2024.e34922
[2] Afreen H., Kashif M., Shaheen Q., Alfaifi Y.H., & Ayaz M., (2023) IoT-Based Smart Surveillance System for High-Security Areas. Appl. Sci. 2023, 13, 8936. https://doi.org/10.3390/app13158936
[3] Bhagyalakshmi, P., Indhumathi, P., Lakshmi, R., &Bhavadharini, D. (2019). Real-time video surveillance for automated weapon detection. International Journal of Trend in Scientific Research and Development (IJTSRD), 465–470.
[4] CHIDI, E. U., UDANOR, C. N., & ANOLIEFO, E. (2024). Exploring the Depths of Visual Understanding: A Comprehensive Review on Real-Time Object of Interest Detection Techniques. Preprints. https://doi.org/10.20944/preprints202402.0583.v1
[5] Chunchwar P., Shelare U., Nagpure A., Patil R., Dhole D., & Shete R.M., (2024) Real Time Weapon Detection using YOLOv8 and Alert Mechanism. International Journal for Research in Applied Science & Engineering Technology (IJRASET) https://doi.org/10.22214/ijraset.2024.60177
[6] Dhumal R., Chandgude P., Jamdade S., Pise M., & Kadam P.N., (2024) Deep Learning-Driven Surveillance System for Anomaly Detection in Crowded Environments. International Research Journal of Modernization in Engineering, Technology and Science https://www.doi.org/10.56726/IRJMETS63195
[7] Ebere Uzoka Chidi, E Anoliefo, C Udanor, AT Chijindu, LO Nwobodo (2025)” A Blind navigation guide model for obstacle avoidance using distance vision estimation based YOLO-V8n; Journal of the Nigerian Society of Physical Sciences, 2292-229; https://doi.org/10.46481/jnsps.2025.2292
[8] Elharrouss, O., Almaadeed, N., & Al-Maadeed, S. (2021). A review of video surveillance systems. Journal of Visual Communication and Image Representation, 77, 103116. https://doi.org/10.1016/j.jvcir.2021.103116
[9] Febin, I. P., Jayasree, K., & Joy, P. T. (2020). Violence detection in videos for an intelligent surveillance system using MoBSIFT and movement filtering algorithm. Pattern Analysis and Applications, 23(2), 611–623.
[10] Ferguson, A. G. (2012). Predictive policing and reasonable suspicion. Emory Law Journal, 62(2), 259.
[11] Gervais N., (2023) Smart Surveillance System With Anomaly Detection At Home. Faculty Of Computing And Information Sciences Masters Of Sciences In Information Technology. University of Lay Adventists of Kigali. Reg.No: M02141/2022
[12] Ghazal, M., Vazquez, C., & Amer, A. (2007). Real-time automatic detection of vandalism behavior in video sequences. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (pp. 1056–1060).
[13] He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 770–778). https://doi.org/10.1109/CVPR.2016.90
[14] Huillcen-Baca H.A., Palomino-Valdivia F.d.L., & Gutierrez-Caceres J.C., (2024) Efficient Human Violence Recognition for Surveillance in Real Time. Sensors 2024, 24, 668. https://doi.org/10.3390/s24020668
[15] Hussain, S. A., & Salim, A. A. A. (2020). A real-time face emotion classification and recognition using a deep learning model. Journal of Physics: Conference Series, 1432, 012087. https://doi.org/10.1088/1742-6596/1432/1/012087
[16] James P. Suarez, J., & Naval, P. C. Jr. (2020). A survey on deep learning techniques for video anomaly detection. arXiv. https://arxiv.org/abs/2009.14146
[17] Jeon H., Kim H., Kim D., & Kim J., (2024) PASS-CCTV: Proactive Anomaly surveillance system for CCTV footage analysis in adverse environmental conditions. Expert Systems With Applications 254 (2024) 124391 https://doi.org/10.1016/j.eswa.2024.124391
[18] Kamble K., Jadhav P., Shanware A., &Chitte P., (2022) Smart Surveillance System for Anomaly Recognition. ITM Web of Conference 44, 02003 (2022) ICACC-2022 https://doi.org/10.1051/itmconf/20224402003
[19] Kekong P.E, Ajah I.A., Ebere U.C. (2019). Real-time drowsy driver monitoring and detection system using deep learning based behavioural approach. International Journal of Computer Sciences and Engineering 9 (1), 11-21
[20] Kusuma, T., & Ashwini, K. (2023). Real-time object detection and tracking design using deep learning with spatial-temporal mechanisms for video surveillance applications. In H. S. Saini, R. Sayal, A. Govardhan, & R. Buyya (Eds.), Innovations in Computer Science and Engineering. ICICSE 2022 (Lecture Notes in Networks and Systems, Vol. 565). Springer. https://doi.org/10.1007/978-981-19-7455-7_56
[21] Lao, W., Han, J., & De With, P. (2009). Automatic video-based human motion analyzer for consumer surveillance system. IEEE Transactions on Consumer Electronics, 55(2), 591–598.
[22] Li, Y. D., Hao, Z. B., & Lei, H. (2016). Survey of convolutional neural networks. Journal of Computer Applications, 36(9), 2508–2515.
[23] Mei, T., & Zhang, C. (2017). Deep learning for intelligent video analysis. In Proceedings of the 25th ACM International Conference on Multimedia (pp. 1955–1956).
[24] Mukto M., Hasan M., al-Mahmud M., Haque I., Ahmed A., Jabid T., Rashid M., Islam M.M., & Islam M., (2024) Design of a real-time crime monitoring system using deep learning techniques. Intelligent Systems with Applications 21 (2024) 200311 https://doi.org/10.1016/j.iswa.2023.200311
[25] Munemma, D., & Uma-Maheswari, K. V. (2024). Predicting robbery behavior potential in indoor security cameras using propounding first AI approach. Journal of Engineering Sciences, 15(06).
[26] Pablo, R. (2020). Deep Learning for Beginners: A Beginner’s Guide to Getting up and Running with Deep Learning from Scratch Using Python. Packt Publishing Ltd.
[27] Pass Security. (n.d.). Benefits of commercial video surveillance systems. Retrieved from https://www.passsecurity.com/benefits-of-commercial-video-surveillance-systems/
[28] Pooja B.R., Rajkumar N., (2024) Real-Time Intelligent Video Surveillance System using Recurrent Neural Network. International Conference on Machine Learning and Data Engineering (ICMLDE 2023) Procedia Computer Science 235 (2024) 1522–1531. 10.1016/j.procs.2024.04.143
[29] Porikli, F., Brémond, F., Dockstader, S. L., Ferryman, J., Hoogs, A., Lovell, B. C., Pankanti, S., Rinner, B., Tu, P., & Venetianer, P. L. (2013). Video surveillance: past, present, and now the future DSP forum. IEEE Signal Processing Magazine, 30(3), 190–198.
[30] Raksha., Ramyashree., Ganiga R., Nayak S.V., & Kini M., (2025) Machine learning Based Real Time Surveillance System for Anomaly Detection. Alvas Institute of Engineering and Technology
[31] Rashvand N., Noghre G.A., Pazho A.D., Yao S., &Tabkhi H., (2025) Exploring Pose-Based Anomaly Detection for Retail Security: A Real-World Shoplifting Dataset and Benchmark. arXiv:2501.06591v1 [cs.CV] 11 Jan 2025
[32] Sochima V.E. Asogwa T.C., Lois O.N. Onuigbo C.M., Frank E.O., Ozor G.O., Ebere U.C. (2025)”; Comparing multi-control algorithms for complex nonlinear system: An embedded programmable logic control applications;
[33] DOI: http://doi.org/10.11591/ijpeds.v16.i1.pp212-224
[34] Suarez, J. J. P., & Naval, P. C. (2020). A survey on deep learning techniques for video anomaly detection. arXiv preprint arXiv:2009.14146.
[35] Sultani, W., Chen, C., & Shah, M. (2018). Real-world anomaly detection in surveillance videos. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 6479–6488).
[36] Vijeikis R., Raudonis V., &Dervinis G., (2022) Efficient Violence Detection in Surveillance. Sensors 2022, 22, 2216. https://doi.org/10.3390/s22062216
[37] Yan, H., Liu, X., & Hong, R. (2016). Image classification via fusing the latent deep CNN feature. In Proceedings of the International Conference on Internet Multimedia Computing and Service (pp. 110–113).
How to cite this paper
@article{1709475,
author = {Ettebong Stephen James, Kingsley M. Udofia, Akaninyene B. Obot},
title = {Review on Deep Learning-Based Approach to Intelligent Video Surveillance Systems},
journal = {Iconic Research And Engineering Journals},
year = {2025},
volume = {9},
number = {1},
pages = {321-329},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1709475.pdf},
abstract = {In recent years, the demand for more robust and Intelligent Video Surveillance Systems (IVSS) has grown due to the increasing need for public safety and security in both urban and remote environments. This study investigates the application of various techniques like Deep Learning (DL) and Machine Learning (ML) techniques in enhancing video surveillance systems considering anomaly detection, human behaviour recognition, violence detection and weapon identification. A comprehensive literature review was conducted for the assessment of performance, advantages and limitations of existing intelligent surveillance systems which highlighted that the capabilities of advanced models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs) and hybrid deep learning architectures in automatically analysing video footage, learning complex patterns and detecting threats in dynamic environments significantly outperform traditional methods in terms of accuracy, adaptability and operational efficiency. The study concludes that the integration of DL and ML into surveillance systems presents a promising direction for modern security infrastructure, which not only reduces the burden on human operators but also enhance real-time threat detection and response, making them indispensable tools for future surveillance applications.},
keywords = {Video Surveillance; Deep Learning (DL); Machine Learning (ML); CNN; RNN; Human Behaviour},
month = {July},
}