Home / Current Issue / Paper 1722134
Score, Review, Retrain: A Closed-Loop Architecture for Real-Time Fraud Detection with Human-Verified Model Retraining in Digital Banking
Subject area: Science,Engineering and Technology · Area of research: Machine Learning
DOI: https://doi.org/10.64388/IREV10I2-1722134
Abstract
The expansion of digital banking has widened the surface available to transaction fraud, and fraud detection mechanisms built on static, predefined rules have struggled to keep pace with fraud patterns that change faster than the rules describing them. Most published machine learning approaches to this problem evaluate a trained classifier against a fixed, offline dataset, without describing how that classifier would be embedded into a live transaction pipeline or how it would continue to improve once deployed. This paper presents the design, implementation, and evaluation of a fraud detection system in which risk scoring, human review, and model retraining are integrated into a single closed loop within a working digital banking backend, rather than treated as separate offline concerns. Every fund transfer and withdrawal is scored in real time by a Gradient Boosting classifier trained on more than forty behavioral, temporal, and velocity-derived features; transactions exceeding a configured risk threshold are withheld pending review by a human analyst, and confirmed outcomes are incorporated into subsequent, automatically scheduled retraining cycles. The system was evaluated on synthetically generated transaction data of two different sizes, with the final deployed configuration achieving an area under the receiver operating characteristic curve (AUC) of 0.94 and, at a class-balancing ratio tuned specifically to preserve precision, a precision of 0.24 with a recall of 0.57 at an F1-optimal decision threshold. Gradient Boosting is further compared against Logistic Regression and Random Forest baselines trained and evaluated under identical conditions. The results and their trade-offs are discussed in relation to dataset size, class-imbalance correction, and decision-threshold selection, and the paper concludes with a candid account of the system's limitations and directions for future work.
Keywords
Automated Retraining, Class Imbalance, Digital Banking, Fraud Detection, Gradient Boosting, Human-In-The-Loop, Machine Learning Operations, Real-Time Systems
References
[1] E. Minastireanu and G. Mesnita, "An analysis of the most used machine learning algorithms for online fraud detection," Informatica Economica, vol. 23, no. 1, 2019.
[2] J. O. Awoyemi, A. O. Adetunmbi, and S. A. Oluwadare, "Credit card fraud detection using machine learning techniques: A comparative analysis," in Proc. Int. Conf. Computing Networking and Informatics (ICCNI), 2017, pp. 1-9.
[3] D. Varmedja, M. Karanovic, S. Sladojevic, M. Arsenovic, and A. Anderla, "Credit card fraud detection — Machine learning methods," in Proc. 18th Int. Symp. INFOTEH-JAHORINA, 2019, pp. 1-5.
[4] J. H. Friedman, "Greedy function approximation: A gradient boosting machine," Annals of Statistics, vol. 29, no. 5, pp. 1189- 1232, 2001.
[5] T. Chen and C. Guestrin, "XGBoost: A scalable tree boosting system," in Proc. 22nd ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, 2016, pp. 785- 794.
[6] S. K. Hashemi, S. L. Mirtaheri, and S. Greco, "Fraud detection in banking data by machine learning techniques," IEEE Access, vol. 10, pp. 1-15, 2022.
[7] A. C. Bahnsen, D. Aouada, A. Stojanovic, and B. Ottersten, "Feature engineering strategies for credit card fraud detection," Expert Systems with Applications, vol. 51, pp. 134- 142, 2016.
[8] M. F. Manzoor and M. F. Aslam, "Enhancing banking fraud detection: Role of machine learning and deep learning methods," International Journal of Artificial Intelligence, 2025.
[9] A. Dal Pozzolo, O. Caelen, Y.-A. Le Borgne, S. Waterschoot, and G. Bontempi, "Calibrating probability with undersampling for unbalanced classification," in Proc. IEEE Symp. Series on Computational Intelligence, 2015, pp. 159-166.
[10] M. Zaharia et al., "Accelerating the machine learning lifecycle with MLflow," IEEE Data Engineering Bulletin, vol. 41, no. 4, pp. 39-45, 2018.
[11] N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic minority over-sampling technique," Journal of Artificial Intelligence Research, vol. 16, pp. 321-357, 2002.
[12] P. Kadam, "Enhancing financial fraud detection with human-in-the-loop feedback and feedback propagation," arXiv preprint arXiv:2411.05859, 2024.
[13] B. Borketey, "Real-time fraud detection using machine learning," Journal of Data Analysis and Information Processing, vol. 12, pp. 189- 209, 2024.
[14] S. Huy, S. Ang, M. Ho, and V. Balasubramaniam, "An AI-driven behavioral analytics framework for real-time fraud detection in financial institutions," in Proc. Int. Conf. Recent Innovations in Science and Technology (ICRIST), 2026.
[15] M. Z. I. Sany, Z. Wubo, and S. Alam, "Optimized hybrid machine learning model for real-time financial fraud detection," Control Systems and Optimization Letters, vol. 4, no. 2, pp. 205-210, 2026.
How to cite this paper
@article{1722134,
author = {Aaisha Farooq},
title = {Score, Review, Retrain: A Closed-Loop Architecture for Real-Time Fraud Detection with Human-Verified Model Retraining in Digital Banking},
journal = {Iconic Research And Engineering Journals},
year = {2026},
volume = {10},
number = {2},
pages = {449-459},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1722134.pdf},
abstract = {The expansion of digital banking has widened the surface available to transaction fraud, and fraud detection mechanisms built on static, predefined rules have struggled to keep pace with fraud patterns that change faster than the rules describing them. Most published machine learning approaches to this problem evaluate a trained classifier against a fixed, offline dataset, without describing how that classifier would be embedded into a live transaction pipeline or how it would continue to improve once deployed. This paper presents the design, implementation, and evaluation of a fraud detection system in which risk scoring, human review, and model retraining are integrated into a single closed loop within a working digital banking backend, rather than treated as separate offline concerns. Every fund transfer and withdrawal is scored in real time by a Gradient Boosting classifier trained on more than forty behavioral, temporal, and velocity-derived features; transactions exceeding a configured risk threshold are withheld pending review by a human analyst, and confirmed outcomes are incorporated into subsequent, automatically scheduled retraining cycles. The system was evaluated on synthetically generated transaction data of two different sizes, with the final deployed configuration achieving an area under the receiver operating characteristic curve (AUC) of 0.94 and, at a class-balancing ratio tuned specifically to preserve precision, a precision of 0.24 with a recall of 0.57 at an F1-optimal decision threshold. Gradient Boosting is further compared against Logistic Regression and Random Forest baselines trained and evaluated under identical conditions. The results and their trade-offs are discussed in relation to dataset size, class-imbalance correction, and decision-threshold selection, and the paper concludes with a candid account of the system's limitations and directions for future work.},
keywords = {Automated Retraining, Class Imbalance, Digital Banking, Fraud Detection, Gradient Boosting, Human-In-The-Loop, Machine Learning Operations, Real-Time Systems},
month = {August},
doi = {https://doi.org/10.64388/IREV10I2-1722134}
}