Home / Current Issue / Paper 1724619
Comparative Analysis of Machine Learning Models for Diabetes Prediction
Subject area: Science,Engineering and Technology · Area of research: Machine Learning
Abstract
Early detection of diabetes can reduce serious complications. This paper compares eight supervised machine learning classifiers—Logistic Regression, k-Nearest Neighbors, Support Vector Machine, Naive Bayes, Decision Tree, Random Forest, AdaBoost and Gradient Boosting—for diabetes prediction on the Pima Indians Diabetes dataset (768 records, 8 features). All models share the same preprocessing and are evaluated with a hold-out test set, 10-fold cross-validation repeated three times, hyperparameter tuning, and class weighting, using accuracy, precision, recall, F1-score and ROC-AUC. Under repeated cross-validation, Gradient Boosting had the highest accuracy (76.9%) and F1-score (0.649), while Logistic Regression had the highest ROC-AUC (0.837). The Decision Tree detected the most diabetic cases on the test set (72.2% recall). Class weighting raised the recall of Logistic Regression from 50.0% to 70.4%. Differences between the top models were within one standard deviation, and glucose was the most influential feature.
Keywords
diabetes prediction; machine learning; classification; model comparison; cross-validation; Pima Indians dataset
References
[1] Kavakiotis I, Tsave O, Salifoglou A, Maglaveras N, Vlahavas I, Chouvarda I. Machine learning and data mining methods in diabetes research. Computational and Structural Biotechnology Journal. 2017;15:104–116.
[2] Smith JW, Everhart JE, Dickson WC, Knowler WC, Johannes RS. Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In: Proceedings of the Annual Symposium on Computer Application in Medical Care; 1988. p. 261–265.
[3] Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research. 2011;12:2825–2830.
[4] Cox DR. The regression analysis of binary sequences. Journal of the Royal Statistical Society: Series B. 1958;20(2):215–242.
[5] Cover T, Hart P. Nearest neighbor pattern classification. IEEE Transactions on Information Theory. 1967;13(1):21–27.
[6] Cortes C, Vapnik V. Support-vector networks. Machine Learning. 1995;20(3):273–297.
[7] Hastie T, Tibshirani R, Friedman J. The elements of statistical learning. 2nd ed. New York (NY): Springer; 2009.
[8] Quinlan JR. Induction of decision trees. Machine Learning. 1986;1(1):81–106.
[9] Breiman L. Random forests. Machine Learning. 2001;45(1):5–32.
[10] Freund Y, Schapire RE. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences. 1997;55(1):119–139.
[11] Friedman JH. Greedy function approximation: A gradient boosting machine. Annals of Statistics. 2001;29(5):1189–1232.
[12] Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters. 2006;27(8):861–874.
How to cite this paper
@article{1724619,
author = {Jayanthi M, Amrit Rijal},
title = {Comparative Analysis of Machine Learning Models for Diabetes Prediction},
journal = {Iconic Research And Engineering Journals},
year = {2026},
volume = {10},
number = {5},
pages = {279-285},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1724619.pdf},
abstract = {Early detection of diabetes can reduce serious complications. This paper compares eight supervised machine learning classifiers—Logistic Regression, k-Nearest Neighbors, Support Vector Machine, Naive Bayes, Decision Tree, Random Forest, AdaBoost and Gradient Boosting—for diabetes prediction on the Pima Indians Diabetes dataset (768 records, 8 features). All models share the same preprocessing and are evaluated with a hold-out test set, 10-fold cross-validation repeated three times, hyperparameter tuning, and class weighting, using accuracy, precision, recall, F1-score and ROC-AUC. Under repeated cross-validation, Gradient Boosting had the highest accuracy (76.9%) and F1-score (0.649), while Logistic Regression had the highest ROC-AUC (0.837). The Decision Tree detected the most diabetic cases on the test set (72.2% recall). Class weighting raised the recall of Logistic Regression from 50.0% to 70.4%. Differences between the top models were within one standard deviation, and glucose was the most influential feature.},
keywords = {diabetes prediction; machine learning; classification; model comparison; cross-validation; Pima Indians dataset},
month = {November},
}