International Peer-Reviewed Journal•Open Access•ISSN 2456-8880
[email protected]•+91-7433024337

Home / Current Issue / Paper 1724619

1724619 Vol 10 · Issue 5 Download Paper

Comparative Analysis of Machine Learning Models for Diabetes Prediction

Jayanthi M Amrit Rijal

Subject area: Science,Engineering and Technology  ·  Area of research: Machine Learning

Abstract

Early detection of diabetes can reduce serious complications. This paper compares eight supervised machine learning classifiers—Logistic Regression, k-Nearest Neighbors, Support Vector Machine, Naive Bayes, Decision Tree, Random Forest, AdaBoost and Gradient Boosting—for diabetes prediction on the Pima Indians Diabetes dataset (768 records, 8 features). All models share the same preprocessing and are evaluated with a hold-out test set, 10-fold cross-validation repeated three times, hyperparameter tuning, and class weighting, using accuracy, precision, recall, F1-score and ROC-AUC. Under repeated cross-validation, Gradient Boosting had the highest accuracy (76.9%) and F1-score (0.649), while Logistic Regression had the highest ROC-AUC (0.837). The Decision Tree detected the most diabetic cases on the test set (72.2% recall). Class weighting raised the recall of Logistic Regression from 50.0% to 70.4%. Differences between the top models were within one standard deviation, and glucose was the most influential feature.

Keywords

diabetes prediction; machine learning; classification; model comparison; cross-validation; Pima Indians dataset

References

[1] Kavakiotis I, Tsave O, Salifoglou A, Maglaveras N, Vlahavas I, Chouvarda I. Machine learning and data mining methods in diabetes research. Computational and Structural Biotechnology Journal. 2017;15:104–116.

[2] Smith JW, Everhart JE, Dickson WC, Knowler WC, Johannes RS. Using the ADAP learning algorithm to forecast the onset of diabetes mellitus. In: Proceedings of the Annual Symposium on Computer Application in Medical Care; 1988. p. 261–265.

[3] Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research. 2011;12:2825–2830.

[4] Cox DR. The regression analysis of binary sequences. Journal of the Royal Statistical Society: Series B. 1958;20(2):215–242.

[5] Cover T, Hart P. Nearest neighbor pattern classification. IEEE Transactions on Information Theory. 1967;13(1):21–27.

[6] Cortes C, Vapnik V. Support-vector networks. Machine Learning. 1995;20(3):273–297.

[7] Hastie T, Tibshirani R, Friedman J. The elements of statistical learning. 2nd ed. New York (NY): Springer; 2009.

[8] Quinlan JR. Induction of decision trees. Machine Learning. 1986;1(1):81–106.

[9] Breiman L. Random forests. Machine Learning. 2001;45(1):5–32.

[10] Freund Y, Schapire RE. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences. 1997;55(1):119–139.

[11] Friedman JH. Greedy function approximation: A gradient boosting machine. Annals of Statistics. 2001;29(5):1189–1232.

[12] Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters. 2006;27(8):861–874.

How to cite this paper

Jayanthi M, Amrit Rijal "Comparative Analysis of Machine Learning Models for Diabetes Prediction" Iconic Research And Engineering Journals Volume 10 Issue 5 2026 Page 279-285
Jayanthi M, Amrit Rijal "Comparative Analysis of Machine Learning Models for Diabetes Prediction" Iconic Research And Engineering Journals, vol. 10, no. 5, Nov. 2026
Jayanthi M, Amrit Rijal (2026). Comparative Analysis of Machine Learning Models for Diabetes Prediction. Iconic Research And Engineering Journals, 10(5).
Jayanthi M, Amrit Rijal "Comparative Analysis of Machine Learning Models for Diabetes Prediction" Iconic Research And Engineering Journals, vol. 10, no. 5, Nov. 2026.
@article{1724619,
      author = {Jayanthi M, Amrit Rijal},
      title = {Comparative Analysis of Machine Learning Models for Diabetes Prediction},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {10},
      number = {5},
      pages = {279-285},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1724619.pdf},
      abstract = {Early detection of diabetes can reduce serious complications. This paper compares eight supervised machine learning classifiers—Logistic Regression, k-Nearest Neighbors, Support Vector Machine, Naive Bayes, Decision Tree, Random Forest, AdaBoost and Gradient Boosting—for diabetes prediction on the Pima Indians Diabetes dataset (768 records, 8 features). All models share the same preprocessing and are evaluated with a hold-out test set, 10-fold cross-validation repeated three times, hyperparameter tuning, and class weighting, using accuracy, precision, recall, F1-score and ROC-AUC. Under repeated cross-validation, Gradient Boosting had the highest accuracy (76.9%) and F1-score (0.649), while Logistic Regression had the highest ROC-AUC (0.837). The Decision Tree detected the most diabetic cases on the test set (72.2% recall). Class weighting raised the recall of Logistic Regression from 50.0% to 70.4%. Differences between the top models were within one standard deviation, and glucose was the most influential feature.},
      keywords = {diabetes prediction; machine learning; classification; model comparison; cross-validation; Pima Indians dataset},
      month = {November},
  }