Home / Current Issue / Paper 1710047
An Analysis of Support Vector Machines and Decision Trees in Handwritten Digits Recognition
Subject area: Science,Engineering and Technology · Area of research: Machine Learning
Abstract
A Support Vector Machines (SVMs) and Decision Trees in handwritten digits recognition. The primary research aim is to find performance and suitability of these algorithms. Most of the time, the physically constructed digits are not inside the domains of proportionate size, due to the similarities between the numbers, such as 1 and 7, 5 and 6, 3 and 8, 2 and 5, 2 and 7. The performance and accuracy of machine learning algorithms heavily depend on the quality and diversity of the dataset used for training and testing. This research limited by the availability of suitable handwritten digit datasets (MNIST), which impact the generalizability of the results. Using MNIST dataset consists of a large number of 28x28 pixel grayscale images of handwritten digits (0 through 9) and 60,000 Training Images and 10,000 Testing. In this study, different machine learning methods, which are SVM and Decision Trees architectures are used to achieve high performance on the digit string recognition problem. In these methods, images of digit strings are trained with the SVM and Decision Trees model methods structure by sliding a fixed size window through the images labeling each sub-image as a part of a digit or not. The research ultimately revealed that Support Vector Machines was the classifier, with 98% accuracy. The lowest score of accuracy goes to Decision Tree with 96% of accuracy and we Recommend the Use of SVM as the Best Algorithms for the handwritten digits recognition but also we suggest that combination of difference Datasets for more accuracy of the recognition MNIST dataset a most of U.S written style..
Keywords
Machine Learning, Support Vector Machine, Decision Tree, MNIST, digit recognition and Data Set.
References
[1] Aruna Jyothi, & Saideep Reddy. (2021). Handwritten digit recognition using double convolution neural network. Ijcrt, 2320-2882.
[2] Chakraborty, P., Jahanapi, S. S., & Choudhury, T. (2022). Bangla handwritten digit recognition. In J. M. R. S. Tavares et al. (Eds.), Cyber intelligence and information retrieval (Lecture Notes in Networks and Systems, Vol. 291, pp. page numbers of the relevant chapter). Springer Nature Singapore Pte Ltd. https://
[3] Geetha, S., & Malathi, K. (2023). SVM vs decision tree algorithm: Cost effective comparison to enhance crime detection and prevention. Journal of Survey in Fisheries Sciences, 10(1S), 2814-2822.
[4] Gomathy, C. K., & Jaya Sairam, K. (2021). The handwritten digits recognition. International Journal of Engineering Applied Sciences and Technology, 6(7), 203-206. Retrieved from http://www.ijeast.com
[5] Kumar, C. V., & Sriramya, P. (2022). Comparison of SVM algorithms with decision trees for accurate recognition to handwritten digits to improve the accuracy value. Baltic Journal of Law & Politics, 15(4), 295-303. https://
[6] Kusetogullari, H., Yavariabdi, A., Hall, J., & Lavesson, N. (2021). DIGITNET: A deep handwritten digit detection and recognition method using a new historical handwritten digit dataset. Big Data Research, 23, 100182.
[7] Mendes Gil, & Ferreira. (2014). Handwritten digit recognition using SVM binary classifiers and unbalanced decision trees. International Publishing Switzerland.
[8] Nader, L., Mohamed, A., Nazir, M., & Awadalla, M. (2018). Identification of writer's gender using handwriting analysis. International Journal of Scientific and Research Publications, 8(10), 728. https://
[9] Priya, Singh, R., & Changlani, S. (2017). Review on handwritten digit recognition. International Journal of Novel Research and Development (IJNRD), 2(4), 91.
[10] Raj, A., Sharma, S., Singh, J., & Singh, A. (2023). Revolutionizing data entry: An in-depth study of optical character recognition technology and its future potential. International Journal for Research in Applied Science & Engineering Technology (IJRASET), 11(2), 645.
[11] Rajput, P., Nahar, J., & Kumar, S. (2021). Handwritten digit recognition using Python [Review of handwritten digit recognition using Python]. Ijcrt, 2320-2882(2320-2882).
[12] Rathore, L., & Yadav, R. (2023). Advancements in handwritten digit recognition: A literature review of machine learning and deep learning approaches. International Journal for Research in Applied Science & Engineering Technology (IJRASET), 11(8), 1879
[13] Rzayeva, L., Myrzatay, A., Abitova, et al. (2023). Enhancing LAN failure predictions with decision trees and SVMs: Methodology and implementation.
[14] Sharma, D., Singh, I., & Pandey, U. (2022). Handwritten digit recognition. International Research Journal of Engineering and Technology (IRJET), 09(06), 1185.
[15] Singh, P., Pawar, P., & Raj, N. (2022). Handwritten digit recognition. International Journal for Research in Applied Science & Engineering Technology (IJRASET), 10(5), 75.
[16] Chakraborty, P., Jahanapi, S. S., & Choudhury, T. (2022). Bangla handwritten digit recognition. In J. M. R. S. Tavares et al. (Eds.), Cyber intelligence and information retrieval (Lecture Notes in Networks and Systems, Vol. 291, pp. page numbers of the relevant chapter). Springer Nature Singapore Pte Ltd. https://
[17] Rani, S., Ur Rehman, A., Yousaf, B., Tayyab Rauf, H., Abouel Nasr, E., & Kadry, S. (2022). Recognition of handwritten medical prescription using signature verification techniques. ncbi.nlm.nih.gov
[18] Pashine, S., Dixit, R., & Kushwah, R. (2021). Handwritten digit recognition using machine and deep learning algorithms
[19] Hamdi, Y., Akouaydi, H., Boubaker, H., & Alimi, A. M. (2020). Handwriting quality analysis using online-offline models
[20] Liu, X., Guo, L., Wang, H., Guo, J., Yang, S., & Duan, L. (2022). Research on imbalance machine learning methods for MR[Formula: see text] WI soft tissue sarcoma data. ncbi.nlm.nih.gov
[21] Gornale, S., Kumar, S., Patil, A., & Hiremath, P. S. (2021). Behavioral biometric data analysis for gender classification using feature fusion and machine learning. ncbi.nlm.nih.gov
[22] Singh, A., Sharma, A., Ahmed, A., Sundramoorthy, A. K., Furukawa, H., Arya, S., & Khosla, A. (2021). Recent advances in electrochemical biosensors: Applications, challenges, and future scope. ncbi.nlm.nih.gov
[23] Dinges, L., Al-Hamadi, A., Elzobi, M., & El- etriby, S. (2016). Synthesis of common Arabic handwritings to aid optical character recognition research. ncbi.nlm.nih.gov
[24] Saha, D., & Manickavasagan, A. (2021). Machine learning techniques for analysis of hyperspectral images to determine quality of food products: A review. ncbi.nlm.nih.gov
[25] Sharma, A. (2012). Handwritten digit recognition using support vector machine
How to cite this paper
@article{1710047,
author = {Kabiru Labaran Bala, Dr Musa Argungu, Dr Dan Lami Gabi, Aminu Labaran, Abubakar Abduraruaf},
title = {An Analysis of Support Vector Machines and Decision Trees in Handwritten Digits Recognition},
journal = {Iconic Research And Engineering Journals},
year = {2025},
volume = {9},
number = {2},
pages = {377-385},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1710047.pdf},
abstract = {A Support Vector Machines (SVMs) and Decision Trees in handwritten digits recognition. The primary research aim is to find performance and suitability of these algorithms. Most of the time, the physically constructed digits are not inside the domains of proportionate size, due to the similarities between the numbers, such as 1 and 7, 5 and 6, 3 and 8, 2 and 5, 2 and 7. The performance and accuracy of machine learning algorithms heavily depend on the quality and diversity of the dataset used for training and testing. This research limited by the availability of suitable handwritten digit datasets (MNIST), which impact the generalizability of the results. Using MNIST dataset consists of a large number of 28x28 pixel grayscale images of handwritten digits (0 through 9) and 60,000 Training Images and 10,000 Testing. In this study, different machine learning methods, which are SVM and Decision Trees architectures are used to achieve high performance on the digit string recognition problem. In these methods, images of digit strings are trained with the SVM and Decision Trees model methods structure by sliding a fixed size window through the images labeling each sub-image as a part of a digit or not. The research ultimately revealed that Support Vector Machines was the classifier, with 98% accuracy. The lowest score of accuracy goes to Decision Tree with 96% of accuracy and we Recommend the Use of SVM as the Best Algorithms for the handwritten digits recognition but also we suggest that combination of difference Datasets for more accuracy of the recognition MNIST dataset a most of U.S written style..},
keywords = {Machine Learning, Support Vector Machine, Decision Tree, MNIST, digit recognition and Data Set.},
month = {August},
}