Indian Sign Language Recognition System

References

[1] TensorFlow Documentation, TensorFlow Machine Learning Framework. Available at: https://www.tensorflow.org

[2] Keras API Reference, Deep Learning Library for Python. Available at: https://keras.io

[3] Mediapipe by Google, Cross-platform Machine Learning Framework. Available at: https://mediapipe.dev

[4] OpenCV-Python Tutorials, Open Source Computer Vision Library Documentation. Available at: https://docs.opencv.org

[5] Google Text-to-Speech (gTTS) Documentation, Python Speech Synthesis Library. Available at: https://gtts.readthedocs.io

[6] Research Paper: Real-Time Sign Language Recognition using Deep Learning and Computer Vision, IEEE Publications.

[7] Indian Sign Language Dictionary, Rehabilitation Council of India (RCI). Available at: https://www.indiansignlanguage.org [8]Brownlee, J., Deep Learning for Computer Vision, Machine Learning Mastery Series, 2020.

[8] Python Official Documentation. Available at: https://docs.python.org

[9] Sheela, B.P., Girisha, H. & Sreepathi, B. (2025). An Efficient EPReLU-CSGNN-MALSTCAM and SSOA-Based Explainable Artificial Intelligence (XAI) to Generate Textual Explanations. SN Computer Science, 6, 594. https://doi.org/10.1007/s42979-025-04115-w

[10] Sheela, B.P., & Girisha, H. (2024). An Exploration on Explainable AI with Background and Motivation for XAI. In: Basha, S.M., Taherdoost, H., Zanchettin, C. (eds) Innovations in Cybersecurity and Data Science (ICICDS 2024). Springer, Singapore. https://doi.org/10.1007/978-981-97-5791-6_36

[11] Sheela, B. P., & Girisha, H. (2024). An Explainable Artificial Intelligence (XAI) Framework for Deep Learning Based Classification to Generate Textual Explanations on Predicted Images. International Journal of Intelligent Engineering & Systems, 17(6), 651–662.https://doi.org/10.22266/ijies2024.1231.50

[12] Sheela B. P., Sanganal, K., Girish, Sharanegouda G., Rajashekhar R., & Sreepathi, B. (2023). Physiotherapy Assistance Application for Physically Disabled People Using Computer Vision. International Research Journal of Modernization in Engineering Technology and Science (IRJMETS), 5(5), 1256. https://doi.org/10.56726/IRJMETS38402

[13] Sheela B.P., Siddana M., Mounika H., Abhishek N., Swathi N. M., Prof P., & Dr. Sreepathi. (2022). Crop Yield Prediction based on Indian Agriculture using Machine Learning. International Journal of Advanced Research in Science, Communication and Technology, 53–57. https://doi.org/10.48175/IJARSCT-5881

@article{1712873,
      author = {A. R. Pragna, Akki Likitha, Hema Sree, Kavya. K, Sheela. B. P; Dr. B. Sreepathi},
      title = {Indian Sign Language Recognition System},
      journal = {Iconic Research And Engineering Journals},
      year = {2025},
      volume = {9},
      number = {6},
      pages = {1733-1736},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1712873.pdf},
      abstract = {Communication barriers between the hearing-impaired, speech-impaired, and non-signers create persistent challenges in education, healthcare, and daily interactions. While Indian Sign Language (ISL) is widely used within the deaf community, the lack of public awareness significantly limits effective communication. This paper presents a real-time ISL Recognition System developed using deep learning and computer vision. The system captures hand gestures through a webcam, extracts 21 hand landmarks using Google Mediapipe, and classifies them using a trained Convolutional Neural Network (CNN). The recognized gestures are translated into text and speech for better accessibility. In addition to gesture recognition, the system provides speech-to-text functionality to enable two-way communication between hearing and non-hearing users. The proposed solution is lightweight, cost-effective, and easy to deploy, making it suitable for educational institutions, assistive technologies, and inclusive digital platforms. The results demonstrate high accuracy and robust performance, validating the effectiveness of the proposed framework.},
      keywords = {Indian Sign Language, Deep Learning, Gesture Recognition, CNN, Mediapipe.},
      month = {December},
      doi = {https://doi.org/10.64388/IREV9I6-1712873}
  }