Home / Current Issue / Paper 1700216
SIGN TO SPEECH AND DISPLAY CONVERTER
Subject area: Science,Engineering and Technology · Area of research: ELECTRONICS AND COMMUNICATION ENGINEERING
Abstract
This report presents a system VISION-BASED SIGN LANGUAGE TRANSLATION DEVICE for automatic translation of gestures into speech in English to assist the impaired people to communicate with hearing people. It can be used as a translator for people who do not understand sign language. The proposed system is an interactive application program developed by using MATLAB software and incorporated into Arduino board. The sign language gesture images are acquired using the inbuilt camera of the LAPTOP or Webcam; vision analysis functions are performed in the operating system and provide speech output through speaker which is in connection with APR33A3 the inbuilt audio device thereby minimizing hardware requirements and expense. The information is sent one after another through the Arduino in 8 bit format to reduce the error. This allows for almost instantaneous recognition from finger and hand movements to translation. This is able to recognize one handed sign representations of alphabets (A-Z) and numbers (0-9). The results are found to be highly consistent, reproducible, with fairly high precision and accuracy.
Keywords
sign language, MATLAB, GUI.
References
[1] Paschaloudi N. Vassilia, Margaritis G. Konstantinos “listening to deaf’: A Greek sign language translator’, 0-7803-9521- 2/06/$20.00 §2006IEEE.
[2] Beifang Yi Dr. Fredrick C. Harris ‘A Framework for a Sign Language Interfacing System’, A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Science and Engineering May 2006 University of Nevada, Reno.
[3] Helene Brashear & Thad Starner ‘Using Multiple Sensors for Mobile Sign Language Recognition’, ETH- Swiss Federal Institute of Technology Wearable Computing Laboratory 8092 Zurich, Switzerland flukowicz, Junker g@ife.eeethz.ch
[4] K. Abe, H. Saito, S. Ozawa: Virtual 3D Interface System via Hand Motion recognition From Two Cameras. IEEE Trans. Systems, Man, and Cybernetics, Vol. 32, No. 4, pp. 536-540, July 2002.
How to cite this paper
@article{1700216,
author = {ANUDEEP KOMERA, NAGESWARA GOUD, SRI HARSHA KATRAGADDA, NARAYANA SWAMY KATRAGADDA},
title = {SIGN TO SPEECH AND DISPLAY CONVERTER},
journal = {Iconic Research And Engineering Journals},
year = {2018},
volume = {1},
number = {8},
pages = {85-89},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1700216.pdf},
abstract = {This report presents a system VISION-BASED SIGN LANGUAGE TRANSLATION DEVICE for automatic translation of gestures into speech in English to assist the impaired people to communicate with hearing people. It can be used as a translator for people who do not understand sign language. The proposed system is an interactive application program developed by using MATLAB software and incorporated into Arduino board. The sign language gesture images are acquired using the inbuilt camera of the LAPTOP or Webcam; vision analysis functions are performed in the operating system and provide speech output through speaker which is in connection with APR33A3 the inbuilt audio device thereby minimizing hardware requirements and expense. The information is sent one after another through the Arduino in 8 bit format to reduce the error. This allows for almost instantaneous recognition from finger and hand movements to translation. This is able to recognize one handed sign representations of alphabets (A-Z) and numbers (0-9). The results are found to be highly consistent, reproducible, with fairly high precision and accuracy.},
keywords = {sign language, MATLAB, GUI.},
month = {February},
}