ASL Finger Spelling Recognition System for Interactive Learning and Education Purpose

Authors

  • J. H. Koh Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Parit Raja, 86400 Batu Pahat, Johor, Malaysia.
  • S. H. A. Ali Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Parit Raja, 86400 Batu Pahat, Johor, Malaysia.

Keywords:

ASL Finger Spelling, Hand Gesture Recognition, MATLAB,

Abstract

The learning platforms for sign language are very limited. Images and videos are usually used to deliver the process of sign language learning. However, sign language is complicated and hard to practice. Thus, a vision-based American Sign Language (ASL) finger spelling recognition system is developed and presented in this paper. The aim of this project is to help users to learn and practice the sign language. ASL is the most common used sign language around the world. Five ASL finger spellings are used as the data set in this project which are 'A', 'E', 'I', 'O' and 'U'. MATLAB software was used to design the graphical user interface (GUI) of the system. The GUI is divided into 3 parts which are Learn, Test and Quiz. The input image was captured by webcam and then converted into HSV color space for segmentation. Recognition process was done by computing 2D correlation coefficient between input testing images and database training images. The accuracy and processing time of 500 testing images with 100 training images are 97.8% and 0.9434 seconds respectively. The challenges of vision-based hand gesture recognition system such as the complexity background and background color were analyzed and they are presented in this paper.

References

S. Barve, K. Dhatavkar, S. Singh, V. Baghele and A. Jethwani , "Hand Gesture Recognition Method for Human," International Journal of Information & Computation Technology, vol. 2, no. 2, 2012, pp. 57-62.

S. Salian, P. Ganorkar and D. Serai, "Hand Gesture Recognition and Cursor Control," ResearchGate, Mumbai, 2015.

R.Z. Khan and N.A. Ibraheem, "Survey on Gesture Recognition for Hand Image Postures," Computer and Information Science, vol. 5, no. 3, 2012, pp. 110-121.

Z. Jachova, O. Kovacheva and A. Karovska, "Differences Between American Sign Language (ASL) and British Sign Language (BSL)," Special Education and Rehabilitation, vol. 9, 2008, pp. 41-54.

Ankita P. Meshram , Dr.D. V. Rojatkar, "Gesture recognition technology," Journal of Emerging Technologies and Innovative Research (JETIR), vol. 4, no. 1, 2017, pp. 135-138.

N. OTSU, "A Threshold Selection Method from Gray-Level Histograms," IEEE Transactions on Systems, Man, and Cybernetics, vol. 9, no. 1, 1979, pp. 62-66.

"Colours of light," Science Learning Hub, [Online]. Available: https://www.sciencelearn.org.nz/resources/47-colours-of-light. [Accessed 30 4 2017].

Downloads

Published

2017-11-30

How to Cite

Koh, J. H., & Ali, S. H. A. (2017). ASL Finger Spelling Recognition System for Interactive Learning and Education Purpose. Journal of Telecommunication, Electronic and Computer Engineering (JTEC), 9(3-7), 43–47. Retrieved from https://jtec.utem.edu.my/jtec/article/view/3074

Issue

Vol. 9 No. 3-7: Intelligent System Modeling and Control

Section

Articles

License

TRANSFER OF COPYRIGHT AGREEMENT

The manuscript is herewith submitted for publication in the Journal of Telecommunication, Electronic and Computer Engineering (JTEC). It has not been published before, and it is not under consideration for publication in any other journals. It contains no material that is scandalous, obscene, libelous or otherwise contrary to law. When the manuscript is accepted for publication, I, as the author, hereby agree to transfer to JTEC, all rights including those pertaining to electronic forms and transmissions, under existing copyright laws, except for the following, which the author(s) specifically retain(s):

  1. All proprietary right other than copyright, such as patent rights
  2. The right to make further copies of all or part of the published article for my use in classroom teaching
  3. The right to reuse all or part of this manuscript in a compilation of my own works or in a textbook of which I am the author; and
  4. The right to make copies of the published work for internal distribution within the institution that employs me

I agree that copies made under these circumstances will continue to carry the copyright notice that appears in the original published work. I agree to inform my co-authors, if any, of the above terms. I certify that I have obtained written permission for the use of text, tables, and/or illustrations from any copyrighted source(s), and I agree to supply such written permission(s) to JTEC upon request.