1 / 23

Arabic Sign Language Recognition

Arabic Sign Language Recognition. Mohamed Mohandes King Fahd University of Petroleum and Minerals mohandes@kfupm.edu.sa. OUTILNE. Introduction Sign Language Recognition Translation of text to sign language Conclusion and future work. Importance of Sign Language.

hong
Télécharger la présentation

Arabic Sign Language Recognition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Arabic Sign Language Recognition Mohamed Mohandes King Fahd University of Petroleum and Minerals mohandes@kfupm.edu.sa

  2. OUTILNE • Introduction • Sign Language Recognition • Translation of text to sign language • Conclusion and future work

  3. Importance of Sign Language • Arabic sign language (ARSL) is different from spoken Arabic language in terms of grammars, vocabulary, and delivery. • ARSL is the natural language for deaf like spoken language to vocal • Sign language is different from country to other (Australia, UK, USA) • 100,000 deaf and hearing impaired in KSA

  4. Objectives Using Computers to make life of deaf easier and integrating them in the society : • Translating ARSL to spoken language • Translating Arabic speech to ARSL

  5. ARSL Recognition • Image based • Requires special set up for camera • Heavy computational load to extract hands • Electronic-Glove based • Inconvenience of gloves • Ease of signal extractions

  6. Translating ARSL to Speech سلمان

  7. System Components

  8. CyberGlove

  9. CyberGlove • 22 sensors • Light weight • Flexible

  10. Tracking System

  11. Sensor signals for two different words

  12. Coordinates of wordمع السلامة Coordinates of word الله

  13. الاشارات المعتمدة المنظمة العربية للتربية والثقافة والعلوم الاتحاد العربي للهيئات العاملة في رعاية الصم

  14. 1300 signs 344 single handed

  15. Data Collection 344 single handed signs 6880 Samples 6880 samples 20 samples from every sign: 15 for training and 5 for testing

  16. Support Vector Machine

  17. SVM

  18. System Performance • Time segments and Principle Component Analysis for feature extraction • Correct recognition rate of 98.33%

  19. Analysis of Misclassified Signs Frames of sign of letter “س” Frames of sign of letter “ش”

  20. Analysis of Misclassified Signs Frames from the sign “employee” Frames from the sign “Down syndrome”

  21. Analysis in Feature space Hand shape of “employee” Hand shape of “Down syndrome”

  22. Translating Speech to ARSL سلمان ســـــــــــلمان

  23. Conclusions and Future work • Developed a Real-time single-handed Arabic sign language recognition system with accuracy of 98.33% • Working on two-handed signs recognition • Developing our own smart glove for Arabic Sign Language • Mapping of signs to roots for speech to sign translation

More Related