An automatic arabic sign language recognition system based on deep CNN: An assistive system for the deaf and hard of hearing

  • Ghazanfar Latif
  • , Nazeeruddin Mohammad
  • , Roaa AlKhalaf
  • , Rawan AlKhalaf
  • , Jaafar Alghazo
  • , Majid A. Khan

Research output: Contribution to journalArticlepeer-review

52 Scopus citations

Abstract

People with disabilities have long been ignored. With the advancement of recent technologies, so many tools and software are designed for disabled people to improve their lives. In this research, the Arabic Sign Language (ArSL) recognition system is developed using the proposed architecture of the Deep Convolutional Neural Network (CNN). The aim is to help people with hearing problems to communicate with normal people. The proposed system recognizes the signs of the Arabic alphabet based on real-time user input. The Deep CNN architectures were trained and tested using a database of more than 50000 Arabic sign images collected from random participants of different age groups. Several experiments are performed with changing CNN architectural design parameters in order to get the best recognition rates. The experimental results show that the proposed Deep CNN architecture achieves an excellent accuracy of 97.6%, which is higher than the accuracy achieved by similar other studies.

Original languageEnglish (US)
Pages (from-to)715-724
Number of pages10
JournalInternational Journal of Computing and Digital Systems
Volume90
Issue number4
DOIs
StatePublished - Jul 2020
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2020 University of Bahrain. All rights reserved.

Keywords

  • Arabic Sign Language
  • Assistive System
  • Assistive Technology
  • Convolutional Neural Networks (CNN)
  • Deaf
  • Deep Learning
  • Hard of Hearing
  • Sign Language Recognition

Fingerprint

Dive into the research topics of 'An automatic arabic sign language recognition system based on deep CNN: An assistive system for the deaf and hard of hearing'. Together they form a unique fingerprint.

Cite this