Enhancing Sign Language Learning with Augmented Reality

Hawa Mohd Ekhsan; Mohamad Daniel  Muhamad Khairi; Jiwa Noris Hamid

doi:10.24191/jcrinn.v7i1.277

Enhancing Sign Language Learning with Augmented Reality

Authors

Hawa Mohd Ekhsan Universiti Teknologi MARA, Perlis Branch, Arau Campus
Mohamad Daniel Muhamad Khairi Universiti Teknologi MARA, Perlis Branch, Arau Campus
Jiwa Noris Hamid Universiti Teknologi MARA, Perlis Branch, Arau Campus

DOI:

https://doi.org/10.24191/jcrinn.v7i1.277

Keywords:

augmented reality, mobile application, sign language, disability

Abstract

Sign language is the communication language used by people with disabilities, especially deaf and hearing-impaired people. The communication between normal and disabled people using sign language will help them carry out their daily activities. Unfortunately, normal people are not aware of the importance of sign language because they are not directly dealing with disabled persons. Besides, some normal people found that sign language is difficult to learn. This study focuses on developing a mobile application for sign language with augmented reality features. This application is targeted at normal people as a sign language learning tool, and augmented reality will make the learning process effective and exciting. The methodology for this study is the ADDIE model that consists of five phases, namely Analysis, Design, Development, Implementation, and Evaluation. This application will assist the users in learning sign language interactively and interestingly. The evaluation of the application was done by the expert in the related background and the normal people. The usability test result revealed that the sign language application is usable for normal people to know and learn the basic sign language. In conclusion, the sign language application is an interesting application for normal people to use and learn sign language.

Downloads

Download data is not yet available.

References

Almutairi, A., & Al-Megren, S. (2017). Augmented reality for the literacy development of deaf children: A preliminary investigation. Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017), 359–360.

Bragg, D. (2020). Sign Language Interfaces : Discussing the Field ’ s Biggest Challenges. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). 1–5.

Deb, S., Suraksha, & Bhattacharya, P. (2018). Augmented Sign Language Modeling(ASLM) with interaction design on smartphone - an assistive learning and communication tool for inclusive classroom. Procedia Computer Science, 125, 492–500.

Hafit, H., Xiang, C. W., Yusof, M. M., Wahid, N., & Kassim, S. (2019). Malaysian Sign Language Mobile Learning Application : A recommendation app to communicate with hearing-impaired communities. International Journal of Electrical and Computer Engineering (IJECE), 9(6), 5512.

Razalli, A. R., Mamat, N., Razali, N., Yasin, M. H. M., Lakulu, M., Hashim, A. T. M., & Ariffin, A. (2021). Development of Prayer Mobile Application Software for The Hearing Impaired (Deaf) Based on Malaysian Sign Language. International Journal of Academic Research in Business and Social Sciences, 11(6), 1108–1122.

Saidin, N. F., Halim, N. D. A., & Yahaya, N. (2016). Designing Mobile Augmented Reality (MAR) for Learning Chemical Bonds. In Proceedings of the 2nd International Colloquium of Art and Design Education Research (i-CADER 2015) (pp. 367–377). Springer Singapore.

Soogund, N.-U.-N., & Joseph, M. H. (2019). SignAR: A Sign Language Translator Application with Augmented Reality using Text and Image Recognition. 2019 IEEE International Conference on Intelligent Techniques in Control, Optimization and Signal Processing (INCOS 2019), 3(1), 1–5.