Abstract
Sign Language is closely associated with the deaf and dumb community to communicate with each other. However, not everyone understands sign language or verbal languages, so these communities need proper ways to communicate online. Therefore, this paper presents EasyChat, a sign language chat application that can translate three main sign languages into Simple English text as well as Simple English text into sign language, which would benefit for deaf/dumb community to express their ideas with the general community by simply capturing their British Sign Language (BSL) or Makaton gestures/symbols or lip movements. These steps are handled by four components. The first component, Convert BSL into Simple English, and the second component, handles Lip Reading conversion. The Makaton gesture and symbol conversion component produces a simple English text-formatted output for identified Makaton hand signs. Finally, the Text/voice to Sign Converter works on converting entered English text back into the sign language-based images. By using these components, EasyChat can detect relevant gestures and lip movement inputs with superior accuracy and translate. This can lead to more effective and efficient online communication between the community of deaf/dumb individuals and the general public.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Kumar, A., Begaum, S.: Sign Mobiles (2014). Accessed 20 Sept 2021
Jayatilake, L., Darshana, C., Indrajith, G., Madhuwantha, A., Ellepola, N.: Electronic Glove: A Teaching AID for the Hearing Impaired (2013). https://www.researchgate.net/publication/326403337_Electronic_glove_A_teaching_AID_for_the_hearing_impaired. Accessed 20 Sept 2021
International Journal of Multidisciplinary and Current Educational Research. Hand Gesture Recognition System for Deaf and Dumb (2020)
Singh, K., Kaur, R.: Online customer care: an android application for mobile customers using speech synthesis. Int. J. Comput. Appl. 145, 18–25 (2016). https://doi.org/10.5120/ijca2016910578. Accessed 20 Sept 2021
García-Bautista, G., Trujillo-Romero, F., Caballero-Morales, S.O.: Mexican sign language recognition using kinect and data time warping algorithm (2017). https://ieeexplore.ieee.org/document/7891832. Accessed 20 Sept 2021
Lang, S., Block, M., Rojas, R.: Sign language recognition using Microsoft Kinect (2013). https://www.researchgate.net/publication/262171243_Sign_Language_Recognition_Using_Kinect. Accessed 20 Sept 2021
Naglot, D., Kulkarni, M.: Real time sign language recognition using the leap motion controller (2016). https://ieeexplore.ieee.org/document/7830097. Accessed 20 Sept 2021
Ahanna.Org: Spiritually Enlightened Deaf Community through Pure Buddhism. Ahanna(listen) (2016)
Shareef, S.R., Hussain, M.M.: B.E 8-Sem, Department of Electronics and Communication Engineering, Muffakham Jah College of Engineering and Technology, Hyderabad, Telangana-500034, India
Soni, S., Nagmode, M.S., Komati, R.D.: Online hand gesture recognition & classification for deaf & dumb (2016). https://www.researchgate.net/publication/313111962_Online_ hand_gesture_recognition_classification_for_deaf_dumb. Accessed 20 Sept 2021
Aswathy, M., Narayanan, H., Rajan, S., Uthara, P., Jacob, J.: Hand Gesture Recognition and Speech Conversion for Deaf and Dumb using Feature Extraction (2017). Ijareeie.com. https://www.ijareeie.com/upload/2017/march/154_ECE5.pdf. Accessed 20 Sept 2021
Alfi, A., Basuony, M., Atawy, S.: Intelligent Arabic text to Arabic Sign Language Translation for Easy Deaf Communication (2014). Citeseerx.ist.psu.edu. Accessed 5 Dec 2021
Enggjournals.com. Sign Language to Speech Translation System Using PIC Microcontroller (2013). https://www.enggjournals.com/ijet/docs/IJET13-05-02-122.pdf. Accessed 5 Dec 2021
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Wijenayake, W.W.G.P.A., Gunathilake, M.D.S.S., Gurusinghe, P.M., Samararathne, W.A.H.K., Sriyaratna, D. (2022). EasyChat: A Chat Application for Deaf/Dumb People to Communicate with the General Community. In: Arai, K. (eds) Intelligent Computing. SAI 2022. Lecture Notes in Networks and Systems, vol 506. Springer, Cham. https://doi.org/10.1007/978-3-031-10461-9_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-10461-9_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-10460-2
Online ISBN: 978-3-031-10461-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)