research-article

VisualComm: a tool to support communication between deaf and hearing persons with the Kinect

Authors:

Hanjing LiAuthors Info & Claims

ASSETS '13: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility

Article No.: 76, Pages 1 - 2

https://doi.org/10.1145/2513383.2513398

Published: 21 October 2013 Publication History

Get Access

Abstract

With the quickly increasing of the deaf community, how to communicate with the hearing persons is becoming a serious social problem. Furthermore, the investigation indicates that the deaf community is more self-enclosed and won't exchange ideas with the hearing. To address this challenge, we develop VisualComm, a tool to support communication between deaf and hearing persons with sign language recognition technology by using the Kinect. The main contribution of the system is a holistic solution of a two-way communication between deaf and hearings, and furthermore it is a seamless experience tailored for this particular activity. Currently we have implemented the basic communication based on 370 daily Chinese words for signer.

References

[1]

Cavender, A., Ladner, R. E., Riskin, E. A. 2006. MobileASL: Intelligibility of Sign Language Video as Constrained by Mobile Phone Technology. ASSETS, (2006), 71--78.

Digital Library

Google Scholar

[2]

Chai, X., Li, G., Lin, Y., Xu, Z., Tang, Y., Chen, X., Zhou, M. 2013. Sign Language Recognition and Translation with Kinect. IEEE Conf. on AFGR, (2013).

Google Scholar

[3]

Han, J., Awad, G., and Sutherland, A. 2009. Modelling and Segmenting Subunits for Sign Language Recognition Based on Hand Motion Analysis. Pattern Recognition Letters, 30 (2009), 623--633.

Digital Library

Google Scholar

[4]

Hollan, J. D., Piper, A. M. 2008. Supporting Medical Conversations between Deaf and Hearing Individuals with Tabletop Displays. CSCW, (2008), 147--156.

Digital Library

Google Scholar

[5]

Shotton, J., Fitzgibbon, A., and Cook, M., etc. 2011. Realtime Human Pose Recognition in Parts from Single Depth images. IEEE Conf. on CVPR, (2011), 1297--1304.

Digital Library

Google Scholar

[6]

Takahashi, T. and Kishino, F. 1991. Hand Gesture Coding based on Experiments using a Hand Gesture Interface Device. SIGCHI Bulletin, 23, (1991), 67--73.

Digital Library

Google Scholar

[7]

Zafrulla, Z., Brashear, H., Starner, T., Hamilton, H. and Presti, P. 2011. American Sign Language Recognition with the Kinect, ICMI, (2011), 279--286.

Digital Library

Google Scholar

Cited By

View all

Sosa-Jimenez CRios-Figueroa HSolis-Gonzalez-Cosio A(2022)A Prototype for Mexican Sign Language Recognition and Synthesis in Support of a Primary Care PhysicianIEEE Access10.1109/ACCESS.2022.322669610(127620-127635)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3226696
Kiran Kumar EKishore PAnil Kumar DTeja Kiran Kumar M(2021)Early estimation model for 3D-discrete indian sign language recognition using graph matchingJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2018.06.00833:7(852-864)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1016/j.jksuci.2018.06.008
ÇELİK ÖODABAS A(2020)Sign2Text: Konvolüsyonel Sinir Ağları Kullanarak Türk İşaret Dili TanımaEuropean Journal of Science and Technology10.31590/ejosat.747231(923-934)Online publication date: 31-Aug-2020
https://doi.org/10.31590/ejosat.747231
Show More Cited By

VisualComm: a tool to support communication between deaf and hearing persons with the Kinect
1. Social and professional topics
  1. Professional topics
    1. Computing profession
  2. User characteristics

Recommendations

A Case Study About Usability, User Experience and Accessibility Problems of Deaf Users with Assistive Technologies
Universal Access in Human-Computer Interaction. Applications and Practice
Abstract
Interaction with mobile devices allows users to have advantages such as flexibility, mobility, and wireless communication. However, challenges have emerged in this interaction context, due to the smaller size of its screens, the new usage ...
Interdependent components of web accessibility
W4A '05: Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A)

Increasingly, the Web is providing unprecedented access to information and interaction for people with disabilities. However, the Web will not be equally accessible, allowing people with disabilities to access and contribute to the Web, until:• ...
An augmentative and alternative communication tool for children and adolescents with cerebral palsy
Medical teamwork, collaboration and patient-centred care

People with disabilities face many accessibility problems in their daily lives. One such group of disabled people, children who suffer from cerebral palsy, faces specific challenges, which arise due to motor dysfunction and communication disorders. In ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ASSETS '13: Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility

October 2013

343 pages

ISBN:9781450324052

DOI:10.1145/2513383

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2013

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

ASSETS '13

Sponsor:

SIGACCESS

ASSETS '13: The 15th International ACM SIGACCESS Conference on Computers and Accessibility

October 21 - 23, 2013

Washington, Bellevue

Acceptance Rates

ASSETS '13 Paper Acceptance Rate 28 of 98 submissions, 29%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
409
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sosa-Jimenez CRios-Figueroa HSolis-Gonzalez-Cosio A(2022)A Prototype for Mexican Sign Language Recognition and Synthesis in Support of a Primary Care PhysicianIEEE Access10.1109/ACCESS.2022.322669610(127620-127635)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3226696
Kiran Kumar EKishore PAnil Kumar DTeja Kiran Kumar M(2021)Early estimation model for 3D-discrete indian sign language recognition using graph matchingJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2018.06.00833:7(852-864)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1016/j.jksuci.2018.06.008
ÇELİK ÖODABAS A(2020)Sign2Text: Konvolüsyonel Sinir Ağları Kullanarak Türk İşaret Dili TanımaEuropean Journal of Science and Technology10.31590/ejosat.747231(923-934)Online publication date: 31-Aug-2020
https://doi.org/10.31590/ejosat.747231
Triviño-López IRodríguez-Garavito CMartinez-Caldas J(2020)Hand Gesture Recognition Using Computer Vision Applied to Colombian Sign LanguageComputer Aided Systems Theory – EUROCAST 201910.1007/978-3-030-45096-0_26(207-214)Online publication date: 15-Apr-2020
https://doi.org/10.1007/978-3-030-45096-0_26
Dhanjal ASingh W(2019)Tools and Techniques of Assistive Technology for Hearing Impaired People2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon)10.1109/COMITCon.2019.8862454(205-210)Online publication date: Feb-2019
https://doi.org/10.1109/COMITCon.2019.8862454
Kumar DSastry AKishore PKumar E(2018)Indian sign language recognition using graph matching on 3D motion captured signsMultimedia Tools and Applications10.1007/s11042-018-6199-777:24(32063-32091)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1007/s11042-018-6199-7
Fang BCo JZhang M(2017)DeepASLProceedings of the 15th ACM Conference on Embedded Network Sensor Systems10.1145/3131672.3131693(1-13)Online publication date: 6-Nov-2017
https://dl.acm.org/doi/10.1145/3131672.3131693
Dai QHou JYang PLi XWang FZhang XVan der Merwe KGreenstein BSrinivasan K(2017)Demo: The Sound of SilenceProceedings of the 23rd Annual International Conference on Mobile Computing and Networking10.1145/3117811.3119853(462-464)Online publication date: 4-Oct-2017
https://dl.acm.org/doi/10.1145/3117811.3119853
Li KZhou ZLee C(2016)Sign Transition Modeling and a Scalable Solution to Continuous Sign Language Recognition for Real-World ApplicationsACM Transactions on Accessible Computing10.1145/28504218:2(1-23)Online publication date: 29-Jan-2016
https://dl.acm.org/doi/10.1145/2850421
Oppenheim M(2016)HeadBanger: controlling switchable software with head gestureJournal of Assistive Technologies10.1108/JAT-04-2015-001510:1(2-10)Online publication date: 21-Mar-2016
https://doi.org/10.1108/JAT-04-2015-0015
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

A Case Study About Usability, User Experience and Accessibility Problems of Deaf Users with Assistive Technologies

Interdependent components of web accessibility

An augmentative and alternative communication tool for children and adolescents with cerebral palsy