demonstration

Public Access

A Demo of Talkit++: Interacting with 3D Printed Models Using an iOS Device

Authors:

Lei Shi,

Zhuohao Zhang,

Shiri AzenkotAuthors Info & Claims

ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 429 - 431

https://doi.org/10.1145/3234695.3241004

Published: 08 October 2018 Publication History

PDF eReader

Abstract

Tactile models are important learning materials for visually impaired students. With the adoption of 3D printing technologies, visually impaired students and teachers will have more access to 3D printed tactile models. We designed Talkit++, an iOS application that plays audio and visual content as a user touches parts of a 3D print. With Talkit++, a visually impaired student can explore a printed model tactilely, and use finger gestures and speech commands to get more information about certain elements in the model. Talkit++ detects the model and finger gestures using computer vision algorithms, simple accessories like paper stickers and printable trackers, and the built-in RGB camera on an iOS device. Based on the model's position and the user's input, Talkit++ speaks textual information, plays audio recordings, and displays visual animations.

References

[1]

3D Print a Volcano by mfritz - Thingiverse: https://www.thingiverse.com/thing:1316498. Accessed: 2018-06--17.

Google Scholar

[2]

AER -- Association for Education and Rehabilitation of the Blind and Visually Impaired: https://aerbvi.org/. Accessed: 2018-06--17.

Google Scholar

[3]

Bonnard, Q. et al. 2013. Chilitags 2: Robust Fiducial Markers for Augmented Reality and Robotics. CHILI, EPFL, Switzerland.

Google Scholar

[4]

Bradski, G.R. and Kaehler, A. 2008. Learning OpenCV?: computer vision with the OpenCV library. O'Reilly.

Google Scholar

[5]

Plane by YahooJAPAN - Thingiverse: https://www.thingiverse.com/thing:182252. Accessed: 2018-06--17.

Google Scholar

[6]

Shi, L. et al. 2016. Magic Touch: Interacting with 3D Printed Graphics. Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16) (2016), 329--330.

Digital Library

Google Scholar

[7]

Shi, L. et al. 2017. Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations. UIST '17 (2017).

Digital Library

Google Scholar

[8]

Washington State Topographical Map | 3D CAD Model Library | GrabCAD: https://grabcad.com/library/washington-state-topographical-map. Accessed: 2018-06--17.

Google Scholar

Cited By

View all

Pistofidis PArnaoutoglou FIoannakis GMichailidou NKarta MKiourt CPavlidis GMouroutsos STsiafaki DKoutsoudis A(2023)Design and evaluation of smart-exhibit systems that enrich cultural heritage experiences for the visually impairedJournal of Cultural Heritage10.1016/j.culher.2023.01.00460(1-11)Online publication date: Mar-2023
https://doi.org/10.1016/j.culher.2023.01.004
Lazna RBarvir RVondrakova ABrus J(2022)Creating a Haptic 3D Model of Wenceslas Hill in OlomoucApplied Sciences10.3390/app12211081712:21(10817)Online publication date: 25-Oct-2022
https://doi.org/10.3390/app122110817
Pistofidis PIoannakis GArnaoutoglou FMichailidou NKarta MKiourt CPavlidis GMouroutsos STsiafaki DKoutsoudis A(2021)Composing smart museum exhibit specifications for the visually impairedJournal of Cultural Heritage10.1016/j.culher.2021.08.01352(1-10)Online publication date: Nov-2021
https://doi.org/10.1016/j.culher.2021.08.013
Show More Cited By

Index Terms

A Demo of Talkit++: Interacting with 3D Printed Models Using an iOS Device
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interactive systems and tools

Recommendations

Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations
UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

As three-dimensional printers become more available, 3D printed models can serve as important learning materials, especially for blind people who perceive the models tactilely. Such models can be much more powerful when augmented with audio annotations ...
Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility
ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

The absence of tactile cues such as keys and buttons makes touchscreens difficult to navigate for people with visual impairments. Increasing tactile feedback and tangible interaction on touchscreens can improve their accessibility. However, prior ...
Text to Haptics: Method and Case Studies of Designing Tactile Graphics for Inclusive Tactile Picture Books by Digital Fabrication and Generative AI
SIGGRAPH '23: ACM SIGGRAPH 2023 Labs

In this case study, we explore the possibilities between Generative AI and tactile graphics for inclusivity in computer graphics communities. The use of Generative AI in the design of tactile graphics has made it possible to support the processes used ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ASSETS '18: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

October 2018

508 pages

ISBN:9781450356503

DOI:10.1145/3234695

General Chair:
Faustina Hwang
University of Reading, UK
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
David Flatla
University of Guelph, Canada

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2018

Check for updates

Author Tags

Qualifiers

Demonstration

Funding Sources

National Science Foundation

Conference

ASSETS '18

Sponsor:

SIGACCESS

ASSETS '18: The 20th International ACM SIGACCESS Conference on Computers and Accessibility

October 22 - 24, 2018

Galway, Ireland

Acceptance Rates

ASSETS '18 Paper Acceptance Rate 28 of 108 submissions, 26%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
449
Total Downloads

Downloads (Last 12 months)111
Downloads (Last 6 weeks)14

Reflects downloads up to 14 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Pistofidis PArnaoutoglou FIoannakis GMichailidou NKarta MKiourt CPavlidis GMouroutsos STsiafaki DKoutsoudis A(2023)Design and evaluation of smart-exhibit systems that enrich cultural heritage experiences for the visually impairedJournal of Cultural Heritage10.1016/j.culher.2023.01.00460(1-11)Online publication date: Mar-2023
https://doi.org/10.1016/j.culher.2023.01.004
Lazna RBarvir RVondrakova ABrus J(2022)Creating a Haptic 3D Model of Wenceslas Hill in OlomoucApplied Sciences10.3390/app12211081712:21(10817)Online publication date: 25-Oct-2022
https://doi.org/10.3390/app122110817
Pistofidis PIoannakis GArnaoutoglou FMichailidou NKarta MKiourt CPavlidis GMouroutsos STsiafaki DKoutsoudis A(2021)Composing smart museum exhibit specifications for the visually impairedJournal of Cultural Heritage10.1016/j.culher.2021.08.01352(1-10)Online publication date: Nov-2021
https://doi.org/10.1016/j.culher.2021.08.013
Picelli Sanches EBueno JLeite Ribeiro Okimoto M(2021)Designing 3D Printed Audio-Tactile Graphics: Recommendations from Prior ResearchUniversal Access in Human-Computer Interaction. Design Methods and User Experience10.1007/978-3-030-78092-0_31(461-472)Online publication date: 24-Jul-2021
https://dl.acm.org/doi/10.1007/978-3-030-78092-0_31

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Markit and Talkit: A Low-Barrier Toolkit to Augment 3D Printed Models with Audio Annotations

Interactiles: 3D Printed Tactile Interfaces to Enhance Mobile Touchscreen Accessibility

Text to Haptics: Method and Case Studies of Designing Tactile Graphics for Inclusive Tactile Picture Books by Digital Fabrication and Generative AI