research-article

Open access

TactJam: An End-to-End Prototyping Suite for Collaborative Design of On-Body Vibrotactile Feedback

Authors:

Dennis Wittchen,

Bruno Fruchard,

Donald Degraen,

Oliver Schneider,

Paul StrohmeierAuthors Info & Claims

TEI '22: Proceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction

Article No.: 1, Pages 1 - 13

https://doi.org/10.1145/3490149.3501307

Published: 13 February 2022 Publication History

All formats PDF

Abstract

We present TactJam, an end-to-end suite for creating and sharing low fidelity prototypes of on-body vibrotactile feedback. With TactJam, designers can create, record and share vibrotactile patterns online. This opens up new ways of collaboratively designing vibrotactile patterns both in collocated as well as in remote settings. We evaluate TactJam in a two-part distributed online workshop, exploring the design of on-body tactons. Participants were able to successfully use TactJam to learn about tacton design. We present an overview of mappings between tactons and their associated concepts before comparing the results of tactons created using solely a GUI and tactons created through experimenting with placements directly on the body. Conducting both parts of the workshop separately highlighted the importance of designing directly with bodies: less implicit assumptions were made, and designs were guided by personal experience. We reflect on these results and close on deliberations for the future development of TactJam.

References

[1]

Margaret Addabbo, Elena Longhi, Nadia Bolognini, Irene Senna, Paolo Tagliabue, Viola Macchi Cassia, and Chiara Turati. 2015. Seeing Touches Early in Life. PLOS ONE 10, 9 (sep 2015), e0134549. https://doi.org/10.1371/JOURNAL.PONE.0134549

[2]

Arduino AG. 2020. Arduino. http://arduino.cc/en/Reference/HomePage Last accessed 06 July 2021.

[3]

Tomohiro Amemiya and Taro Maeda. 2008. Asymmetric Oscillation Distorts the Perceived Heaviness of Handheld Objects. IEEE Transactions on Haptics 1, 1 (2008), 9–18. https://doi.org/10.1109/TOH.2008.5

Digital Library

[4]

Cynthia L. Bennett and Daniela K. Rosner. 2019. The Promise of Empathy: Design, Disability, and Knowing the ”Other”. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300528

Digital Library

[5]

Sliman Bensmaïa and Mark Hollins. 2005. Pacinian representations of fine surface texture. Perception & Psychophysics 67, 5 (01 Jul 2005), 842–854. https://doi.org/10.3758/BF03193537

[6]

Richard E Boyatzis. 1998. Transforming qualitative information: Thematic analysis and code development. sage.

[7]

Stephen A Brewster and Lorna M Brown. 2004. Tactons: structured tactile messages for non-visual information display. (2004).

[8]

L.M. Brown, S.A. Brewster, and H.C. Purchase. 2005. A First Investigation into the Effectiveness of Tactons. In First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, 167–176. https://doi.org/10.1109/WHC.2005.6

Digital Library

[9]

Bill Buxton. 2010. Sketching user experiences: getting the design right and the right design. Morgan kaufmann.

[10]

Andrew Chan, Karon MacLean, and Joanna McGrenere. 2008. Designing haptic icons to support collaborative turn-taking. International Journal of Human-Computer Studies 66, 5 (2008), 333–355. https://doi.org/10.1016/j.ijhcs.2007.11.002

Digital Library

[11]

Fabien Danieau, Philippe Guillotel, Olivier Dumas, Thomas Lopez, Bertrand Leroy, and Nicolas Mollet. 2018. HFX Studio: Haptic Editor for Full-Body Immersive Experiences. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology (Tokyo, Japan) (VRST ’18). Association for Computing Machinery, New York, NY, USA, Article 37, 9 pages. https://doi.org/10.1145/3281505.3281518

Digital Library

[12]

Donald Degraen, Bruno Fruchard, Frederik Smolders, Emmanouil Potetsianakis, Seref Güngör, Antonio Krüger, and Jürgen Steimle. 2021. Weirding Haptics: In-Situ Prototyping of Vibrotactile Feedback in Virtual Reality through Vocalization. In Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology (Virtual) (UIST ’21). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3472749.3474797

Digital Library

[13]

Alexandra Delazio, Ken Nakagaki, Jill Fain Lehman, Roberta L. Klatzky, Alanson P. Sample, and Scott E. Hudson. 2018. Force jacket: Pneumatically-actuated jacket for embodied haptic experiences. Conference on Human Factors in Computing Systems - Proceedings 2018-April (2018), 1–12. https://doi.org/10.1145/3173574.3173894

Digital Library

[14]

M.J. Enriquez and K.E. MacLean. 2003. The hapticon editor: a tool in support of haptic communication research. In HAPTICS ’03. IEEE Comput. Soc, 356–362. https://doi.org/10.1109/HAPTIC.2003.1191310

[15]

Colin Gallacher, Arash Mohtat, and Steve Ding. 2016. Toward Open-Source Portable Haptic Displays with Visual-Force-Tactile Feedback Colocation. (2016).

[16]

Frank A. Geldard. 1957. Adventures in tactile literacy.American Psychologist 12, 3 (1957), 115–124. https://doi.org/10.1037/h0040416

[17]

Eric Gunther, Glorianna Davenport, and Sile O’Modhrain. 2002. Cutaneous grooves: composing for the sense of touch. In NIME ’02. New York, NY, USA, 73–79. http://dl.acm.org/citation.cfm?id=1085171.1085181

[18]

Antal Haans and Wijnand IJsselsteijn. 2006. Mediated social touch: a review of current research and future directions. Virtual Reality 9, 2-3 (2006), 149–159.

Digital Library

[19]

Matthew J Hertenstein, Rachel Holmes, Margaret McCullough, and Dacher Keltner. 2009. The communication of emotion via touch.Emotion 9, 4 (2009), 566.

[20]

Lucas Hinderberger. 2020. libvtp: A library for encoding and decoding vibrotactile patterns. https://github.com/lhinderberger/libvtp Last accessed 06 July 2021.

[21]

Kristina Höök. 2018. Designing with the body: Somaesthetic interaction design. MIT Press.

[22]

Gijs Huisman, Aduén Darriba Frederiks, Betsy Van Dijk, Dirk Hevlen, and Ben Kröse. 2013. The TaSSt: Tactile sleeve for social touch. In 2013 World Haptics Conference (WHC). 211–216. https://doi.org/10.1109/WHC.2013.6548410

[23]

W.A. A IJsselsteijn. 2003. Presence in the past: what can we learn from media history?Being there: concepts, effects and measurements of user presence in synthetic environments 5 (2003), 17–40.

[24]

Apple inc.2021. Core Haptics. https://developer.apple.com/documentation/corehaptics Last accessed August 1st 2021.

[25]

Interhaptics. 2021. Haptic Composer. https://www.interhaptics.com/haptic-composer Last accessed August 1st 2021.

[26]

Yeongmi Kim, Jongeun Cha, Ian Oakley, and Jeha Ryu. 2009. Exploring Tactile Movies: An Initial Tactile Glove Design and Concept Evaluation. IEEE Multimedia PP, 99 (2009), 1. https://doi.org/10.1109/MMUL.2009.63

Digital Library

[27]

PlatformIO Labs. 2014. Professional collaborative platform for embedded development. https://platformio.org/ Last accessed 06 July 2021.

[28]

PlatformIO Labs. 2016. Espressif 32: development platform for PlatformIO. https://github.com/platformio/platform-espressif32 Last accessed 06 July 2021.

[29]

Lofelt. 2021. Lofelt Studio. https://lofelt.com/design Last accessed August 1st 2021.

[30]

Emanuela Maggioni, Erika Agostinelli, and Marianna Obrist. 2017. Measuring the added value of haptic feedback. In 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX). 1–6. https://doi.org/10.1109/QoMEX.2017.7965670

[31]

Melisa Orta Martinez, Joseph Campion, Tara Gholami, Michal K. Rittikaidachar, Aaron C. Barron, and Allison M. Okamura. 2017. Open source, modular, customizable, 3-D printed kinesthetic haptic devices. 2017 IEEE World Haptics Conference, WHC 2017 (2017), 142–147. https://doi.org/10.1109/WHC.2017.7989891

[32]

David J. Meyer, Michael A. Peshkin, and J. Edward Colgate. 2016. Tactile Paintbrush: A procedural method for generating spatial haptic texture. In 2016 IEEE Haptics Symposium (HAPTICS). IEEE, 259–264. https://doi.org/10.1109/HAPTICS.2016.7463187

[33]

Camille Moussette. 2010. Sketching in Hardware and Building Interaction Design : tools, toolkits and an attitude for Interaction Designers. In Processing. https://public.me.com/intuitive

[34]

Camille Moussette, Stoffel Kuenen, and Ali Israr. 2012. Designing Haptics. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (Kingston, Ontario, Canada) (TEI ’12). Association for Computing Machinery, New York, NY, USA, 351–354. https://doi.org/10.1145/2148131.2148215

Digital Library

[35]

Marianna Obrist, Sue Ann Seah, and Sriram Subramanian. 2013. Talking about Tactile Experiences. Association for Computing Machinery, New York, NY, USA, 1659–1668. https://doi.org/10.1145/2470654.2466220

Digital Library

[36]

Allison M Okamura, Katherine J Kuchenbecker, and Mohsen Mahvash. 2008. Measurement-Based Modeling for Haptic Rendering. In Haptic Rendering: Algorithms and Applications. A. K. Peters, Chapter 21, 443–467.

[37]

Sabrina A. Paneels, Margarita Anastassova, and Lucie Brunet. 2013. TactiPEd: Easy Prototyping of Tactile Patterns. INTERACT ’13 8118(2013), 228–245. https://doi.org/10.1007/978-3-642-40480-1

[38]

Evan Pezent, Brandon Cambio, and Marcia K O Malley. 2020. Syntacts : Open Source Framework for Audio-Controlled Vibrotactile Haptics. c (2020), 2020.

[39]

M Pielot, N Henze, and S Boll. 2009. Supporting map-based wayfinding with tactile cues. Proceedings of the 11th International Conference on HumanComputer Interaction with Mobile Devices and Services MobileHCI 09 (2009), 1. https://doi.org/10.1145/1613858.1613888

Digital Library

[40]

Jonghyun Ryu and Seungmoon Choi. 2008. posVibEditor: Graphical authoring tool of vibrotactile patterns. In HAVE ’08. IEEE, 120–125. https://doi.org/10.1109/HAVE.2008.4685310

[41]

Oliver Schneider, Karon MacLean, Colin Swindells, and Kellogg Booth. 2017. Haptic experience design: What hapticians do and where they need help. International Journal of Human-Computer Studies 107 (2017), 5–21. https://doi.org/10.1016/j.ijhcs.2017.04.004 Multisensory Human-Computer Interaction.

Digital Library

[42]

Oliver S. Schneider, Ali Israr, and Karon E. MacLean. 2015. Tactile Animation by Direct Manipulation of Grid Displays. In UIST’15.

[43]

Oliver S. Schneider and Karon E. MacLean. 2014. Improvising design with a Haptic Instrument. In 2014 IEEE Haptics Symposium (HAPTICS). 327–332. https://doi.org/10.1109/HAPTICS.2014.6775476

[44]

Oliver S. Schneider and Karon E. MacLean. 2016. Studying Design Process and Example Use with Macaron, a Web-based Vibrotactile Effect Editor. In HAPTICS ’16: Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[45]

Oliver S. Schneider, Hasti Seifi, Salma Kashani, Matthew Chun, and Karon E. MacLean. 2016. HapTurk: Crowdsourcing Affective Ratings for Vibrotactile Icons. In CHI ’16. ACM Press, New York, New York, USA, 3248–3260. https://doi.org/10.1145/2858036.2858279

Digital Library

[46]

Hasti Seifi, Matthew Chun, Colin Gallacher, Oliver Schneider, and Karon E. MacLean. 2020. How Do Novice Hapticians Design? A Case Study in Creating Haptic Learning Environments. IEEE Transactions on Haptics 13, 4 (2020), 791–805. https://doi.org/10.1109/TOH.2020.2968903

Digital Library

[47]

Tanay Singhal and Oliver Schneider. 2021. Juicy Haptic Design: Vibrotactile Embellishments Can Improve Player Experience in Games. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445463

Digital Library

[48]

Katta Spiel. 2021. The Bodies of TEI – Investigating Norms and Assumptions in the Design of Embodied Interaction. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (Salzburg, Austria) (TEI ’21). Association for Computing Machinery, New York, NY, USA, Article 32, 19 pages. https://doi.org/10.1145/3430524.3440651

Digital Library

[49]

Katta Spiel and Lennart E. Nacke. 2020. What Is It Like to Be a Game?—Object Oriented Inquiry for Games Research, Design, and Evaluation. Frontiers in Computer Science 2 (2020), 18. https://doi.org/10.3389/fcomp.2020.00018

[50]

Paul Strohmeier, Seref Güngör, Luis Herres, Dennis Gudea, Bruno Fruchard, and Jürgen Steimle. 2020. BARefoot: Generating Virtual Materials Using Motion Coupled Vibration in Shoes. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology(Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 579–593. https://doi.org/10.1145/3379337.3415828

Digital Library

[51]

Colin Swindells, Seppo Pietarinen, and Arto Viitanen. 2014. Medium fidelity rapid prototyping of vibrotactile haptic, audio and video effects. In 2014 IEEE Haptics Symposium (HAPTICS). 515–521. https://doi.org/10.1109/HAPTICS.2014.6775509

[52]

D Ternes and K E MacLean. 2008. Designing Large Sets of Haptic Icons with Rhythm. Haptics: Perception, Devices and Scenarios 5024 (2008), 199–208. http://www.springerlink.com/index/atl5686222k242m4.pdf

Digital Library

[53]

Marc Teyssier, Gilles Bailly, Éric Lecolinet, and Catherine Pelachaud. 2017. Survey and Perspectives of Social Touch in HCI. In Proceedings of the 29th Conference on l’Interaction Homme-Machine (Poitiers, France) (IHM ’17). Association for Computing Machinery, New York, NY, USA, 93–104. https://doi.org/10.1145/3132129.3132136

Digital Library

[54]

Graham Wilson and Stephen A. Brewster. 2017. Multi-Moji: Combining Thermal, Vibrotactile and Visual Stimuli to Expand the Affective Range of Feedback. Association for Computing Machinery, New York, NY, USA, 1743–1755. https://doi.org/10.1145/3025453.3025614

Digital Library

[55]

Dennis Wittchen, Bruno Fruchard, Paul Strohmeier, and Georg Freitag. 2021. TactJam: A Collaborative Playground for Composing Spatial Tactons. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction(Salzburg, Austria) (TEI ’21). Association for Computing Machinery, New York, NY, USA, Article 64, 4 pages. https://doi.org/10.1145/3430524.3442699

Digital Library

[56]

Hsin-yun Yao and Vincent Hayward. 2006. An experiment on length perception with a virtual rolling stone. In Proceedings of Eurohaptics. 325–330.

[57]

Yongjae Yoo, Taekbeom Yoo, Jihyun Kong, and Seungmoon Choi. 2015. Emotional responses of tactile icons: Effects of amplitude, frequency, duration, and envelope. In 2015 IEEE World Haptics Conference (WHC). IEEE, 235–240. https://doi.org/10.1109/WHC.2015.7177719

[58]

Siyan Zhao, Zachary Schwemler, Adam Fritz, and Ali Israr. 2016. Stereo Haptics: Designing Haptic Interactions Using Audio Tools. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction(Eindhoven, Netherlands) (TEI ’16). Association for Computing Machinery, New York, NY, USA, 778–781. https://doi.org/10.1145/2839462.2854120

Digital Library

Cited By

Cunha Monteiro WAugusto Soares de Sousa TGregório Marques Soares ADavi Oliveira de Araújo TGustavo Resque dos Santos CSerique Meiguins B(2024)Encoding Data Through Tactile Vibrations2024 28th International Conference Information Visualisation (IV)10.1109/IV64223.2024.00011(1-6)Online publication date: 22-Jul-2024
https://doi.org/10.1109/IV64223.2024.00011
Messerschmidt MCortes JNanayakkara S(2024)CoTacs: A Haptic Toolkit to Explore Effective On-Body Haptic Feedback by Ideating, Designing, Evaluating and Refining Haptic Designs Using Group CollaborationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2358460(1-21)Online publication date: 7-Jun-2024
https://doi.org/10.1080/10447318.2024.2358460
Regimbal JCooperstock J(2024)Investigating Haptic Co-creation with Reinforcement LearningHaptics: Understanding Touch; Technology and Systems; Applications and Interaction10.1007/978-3-031-70061-3_37(448-454)Online publication date: 30-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-70061-3_37
Show More Cited By

Index Terms

TactJam: An End-to-End Prototyping Suite for Collaborative Design of On-Body Vibrotactile Feedback
1. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Weirding Haptics: In-Situ Prototyping of Vibrotactile Feedback in Virtual Reality through Vocalization
UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

Effective haptic feedback in virtual reality (VR) is an essential element for creating convincing immersive experiences. To design such feedback, state-of-the-art VR setups provide APIs for programmatically generating controller vibration patterns. ...
WalkingVibe: Reducing Virtual Reality Sickness and Improving Realism while Walking in VR using Unobtrusive Head-mounted Vibrotactile Feedback
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Virtual Reality (VR) sickness is common with symptoms such as headaches, nausea, and disorientation, and is a major barrier to using VR. We propose WalkingVibe, which applies unobtrusive vibrotactile feedback for VR walking experiences, and also reduces ...
TactJam: a collaborative playground for composing spatial tactons
TEI '21: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction

Tactons are vibrotactile patterns used to convey information. Conventionally, a small set of tactons is used on mobile phone or wearables to notify users of messages or emails received. However, tactons have multiple characteristics that one can vary to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '22: Proceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2022

758 pages

ISBN:9781450391474

DOI:10.1145/3490149

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 February 2022

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

TEI '22

Sponsor:

SIGCHI

TEI '22: Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 13 - 16, 2022

Daejeon, Republic of Korea

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
1,264
Total Downloads

Downloads (Last 12 months)383
Downloads (Last 6 weeks)54

Reflects downloads up to 17 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cunha Monteiro WAugusto Soares de Sousa TGregório Marques Soares ADavi Oliveira de Araújo TGustavo Resque dos Santos CSerique Meiguins B(2024)Encoding Data Through Tactile Vibrations2024 28th International Conference Information Visualisation (IV)10.1109/IV64223.2024.00011(1-6)Online publication date: 22-Jul-2024
https://doi.org/10.1109/IV64223.2024.00011
Messerschmidt MCortes JNanayakkara S(2024)CoTacs: A Haptic Toolkit to Explore Effective On-Body Haptic Feedback by Ideating, Designing, Evaluating and Refining Haptic Designs Using Group CollaborationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2358460(1-21)Online publication date: 7-Jun-2024
https://doi.org/10.1080/10447318.2024.2358460
Regimbal JCooperstock J(2024)Investigating Haptic Co-creation with Reinforcement LearningHaptics: Understanding Touch; Technology and Systems; Applications and Interaction10.1007/978-3-031-70061-3_37(448-454)Online publication date: 30-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-70061-3_37
Feick MDegraen DHupperich FKrüger A(2023)MetaReality: enhancing tactile experiences using actuated 3D-printed metamaterials in Virtual RealityFrontiers in Virtual Reality10.3389/frvir.2023.11723814Online publication date: 28-Jun-2023
https://doi.org/10.3389/frvir.2023.1172381
Mukashev DRanasinghe NNittala A(2023)TactTongue: Prototyping ElectroTactile Stimulations on the TongueProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606829(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606829
Zhou RSchwemler ZBaweja ASareen HHunt CLeithinger D(2023)TactorBots: A Haptic Design Toolkit for Out-of-lab Exploration of Emotional Robotic TouchProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580799(1-19)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580799
Dalsgaard TSchneider O(undefined)A Unified Model for Haptic ExperienceACM Transactions on Computer-Human Interaction10.1145/3711842
https://dl.acm.org/doi/10.1145/3711842

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten