Article

reacTIVision: a computer-vision framework for table-based tangible interaction

Authors:

Martin Kaltenbrunner,

Ross BencinaAuthors Info & Claims

TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction

Pages 69 - 74

https://doi.org/10.1145/1226969.1226983

Published: 15 February 2007 Publication History

Get Access

Abstract

This article provides an introductory overview to first-time users of the reacTIVision framework -- an open-source cross-platform computer-vision framework primarily designed for the construction of table-based tangible user interfaces. The central component of the framework is a standalone application for fast and robust tracking of fiducial markers in a real-time video stream. The framework also defines a transport protocol for efficient and reliable transmission of object states via a local or wide area network. In addition, the distribution includes a collection of client example projects for various programming environments that allow the rapid development of unique tangible user interfaces. This article also provides a discussion of key points relevant to the construction of the necessary table hardware and surveys some projects that have been based on this technology.

References

[1]

Bencina, R. & Kaltenbrunner, M. "The Design and Evolution of Fiducials for the reacTIVision System", Proceedings of the 3rd International Conference on Generative Systems in the Electronic Arts (3rd Iteration 2005), Melbourne (Australia)

Google Scholar

[2]

Bencina, R. & Kaltenbrunner, M. & Jordà& Jordàà, S. "Improved Topological Fiducial Tracking in the reacTIVision System", Proceedings of the IEEE International Workshop on Projector-Camera Systems (Procams 2005), San Diego (USA)

Digital Library

Google Scholar

[3]

Costanza, E. & Shelley, S. B. & Robinson, J. "D-touch: A Consumer-Grade Tangible Interface Module and Musical Applications". Proceedings of Conference on Human-Computer Interaction (HCI03), Bath (UK)

Google Scholar

[4]

Han, J. Y. "Low-cost multi-touch sensing through frustrated total internal reflection", Proceedings of the 18th annual ACM symposium on User interface software and technology 2005, Seattle (USA)

Digital Library

Google Scholar

[5]

Jordà, S. & Kaltenbrunner, M. & Geiger, G. & Bencina, R. "The reacTable*", Proceedings of the International Computer Music Conference (ICMC2005), Barcelona (Spain)

Google Scholar

[6]

Kaltenbrunner, M. & Bovermann, T. & Bencina, R. & Costanza, E. "TUIO - A Protocol for Table Based Tangible User Interfaces", Proceedings of the 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (GW 2005), Vannes (France)

Google Scholar

[7]

Kato, H. & Billinghurst, M. & Poupyrev, I. & Imamoto, K. & Tachibana, K. "Virtual Object Manipulation on a Table-Top AR Environment", Proceedings of the International Symposium on Augmented Reality (ISAR 2000), Munich (Germany)

Crossref

Google Scholar

[8]

MIDI Manufacturers Association, http://www.midi.org/

Google Scholar

[9]

Ullmer, B. & Ishii, H. "Emerging Frameworks for Tangible User Interfaces", In J. M. Carroll, editor, Human-Computer Interaction in the New Millennium, pp. 579--601, 2001

Google Scholar

[10]

Wright M. & Freed, A. & Momeni, A. "OpenSound Control: State of the Art 2003", Proceedings of the 3rd Conference on New Interfaces for Musical Expression (NIME03), Montreal (Canada)

Digital Library

Google Scholar

Cited By

View all

Sardenberg VKondziela ABrünner ADaadoush YWiese HBecker M(2024)The migrating wallsSPOOL10.47982/spool.2024.1.0211:1(23-48)Online publication date: 20-Jul-2024
https://doi.org/10.47982/spool.2024.1.02
Liang Rvan Iterson HKrueger HToeters MFeijs L(2024)Chic-Marker: Fashionably Fusing Fiducial Markers into Apparel and AccessoriesProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665790(1-15)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3639473.3665790
Maierhöfer VSchmid AWimmer RCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)TipTrack: Precise, Low-Latency, Robust Optical Pen Tracking on Arbitrary Surfaces Using an IR-Emitting Pen TipProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633366(1-13)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633366
Show More Cited By

Index Terms

reacTIVision: a computer-vision framework for table-based tangible interaction

Recommendations

reacTIVision and TUIO: a tangible tabletop toolkit
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

This article presents the recent updates and an evaluation of reacTIVision, a computer vision toolkit for fiducial marker tracking and multi-touch interaction. It also discusses the current and future development of the TUIO protocol and framework, ...
TouchBridge: augmenting active tangibles for camera-based multi-touch surfaces
ITS '10: ACM International Conference on Interactive Tabletops and Surfaces

The augmentation of tabletop multi-touch surfaces with physical objects is a well visited approach for the realisation of tangible user interfaces. Interaction with objects on a multi-touch surface is often limited to spatial manipulation and common ...
Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks
TEI '16: Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction

Interactive visualization plays a key role in the analysis of large datasets. It can help users to explore data, investigate hypotheses and find patterns. The easier and more tangible the interaction, the more likely it is to enhance understanding. This ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

TEI '07: Proceedings of the 1st international conference on Tangible and embedded interaction

February 2007

296 pages

ISBN:9781595936196

DOI:10.1145/1226969

Conference Chairs:
Brygg Ullmer
Louisiana State University, Baton Rouge, Louisiana
,
Albrecht Schmidt
Ludwig-Maximilians-University, Munich, Germany

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 February 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

TEI07

Sponsor:

TEI07: Tangible and Embedded Interaction 2007

February 15 - 17, 2007

Louisiana, Baton Rouge

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

304
Total Citations
View Citations
2,802
Total Downloads

Downloads (Last 12 months)88
Downloads (Last 6 weeks)14

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sardenberg VKondziela ABrünner ADaadoush YWiese HBecker M(2024)The migrating wallsSPOOL10.47982/spool.2024.1.0211:1(23-48)Online publication date: 20-Jul-2024
https://doi.org/10.47982/spool.2024.1.02
Liang Rvan Iterson HKrueger HToeters MFeijs L(2024)Chic-Marker: Fashionably Fusing Fiducial Markers into Apparel and AccessoriesProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665790(1-15)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3639473.3665790
Maierhöfer VSchmid AWimmer RCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)TipTrack: Precise, Low-Latency, Robust Optical Pen Tracking on Arbitrary Surfaces Using an IR-Emitting Pen TipProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633366(1-13)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633366
Ullmer BDai SGomes De Siqueira AMcLendon IV MFilipiak BShafiee LNewman WKonkel MCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Variations on a Hexagon: Iterative Design of Interactive Cyberphysical Tokens and ConstraintsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633354(1-17)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633354
Campos Zamora DDogan MSiu AKoh EXiao C(2024)MoiréWidgets: High-Precision, Passive Tangible Interfaces via Moiré EffectProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642734(1-10)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642734
Van de Wynckel MValadez ISigner B(2024)FidMark: A Fiducial Marker Ontology for Semantically Describing Visual MarkersThe Semantic Web10.1007/978-3-031-60635-9_14(235-250)Online publication date: 26-May-2024
https://dl.acm.org/doi/10.1007/978-3-031-60635-9_14
Clarinval ASimonofski AHenry JVanderose BDumas B(2023)Introducing the Smart City to Children: Lessons Learned from Hands-On Workshops in ClassesSustainability10.3390/su1503177415:3(1774)Online publication date: 17-Jan-2023
https://doi.org/10.3390/su15031774
Cerit MVainer DHaber N(2023)Tingets 2.0: Computer Vision-Powered Interactive Social and Emotional Learning ToolProceedings of the 2023 Symposium on Learning, Design and Technology10.1145/3594781.3594797(53-59)Online publication date: 23-Jun-2023
https://dl.acm.org/doi/10.1145/3594781.3594797
Chen MLiang SSmith G(2023)Stackable Music: A Marker-Based Augmented Reality Music Synthesis GameCompanion Proceedings of the Annual Symposium on Computer-Human Interaction in Play10.1145/3573382.3616071(22-28)Online publication date: 6-Oct-2023
https://dl.acm.org/doi/10.1145/3573382.3616071
Gyory PBae SYang RDo EZheng C(2023)Marking Material Interactions with Computer VisionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580643(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580643
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

reacTIVision and TUIO: a tangible tabletop toolkit

TouchBridge: augmenting active tangibles for camera-based multi-touch surfaces

Comparing Tangible and Multi-touch Interaction for Interactive Data Visualization Tasks