Demonstrating SurfaceCast: Ubiquitous, Cross-Device Surface Sharing
Authors: 
Florian Echtler, 
Vitus Maierhöfer, 
Nicolai Brodersen Hansen, 
Raphael WimmerAuthors Info & Claims
Pages 65 - 68
Abstract
Real-time online interaction is the norm today. Tabletops and other dedicated interactive surface devices with direct input and tangible interaction can enhance remote collaboration, and open up new interaction scenarios based on mixed physical/virtual components. However, they are only available to a small subset of users, as they usually require identical bespoke hardware for every participant, are complex to setup, and need custom scenario-specific applications. We present SurfaceCast, a software toolkit designed to merge multiple distributed, heterogeneous end-user devices into a single, shared mixed-reality surface. Supported devices include regular desktop and laptop computers, tablets, and mixed-reality headsets, as well as projector-camera setups and dedicated interactive tabletop systems. This device-agnostic approach provides a fundamental building block for exploration of a far wider range of usage scenarios than previously feasible, including future clients using our provided API.
In this paper, we present various example application scenarios which we enhance through the multi-user and multi-device features of the framework. Our results show that the hardware- and content-agnostic architecture of SurfaceCast can run on a wide variety of devices with sufficient performance and fidelity for real-time interaction.
References
[1]
Pollie Barden, Rob Comber, David Green, Daniel Jackson, Cassim Ladha, Tom Bartindale, Nick Bryan-Kinns, Tony Stockman, and Patrick Olivier. 2012. Telematic Dinner Party: Designing for Togetherness through Play and Performance. In Proceedings of the Designing Interactive Systems Conference (New York, NY, USA) (DIS ’12). ACM, 38–47. https://doi.org/10.1145/2317956.2317964
[2]
Florian Echtler. 2018. SurfaceStreams: A Content-Agnostic Streaming Toolkit for Interactive Surfaces. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (New York, NY, USA) (UIST ’18 Adjunct). ACM, 10–12. https://doi.org/10.1145/3266037.3266085
[3]
Florian Echtler and Martin Kaltenbrunner. 2016. SUR40 Linux: Reanimating an Obsolete Tangible Interaction Platform. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (New York, NY, USA) (ISS ’16). ACM, 343–348. https://doi.org/10.1145/2992154.2996778
[4]
Florian Echtler and Raphael Wimmer. 2014. The Interactive Dining Table, or Pass the Weather Widget, Please. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (New York, NY, USA) (ITS ’14). ACM, 419–422. https://doi.org/10.1145/2669485.2669525
[5]
Keita Higuchi, Yinpeng Chen, Philip A. Chou, Zhengyou Zhang, and Zicheng Liu. 2015. ImmerseBoard: Immersive Telepresence Experience Using a Digital Whiteboard. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, New York, NY, USA, 2383–2392. https://doi.org/10.1145/2702123.2702160
[6]
Sasa Junuzovic, Kori Inkpen, Tom Blank, and Anoop Gupta. 2012. IllumiShare: Sharing Any Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). ACM, New York, NY, USA, 1919–1928. https://doi.org/10.1145/2207676.2208333
[7]
Martin Kaltenbrunner and Florian Echtler. 2018. The TUIO 2.0 Protocol: An Abstraction Framework for Tangible Interactive Surfaces. Proceedings of the ACM on Human-Computer Interaction 2, EICS, Article 8 (June 2018), 35 pages. https://doi.org/10.1145/3229090
[8]
Chelsea Mills, Denise Y. Geiskkovitch, Carman Neustaedter, William Odom, and Benett Axtell. 2023. Remote Wavelength: Design and Evaluation of a System for Social Connectedness Through Distributed Tabletop Gameplay. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 680, 19 pages. https://doi.org/10.1145/3544548.3581142
[9]
Jasmin Odenwald, Sven Bertel, and Florian Echtler. 2020. Tabletop Teleporter: Evaluating the Immersiveness of Remote Board Gaming. In Proceedings of the 9TH ACM International Symposium on Pervasive Displays (Manchester, United Kingdom) (PerDis ’20). Association for Computing Machinery, New York, NY, USA, 79–86. https://doi.org/10.1145/3393712.3395337
[10]
David Saffo, Sara Di Bartolomeo, Caglar Yildirim, and Cody Dunne. 2021. Remote and Collaborative Virtual Reality Experiments via Social VR Platforms. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 523, 15 pages. https://doi.org/10.1145/3411764.3445426
[11]
Sebastian Stickert, Hagen Hiller, and Florian Echtler. 2018. Companion - A Software Toolkit for Digitally Aided Pen-and-Paper Tabletop Roleplaying. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (New York, NY, USA) (UIST ’18 Adjunct). ACM, 48–50. https://doi.org/10.1145/3266037.3266097
[12]
Baris Unver, Sarah A. McRoberts, Sabirat Rubya, Haiwei Ma, Zuoyi Zhang, and Svetlana Yarosh. 2016. ShareTable Application for HP Sprout. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’16). ACM, New York, NY, USA, 3784–3787. https://doi.org/10.1145/2851581.2890252
[13]
Jun Wei, Xuan Wang, Roshan Lalintha Peiris, Yongsoon Choi, Xavier Roman Martinez, Remi Tache, Jeffrey Tzu Kwan Valino Koh, Veronica Halupka, and Adrian David Cheok. 2011. CoDine: An Interactive Multi-sensory System for Remote Dining. In Proceedings of the 13th International Conference on Ubiquitous Computing (New York, NY, USA) (UbiComp ’11). ACM, 21–30. https://doi.org/10.1145/2030112.2030116
[14]
Ying Yang, Tim Dwyer, Michael Wybrow, Benjamin Lee, Maxime Cordeil, Mark Billinghurst, and Bruce H. Thomas. 2022. Towards Immersive Collaborative Sensemaking. Proc. ACM Hum.-Comput. Interact. 6, ISS, Article 588 (nov 2022), 25 pages. https://doi.org/10.1145/3567741
[15]
Jakob Zillner, Christoph Rhemann, Shahram Izadi, and Michael Haller. 2014. 3D-Board: A Whole-Body Remote Collaborative Whiteboard. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(UIST ’14). ACM, New York, NY, USA, 471–479. https://doi.org/10.1145/2642918.2647393
Index Terms
- Demonstrating SurfaceCast: Ubiquitous, Cross-Device Surface Sharing
Recommendations
SurfaceCast: Ubiquitous, Cross-Device Surface Sharing
Real-time online interaction is the norm today. Tabletops and other dedicated interactive surface devices with direct input and tangible interaction can enhance remote collaboration, and open up new interaction scenarios based on mixed physical/virtual ...
Enabling tangible interaction on capacitive touch panels
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technologyWe propose two approaches to sense tangible objects on capacitive touch screens, which are used in off-the-shelf multi-touch devices such as Apple iPad, iPhone, and 3M's multi-touch displays. We seek for the approaches that do not require modifications ...
Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls
UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technologyVirtual keyboards and controls, commonly used on mobile multi-touch devices, occlude content of interest and do not provide tactile feedback. Clip-on Gadgets solve these issues by extending the interaction area of multi-touch devices with physical ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
November 2023
113 pages
ISBN:9798400704253
DOI:10.1145/3626485
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 05 November 2023
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Funding Sources
Conference
ISS '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 147 of 533 submissions, 28%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 77Total Downloads
- Downloads (Last 12 months)38
- Downloads (Last 6 weeks)4
Reflects downloads up to 23 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format