research-article

HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration

Authors:

Hans-Christian Jetter,

Nicolai Marquardt,

Harald Reiterer,

Yvonne RogersAuthors Info & Claims

ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces

Pages 45 - 54

https://doi.org/10.1145/2669485.2669500

Published: 16 November 2014 Publication History

Abstract

We present HuddleLamp, a desk lamp with an integrated RGB-D camera that precisely tracks the movements and positions of mobile displays and hands on a table. This enables a new breed of spatially-aware multi-user and multi-device applications for around-the-table collaboration without an interactive tabletop. At any time, users can add or remove displays and reconfigure them in space in an ad-hoc manner without the need of installing any software or attaching markers. Additionally, hands are tracked to detect interactions above and between displays, enabling fluent cross-device interactions. We contribute a novel hybrid sensing approach that uses RGB and depth data to increase tracking quality and a technical evaluation of its capabilities and limitations. For enabling installation-free ad-hoc collaboration, we also introduce a web-based architecture and JavaScript API for future HuddleLamp applications. Finally, we demonstrate the resulting design space using five examples of cross-device interaction techniques.

Supplementary Material

JPG File (its0144.jpg)

Download
9.98 KB

MP4 File (its0144.mp4)

Supplemental video

Download
47.21 MB

References

[1]

Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic Interaction: Designing for a Proximity and OrientationAware Environment. Proc. of ITS '10, ACM (2010).

Digital Library

[2]

Borovoy, R. and Knep, B. Junkyard Jumbotron, http://jumbotron.media.mit.edu. 2011.

[3]

Dearman, D., Guy, R., and Truong, K. Determining the Orientation of Proximate Mobile Devices Using Their Back Facing Camera. Proc. of CHI '12, ACM (2012), 2231--2234.

Digital Library

[4]

Dippon, A., Wiedermann, N., and Klinker, G. Seamless Integration of Mobile Devices into Interactive Surface Environments. Proc. of ITS '12, ACM (2012), 331--334.

Digital Library

[5]

Fitzmaurice, G.W. Situated information spaces and spatially aware palmtop computers. Comm. of ACM 36, 7 (1993).

Digital Library

[6]

Greenberg, S., Marquardt, N., Ballendat, T., Diaz-Marino, R., and Wang, M. Proxemic Interactions: The New Ubicomp' ACM Interactions 18, 1 (2011), 42--50.

Digital Library

[7]

Hamilton, P. and Wigdor, D.J. Conductor: Enabling and Understanding Cross-device Interaction. Proc. of CHI '14, ACM (2014), 2773--2782.

Digital Library

[8]

Harrison, C., Benko, H., and Wilson, A.D. OmniTouch: wearable multitouch interaction everywhere. Proc. of UIST '11, ACM (2011), 441--450.

Digital Library

[9]

Hilliges, O., et al. Interactions in the air: adding further depth to interactive tabletops. Proc. of UIST '09, ACM (2009).

Digital Library

[10]

Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., and Smith, M. Stitching: pen gestures that span multiple displays. Proc. of AVI '04, ACM (2004), 23--31.

Digital Library

[11]

Hollan, J., Hutchins, E., and Kirsh, D. Distributed Cognition: Toward a New Foundation for Human-computer Interaction Research. ACM Trans. Comput.-Hum. Interact. 7, 2 (2000).

Digital Library

[12]

Holmquist, L., et al. Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts. Proc. of UbiComp, Springer (2001), 116.

Digital Library

[13]

Huang, D.-Y., Lin, C.-P., Hung, Y.-P., et al. MagMobile: Enhancing Social Interactions with Rapid View-stitching Games of Mobile Devices. Proc. of MUM '12, ACM (2012).

Digital Library

[14]

Kendon, A. Conducting Interaction: Patterns of Behavior in Focused Encounters. Cambridge Press, Cambridge, 1990.

[15]

Kray, C., et al. Group Coordination and Negotiation through Spatial Proximity Regions around Mobile Devices on Augmented Tabletops. Proc. of TABLETOP, IEEE (2008).

[16]

Li, M. and Kobbelt, L. Dynamic Tiling Display: Building an Interactive Display Surface Using Multiple Mobile Devices. Proc. of MUM '12, ACM (2012), 24:1--24:4.

Digital Library

[17]

Linder, N. and Maes, P. The Design Evolution of LuminAR: A Compact and Kinetic Projected Augmented Reality Interface. CHI '12 Ext. Abs., ACM (2012), 1435--1436.

Digital Library

[18]

Lucero, A., Holopainen, J., and Jokela, T. Pass-them-around: Collaborative Use of Mobile Phones for Photo Sharing. Proc. of CHI '11, ACM (2011), 1787--1796.

Digital Library

[19]

Lucero, A., et al. Mobile Collocated Interactions: Taking an Offline Break Together. interactions 20, 2 (2013), 26--32.

Digital Library

[20]

Marquardt, N., et al. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. Proc. of UIST '11, ACM (2011).

Digital Library

[21]

Marquardt, N., Hinckley, K., and Greenberg, S. CrossDevice Interaction via Micro-mobility and F-formations. Proc. of UIST '12, ACM (2012), 13--22.

Digital Library

[22]

Marquardt, N., Jota, R., Greenberg, S., and Jorge, J.A. The continuous interaction space: interaction techniques unifying touch and gesture on and above a digital surface. Proc. of INTERACT, Springer (2011), 461--476.

Digital Library

[23]

Merrill, D., Kalanithi, J., and Maes, P. Siftables: towards sensor network user interfaces. Proc. of TEI, ACM (2007).

Digital Library

[24]

Ohta, T. and Tanaka, J. Pinch: An Interface That Relates Applications on Multiple Touch-screen by Pinching Gesture. Proc. of ACE '12, Springer-Verlag (2012), 320--335.

Digital Library

[25]

Oulasvirta, A. When Users 'Do' the Ubicomp. interactions 15, 2 (2008), 6--9.

Digital Library

[26]

Piazza, T., et al. Dynamic Duo: Exploring Phone-Tablet, Combinations for Mobile Usage. WIP, TEI '13, ACM (2013).

[27]

Ramos, G., et al. Synchronous Gestures in Multi-Display Environments. Human-Computer Interaction 24, 1 (2009).

[28]

Rekimoto, J. and Saitoh, M. Augmented surfaces: a spatially continuous work space for hybrid computing environments. Proc. of CHI '99, ACM (1999), 378--385.

Digital Library

[29]

Schmitz, A., Li, M., Schönefeld, V., and Kobbelt, L. Ad-Hoc Multi-Displays for Mobile Interactive Applications. The Eurographics Association (2010), 45--52.

[30]

Schwarz, J., et al. Phone As a Pixel: Enabling Ad-hoc, Largescale Displays Using Mobile Devices. Proc. of CHI '12, ACM (2012).

Digital Library

[31]

Spindler, M., et al. Tangible Displays for the Masses: Spatial Interaction with Handheld Displays by Using Consumer Depth Cameras. Personal Ubiquitous Comput. 18, 5 (2014).

Digital Library

[32]

Spindler, M., Stellmach, S., and Dachselt, R. PaperLens: advanced magic lens interaction above the tabletop. Proc. of ITS '09, ACM (2009), 69--76.

Digital Library

[33]

Steimle, J., Jordt, A., and Maes, P. Flexpad: Highly Flexible Bending Interactions for Projected Handheld Displays. Proc. of CHI '13, ACM (2013), 237--246.

Digital Library

[34]

Tandler, P., et al. Connectables: Dynamic Coupling of Displays for the Flexible Creation of Shared Workspaces. Proc. of UIST '01, ACM (2001), 11--20.

Digital Library

[35]

Wang, M., Boring, S., and Greenberg, S. A Public Advertising Display that Captures and Preserves the Attention of a Passerby. Proc. of PerDis '12, ACM (2012).

Digital Library

[36]

Wilson, A., et al. Steerable Augmented Reality with the Beamatron. Proc. of UIST '12, ACM (2012), 413--422.

Digital Library

[37]

Wilson, A.D. and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. Proc. of UIST '10, ACM (2010), 273--282.

Digital Library

[38]

Winkler, C., et al. SurfacePhone: A Mobile Projection Device for Single- and Multiuser Everywhere Tabletop Interaction. Proc. of CHI '14, ACM (2014), 3513--3522.

Digital Library

Cited By

Chen YCasiez GMalacria SVogel D(2024)LuxAR: A Direct Manipulation Projected Display to Extend and Augment Desktop ComputingProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670981(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670981
Emmert MSchönwerth NSchmid AWolff CWimmer R(2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670778
Gryphon KVu VChung H(2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614516
Show More Cited By

Index Terms

HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Demonstrating HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration
ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces

We present HuddleLamp, a desk lamp with an integrated RGB-D camera that precisely tracks the movements and positions of mobile displays and hands on a table. This enables a new breed of spatially-aware multi-user and multi-device applications for around-...
Code space: touch + air gesture hybrid interactions for supporting developer meetings
ITS '11: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

We present Code Space, a system that contributes touch + air gesture hybrid interactions to support co-located, small group developer meetings by democratizing access, control, and sharing of information across multiple personal devices and public ...
Cross-Surface: Workshop on Interacting with Multi-Device Ecologies in the Wild
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces

In this workshop, we will review and discuss opportunities, technical challenges and problems with cross-device interactions in interactive multi-surface and multi-device ecologies. We aim to bring together researchers and practitioners currently ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '14: Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces

November 2014

524 pages

ISBN:9781450325875

DOI:10.1145/2669485

General Chairs:
Raimund Dachselt
Technische Universität Dresden, Germany
,
Nicholas Graham
Queen's University, Canada
,
Program Chairs:
Kasper Hornbæk
University of Copenhagen, Denmark
,
Miguel Nacenta
University of St. Andrews, UK

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2014

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

ITS '14

Sponsor:

SIGCHI

ITS '14: Interactive Tabletops and Surfaces

November 16 - 19, 2014

Dresden, Germany

Acceptance Rates

ITS '14 Paper Acceptance Rate 31 of 112 submissions, 28%;

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

107
Total Citations
View Citations
1,466
Total Downloads

Downloads (Last 12 months)179
Downloads (Last 6 weeks)12

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen YCasiez GMalacria SVogel D(2024)LuxAR: A Direct Manipulation Projected Display to Extend and Augment Desktop ComputingProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670981(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670981
Emmert MSchönwerth NSchmid AWolff CWimmer R(2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670778
Gryphon KVu VChung H(2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614516
Hu EGrønbæk JYing WDu RHeo S(2023)ThingShare: Ad-Hoc Digital Copies of Physical Objects for Sharing Things in Video MeetingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581148(1-22)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581148
Grubert J(2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_5
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Liu CDai CMa QMehra BCassinelli A(2022)AngleCAD: Surface-Based 3D Modelling Techniques on Foldable TouchscreensProceedings of the ACM on Human-Computer Interaction10.1145/35677356:ISS(592-616)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567735
Homaeian LWallace JScott S(2022)Handoff and Deposit: Designing Temporal Coordination in Cross-Device Transfer Techniques for Mixed-Focus CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/35551926:CSCW2(1-23)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555192
Li DGe XMa QMehra BLiu JHan TLiu C(2022)Evaluating Three Touch Gestures for Moving Objects across Folded ScreensProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503096:3(1-28)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550309
Yuan YRiche NMarquardt NNicholas MSeyed TRomat HLee BPahud MGoldstein JVishkaie RHolz CHinckley K(2022)Understanding Multi-Device Usage Patterns: Physical Device Configurations and Fragmented WorkflowsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517702(1-22)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517702
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents