research-article

Multi-point interactions with immersive omnidirectional visualizations in a dome

Authors:

Andrew D. WilsonAuthors Info & Claims

ITS '10: ACM International Conference on Interactive Tabletops and Surfaces

Pages 19 - 28

https://doi.org/10.1145/1936652.1936657

Published: 07 November 2010 Publication History

Abstract

This paper describes an interactive immersive experience using mid-air gestures to interact with a large curved display: a projected dome. Our Pinch-the-Sky Dome is an immersive installation where several users can interact simultaneously with omnidirectional data using freehand gestures. The system consists of a single centrally-located omnidirectional projector-camera unit where the projector is able to project an image spanning the entire 360 degrees and a camera is used to track gestures for navigation of the content. We combine speech commands with freehand pinch and clasping gestures and infra-red laser pointers to provide a highly immersive and interactive experience to several users inside the dome, with a very wide field of view for each user. The interactive applications include: 1) the astronomical data exploration, 2) social networking 3D graph visualizations, 3) immersive panoramic images, 4) 360 degree video conferencing, 5) a drawing canvas, and 6) a multi-user interactive game. Finally, we discuss the user reactions and feedback from two demo events where more than 1000 people had the chance to experience our work.

Supplementary Material

JPG File (p19-benko.jpg)

Download
10.25 KB

WMV File (p19-benko.wmv)

Download
30.88 MB

References

[1]

Benko, H. 2009. Beyond Flat Surface Computing: Challenges of Depth-Aware and Curved Interfaces. In Proc. ACM MultiMedia '09. p. 935--944.

Digital Library

[2]

Benko, H. and Wilson, A. D. 2010. Pinch-the-sky dome: freehand multi-point interactions with immersive omni-directional data. Extended Abstracts ACM SIGCHI '10. p. 3045--3050.

Digital Library

[3]

Benko, H., Wilson, A., and Balakrishnan, R. 2008. Sphere: Multi-Touch Interactions on a Spherical Display. In Proc. ACM UIST '08. p. 77--86.

Digital Library

[4]

Buxton, W. 1990. A three-state model of graphical input. In Proc. IFIP Tc13 Third International Conference on Human-Computer interaction (August 27--31, 1990). p. 449--456.

Digital Library

[5]

Cruz-Neira, C., Sandin, D. J., and DeFanti, T. A. 1993. Surround-screen projection-based virtual reality: The design and implementation of the CAVE. In Proc. ACM SIGGRAPH '93. p. 135--142.

Digital Library

[6]

Emmart, C. 2001. Tools and Techniques for Realtime Dome Production and Education. Computer Graphics for Large Scale Immersive Theaters. SIGGRAPH '01 Course Notes.

[7]

Fitzmaurice, G., Khan, A., Buxton, W., Kurtenbach, G., and Balakrishnan, R. 2003. Sentient data access via a diverse society of devices. ACM Queue. p. 53--62.

Digital Library

[8]

Fukuchi, K., Sato, T., Mamiya, H., and Koike, H. 2010. Pac-pac: pinching gesture recognition for tabletop entertainment system. In Proc. ACM AVI '10. p. 267--273.

Digital Library

[9]

Gaitatzes, A., Papaioannou, G., Christopoulos, D., and Zyba, G. 2006. Media productions for a dome display system. In Proc. ACM VRST '06. p. 261--264.

Digital Library

[10]

Gray, J. and Szalay, A. 2002. The World Wide Telescope: An Archetype for Online Science. Microsoft Research Technical Report MSR-TR-2002-75. June '02.

[11]

Hilliges, O., Izadi, S., Wilson, A. D., Hodges, S., Garcia-Mendoza, A., and Butz, A. 2009. Interactions in the Air: Adding Further Depth to Interactive Tabletops. In Proc. ACM UIST '09. p. 139--148.

Digital Library

[12]

Hua, H., Brown, L. D., and Gao, C. 2004. Scape: Supporting Stereoscopic Collaboration in Augmented and Projective Environments. IEEE Computer Graphics and Applications. 24, 1 (Jan. 2004). p. 66--75.

Digital Library

[13]

Kaiser, E., Olwal, A., McGee, D., Benko, H., Corradini, A., Li, X., Cohen, P., and Feiner, S. 2003. Mutual Disambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality. In Proc. ICMI '03. p. 12--19.

Digital Library

[14]

Krueger, M. W., Gionfriddo, T., and Hinrichsen, K. 1985. VIDEOPLACE---an artificial reality. SIGCHI Bull. 16, 4 (Apr. '85). p. 35--40.

Digital Library

[15]

LaViola, J. 2000. MSVT: A Virtual Reality-Based Multimodal Scientific Visualization Tool. In Proc. IASTED International Conference on Computer Graphics and Imaging. p. 1--7.

[16]

Magnor, M., Sen, P., Kniss, J., Angel, E., and Wenger, S. 2010. Progress in Rendering and Modeling for Digital Planetariums. In Proc. of EUROGRAPHICS '10.

[17]

Matsushita, N. and Rekimoto, J. 1997. HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall. In Proc. ACM UIST '99. p. 209--210.

Digital Library

[18]

Mapes, D. P. and Moshell, J. M. 1995. A two-handed interface for object manipulation in virtual environments. PRESENCE: Teleoperators and Virtual Environments, 4(4). p. 403--416.

[19]

Myers, B. A., Bhatnagar, R., Nichols, J., Peck, C. H., Kong, D., Miller, R., and Long, A. C. 2002. Interacting at a distance: measuring the performance of laser pointers and other devices. In Proc. ACM SIGCHI '02. p. 33--40.

Digital Library

[20]

Oh, J.-Y. and Stuerzlinger, W. 2002. Laser Pointers as Collaborative Pointing Devices, In Proc. Graphics Interface '02. p. 141--149.

[21]

Olsen, D. R. and Nielsen, T. 2001. Laser pointer Interaction. In Proc. ACM SIGCHI '01. p. 17--22.

Digital Library

[22]

Pinhanez, C. S. 2001. The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces. In Proc. UBICOMP '01. p. 315--331.

Digital Library

[23]

Poupyrev, I., Billinghurst, M., Weghorst, S., and Ichikawa, T. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proc. ACM UIST '96. p. 79--80.

Digital Library

[24]

Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. 1998. The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays. In Proc. ACM SIGGRAPH '98. p. 179--188.

Digital Library

[25]

Sato, Y., Saito, M. and Koike, H. 2001. Real-time input of 3D pose and gestures of a user's hand and its applications for HCI. In. Proc. IEEE VR '01. p. 79--86.

Digital Library

[26]

Shoemaker, G., Tang, A., and Booth, K. S. 2007. Shadow reaching: a new perspective on interaction for large displays. In Proc. ACM UIST '07. p. 53--56.

Digital Library

[27]

Simon, A. 2005. First-person experience and usability of co-located interaction in a projection-based virtual environment. In Proc. ACM VRST '05. p. 23--30.

Digital Library

[28]

Simon, A. and Göbel, M. 2002. The i-Cone -- A Panoramic Display System for Virtual Environments. In Proc. Pacific Conference on Computer Graphics and Applications. p. 3--7.

Digital Library

[29]

Stanney, K. M., Mourant, R. R., and Kennedy, R. S. 1998. Human Factors Issues in Virtual Environments: A Review of the Literature. Presence 7(4). p. 327--351.

Digital Library

[30]

Wilson, A. 2006. Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input. In Proc. ACM UIST '06. p. 255--258.

Digital Library

[31]

Wilson, A. 2007. Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction. In Proc. IEEE TABLETOP '07. p. 201--204.

[32]

Wren, C., Azarbayejani, A., Darrell, T., and Pentland, A. 1997. Pfinder: real-time tracking of the human body. IEEE Trans. PAMI, 19 (7). p. 780--785.

Digital Library

[33]

Yilmaz, A., Javed, O., and Shah, M. 2006. Object tracking: A survey. ACM Computing Surveys. 38(4). (Dec. '06), Article #13.

Digital Library

Cited By

Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Mich OSchiavo GFerron MMana N(2022)Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older PeopleResearch Anthology on Supporting Healthy Aging in a Digital Society10.4018/978-1-6684-5295-0.ch028(496-519)Online publication date: 4-Feb-2022
https://doi.org/10.4018/978-1-6684-5295-0.ch028
Xu RSato TMiyafuji SKoike HBottoni PPanizzi E(2022)OmniLantern: Design and Implementations of a Portable and Coaxial Omnidirectional Projector-Camera SystemProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531126(1-5)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3531126
Show More Cited By

Index Terms

Multi-point interactions with immersive omnidirectional visualizations in a dome
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Pinch-the-sky dome: freehand multi-point interactions with immersive omni-directional data
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

Pinch-the-Sky Dome is a large immersive installation where several users can interact simultaneously with omni-directional data inside of a tilted geodesic dome. Our system consists of an omni-directional projector-camera unit in the center of the dome. ...
Vulture: a mid-air word-gesture keyboard
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Word-gesture keyboards enable fast text entry by letting users draw the shape of a word on the input surface. Such keyboards have been used extensively for touch devices, but not in mid-air, even though their fluent gestural input seems well suited for ...
Interactive dome experiences: designing astrosurf
AcademicMindtrek '16: Proceedings of the 20th International Academic Mindtrek Conference

Dome and display technology have evolved to the point that designing interactive dome experiences no longer requires expertise with dome technology. In particular, the DomeLab provides an interface for designers to work with popular game development ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '10: ACM International Conference on Interactive Tabletops and Surfaces

November 2010

327 pages

ISBN:9781450303996

DOI:10.1145/1936652

General Chairs:
Antonio Krüger,
Johannes Schöning,
Program Chairs:
Daniel Wigdor,
Michael Haller

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 November 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS'10

Sponsor:

SIGCHI

ITS'10: Interactive Tabletops and Surfaces

November 7 - 10, 2010

Saarbrücken, Germany

Acceptance Rates

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

51
Total Citations
View Citations
974
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)8

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Mich OSchiavo GFerron MMana N(2022)Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older PeopleResearch Anthology on Supporting Healthy Aging in a Digital Society10.4018/978-1-6684-5295-0.ch028(496-519)Online publication date: 4-Feb-2022
https://doi.org/10.4018/978-1-6684-5295-0.ch028
Xu RSato TMiyafuji SKoike HBottoni PPanizzi E(2022)OmniLantern: Design and Implementations of a Portable and Coaxial Omnidirectional Projector-Camera SystemProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531126(1-5)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3531126
Besançon LYnnerman AKeefe DYu LIsenberg T(2021)The State of the Art of Spatial Interfaces for 3D VisualizationComputer Graphics Forum10.1111/cgf.1418940:1(293-326)Online publication date: 6-Jan-2021
https://doi.org/10.1111/cgf.14189
Zhou WLi TLi SZhu Y(2021)Color-in-fist: a metaphor for color selection with mid-air interactionJournal of Visualization10.1007/s12650-021-00792-wOnline publication date: 20-Sep-2021
https://doi.org/10.1007/s12650-021-00792-w
Mich OSchiavo GFerron MMana N(2020)Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older PeopleInternational Journal of Mobile Human Computer Interaction10.4018/IJMHCI.202001010212:1(22-41)Online publication date: 1-Jan-2020
https://doi.org/10.4018/IJMHCI.2020010102
Englmeier DO'Hagan JZhang MAlt FButz AHöllerer TWilliamson JLamas DSarapuu HŠmorgun IBerget G(2020)TangibleSphere – Interaction Techniques for Physical and Virtual Spherical DisplaysProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420101(1-11)Online publication date: 25-Oct-2020
https://dl.acm.org/doi/10.1145/3419249.3420101
Li ZTeo TChan LLee GAdcock MBillinghurst MKoike HWakkary RAndersen KOdom WDesjardins APetersen M(2020)OmniGlobeVRProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395429(615-625)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395429
Li ZChan LTeo TKoike HBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)OmniGlobeVR: A Collaborative 360° Communication System for VRExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3382869(1-8)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3382869
Miyafuji SPerteneder FSato TKoike HKlinker GJorge JKim JVan Eyken HGlencross MMitchell KNarumi T(2019)A Bowl-Shaped Display for Controlling Remote VehiclesProceedings of the 17th International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3359997.3365706(1-8)Online publication date: 14-Nov-2019
https://dl.acm.org/doi/10.1145/3359997.3365706
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents