Article

Understanding the design space of referencing in collaborative augmented reality environments

Authors:

Jeffrey W. Chastine,

Kristine Nagel,

Luca YearsovichAuthors Info & Claims

GI '07: Proceedings of Graphics Interface 2007

Pages 207 - 214

https://doi.org/10.1145/1268517.1268552

Published: 28 May 2007 Publication History

Abstract

For collaborative environments to be successful, it is critical that participants have the ability to generate effective references. Given the heterogeneity of the objects and the myriad of possible scenarios for collaborative augmented reality environments, generating meaningful references within them can be difficult. Participants in co-located physical spaces benefit from non-verbal communication, such as eye gaze, pointing and body movement; however, when geographically separated, this form of communication must be synthesized using computer-mediated techniques. We have conducted an exploratory study using a collaborative building task of constructing both physical and virtual models to better understand inter-referential awareness -- or the ability for one participant to refer to a set of objects, and for that reference to be understood. Our contributions are not necessarily in presenting novel techniques, but in narrowing the design space for referencing in collaborative augmented reality. This study suggests collaborative reference preferences are heavily dependent on the context of the workspace.

References

[1]

J. W. Chastine, J. C. Brooks, Y. Zhu, G. S. Owen, R. W. Harrison, and I. T. Weber, "AMMP-Vis: A Collaborative Virtual Environment for Molecular Modeling," in VRST - ACM Symposium on Virtual Reality Software and Technology. Monterey, CA, 2005.

Digital Library

[2]

M. Bajura, H. Fuchs, and R. Ohbuchi, "Merging Virtual Objects with the Real World," Computer Graphics, vol. 26, pp. 203--210, 1992.

Digital Library

[3]

W. Gaver, "The affordances of media spaces for collaboration," in Computer Supported Cooperative Work (CSCW), 1992.

Digital Library

[4]

S. R. Fussell, Kraut, R. E, Setlock, L. D., "Coordination of Communication: Effects of Shared Visual Context on Collaborative Work," in Computer Supported Collaborative Work (CSCW). Philedelphia, PA, 2000.

Digital Library

[5]

S. R. Fussell, Setlock, L. D., Kraut, R. E, "Effects of Head-Mounted and Scene-Oriented Video Systems on Remote Collaboration on Physical Tasks," in CHI. Ft. Lauderdale, FL, 2003.

Digital Library

[6]

R. E. Kraut, Miller, M., Siegel, J., "Collaboration in Performance of Physical Tasks: Effects on Outcomes and Communication," in Computer-Supported Cooperative Work. Cambridge, MA, 1996.

Digital Library

[7]

J. Ou, Fussell, S. R., Chen, X., Setlock, L. D., Yang, J., "Gestural Communication over Video Stream: Supporting Multimodal Interaction for Remote Collaborative Physical Tasks," in ICMI. Vancouver, British Columbia, Canada, 2003.

Digital Library

[8]

A. Ranjan, Birnholtz, J. P., Balakrishnan, R., "An Exploratory Analysis of Partner Action and Camera Control in a Video-Mediated Collaborative Task," in Computer Supported Collaborative Work (CSCW). Banff, Alberta, Canada, 2006.

Digital Library

[9]

J. Hindmarsh, Fraser, M., Heath, C., Benford, S., Greenlaugh, C., "Object-Focused Interaction in Collaborative Virtual Environments," ACM Transactions on Computer-Human Interaction, vol. 7, pp. 477--509, 2001.

Digital Library

[10]

K. Ahlers, A. Kramer, D. E. Breen, P. Y. Chevalier, C. Crampton, E. Rose, M. Tuceryan, R. T. Whitaker, and D. Greer, "Distributed Augmented Reality for Collaborative Design Applications," in Eurographics. Maastricht, NL, 1995.

[11]

M. Billinghurst, Bee, S., Bowskill, J., Kato, H., "Asymmetries in Collaborative Wearable Interfaces," in The Third International Symposium on Wearable Computers. Digest of Papers, 1999, pp. 133--140.

Digital Library

[12]

K. B. Kiyokawa, M., S. E. Hayes, A. Gupta, Y. Sannohe, and H. Kato, "Communication Behaviors of Co-located Users in Collaborative AR Interfaces," in International Symposium of Mixed and Augmented Reality (ISMAR), 2002.

Digital Library

[13]

M. Bauer, G. Kortuem, and Z. Segall, ""Where are you pointing at?" A Study of Remote Collaboration in a Wearable Videoconferencing System," in International Symposium on Wearable Computing (ISWC), 1999.

Digital Library

[14]

L. Cheng and J. Robinson, "Dealing with Speed and Robustness Issues for Video-Based Registration on a Wearable Computing Platform," in International Symposium on Wearable Computing (ISWC), 1998.

Digital Library

[15]

A. Newport, Anderson, A., Thomson, A., Ion, B., Dickson, N., "Using Speech Related Gestures to Aid Referential Communication in Face-to-face and Computer Supported Collaborative Work," in First Congress of the International Society for Gesture Studies. Austin, TX, 2002.

[16]

A. Stafford, Piekarski, W., Thomas, B. H., "Implementation of God-like Interaction Techniques for Supporting Collaboration Between Outdoor AR and Indoor Tabletop Users," in International Symposium on Mixed and Augmented Reality (ISMAR), 2006.

Digital Library

[17]

B. H. Thomas and W. Piekarski, "Glove Based User Interaction Techniques for Augmented Reality in an Outdoor Environment," Virtual Reality: Research, Development and Applications, vol. 6, 2002.

[18]

J. W. Chastine, J. C. Brooks, Y. Zhu, C. Owen, R. W. Harrison, and I. T. Weber, "Emphasizing the Area of Interest Using Real-Time Shaders," in SIGGRAPH Poster Session. Los Angeles, CA, 2005.

Digital Library

[19]

F. Biocca, A. Tang, C. Owen, and F. Xiao, "Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms.," in Conference on Human Factors in Computing Systems (SIGCHI). Montreal, Canada, 2006.

Digital Library

[20]

J. W. Chastine, Zhu, Y., Preston, J. A, "A Framework for Inter-referential Awareness in Collaborative Environments," in 2nd International Conference on Collaborative Computing. Atlanta, GA, 2006.

[21]

D. Bowman, E. Kruijff, J. LaVoila, and I. Poupyrev, 3D User Interfaces: Theory and Practice: Addison-Wesley Professional, 2004.

Digital Library

[22]

H. H. Clark, Brennan, S. E., "Grounding in Communication," in Perspectives on Socially Shared Cognition, L. B. Resnick, Levine, J., Teasley, S. D., Ed. Washington, DC: American Psychological Association, 1991, pp. 17--149.

[23]

B. MacIntyre, M. Gandy, S. Dow, and J. D. Bolter, "DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences," in User Interface Software and Technology (UIST). Santa Fe, NM, 2004.

Digital Library

[24]

H. Kato and M. Billinghurst, "ARToolKit, Technical Report," Hiroshima City University, 1999.

Cited By

Zhang LPan JGettig JOney SGuo A(2024)VRCopilot: Authoring 3D Layouts with Generative AI Models in VRProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676451(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676451
Huang WBillinghurst MAlem LXiao CRasmussen THuang WBillinghurst MAlem LXiao CRasmussen T(2024)Communication Models for Remote GuidanceComputer‐Supported Collaboration10.1002/9781119719830.ch2(7-40)Online publication date: 24-May-2024
https://doi.org/10.1002/9781119719830.ch2
Kintscher MHuang JArunkumar AAmresh ABryan C(2023)Measuring and Comparing Collaborative Visualization Behaviors in Desktop and Augmented Reality EnvironmentsProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615691(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615691
Show More Cited By

Index Terms

Understanding the design space of referencing in collaborative augmented reality environments
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Collaborative and social computing
  2. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Recommendations

The cost of supporting references in collaborative augmented reality
GI '08: Proceedings of Graphics Interface 2008

For successful collaboration to occur, a fundamental requirement is the ability for participants to refer to artifacts within the shared environment. This task is often straightforward in traditional collaborative desktop applications, yet the spatial ...
Collaborative Augmented Reality: Multi-user Interaction in Urban Simulation
IVIC '09: Proceedings of the 1st International Visual Informatics Conference on Visual Informatics: Bridging Research and Practice

Augmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration ...
Exploring group awareness in a mixed reality collaborative environment
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

Mixed reality collaborative environments connect physical and virtual worlds to present an integrated collaborative space for remote and co-located collaborators. We designed an immersive mixed reality environment using Unity 3D¹ and an Oculus Rift²head-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

GI '07: Proceedings of Graphics Interface 2007

May 2007

352 pages

ISBN:9781568813370

DOI:10.1145/1268517

Program Chairs:
Christopher G. Healey
North Carolina State University
,
Edward Lank
University of Waterloo

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

CHCCS: The Canadian Human-Computer Communications Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 May 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 206 of 508 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
1,054
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)4

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang LPan JGettig JOney SGuo A(2024)VRCopilot: Authoring 3D Layouts with Generative AI Models in VRProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676451(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676451
Huang WBillinghurst MAlem LXiao CRasmussen THuang WBillinghurst MAlem LXiao CRasmussen T(2024)Communication Models for Remote GuidanceComputer‐Supported Collaboration10.1002/9781119719830.ch2(7-40)Online publication date: 24-May-2024
https://doi.org/10.1002/9781119719830.ch2
Kintscher MHuang JArunkumar AAmresh ABryan C(2023)Measuring and Comparing Collaborative Visualization Behaviors in Desktop and Augmented Reality EnvironmentsProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615691(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615691
Letter MGeorge CWolf K(2023)A Survey of Computer-Supported Remote Collaboration on Physical ObjectsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42286-7_19(346-368)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42286-7_19
Halonen RCherukuri AJ. D(2022)Augmented Reality Assistance for Aging PeopleInternational Journal of Information Systems and Social Change10.4018/IJISSC.30360413:1(1-17)Online publication date: 13-Jul-2022
https://dl.acm.org/doi/10.4018/IJISSC.303604
Chen LLiu YLi YYu LGao BCaon MYue YLiang H(2021)Effect of Visual Cues on Pointing Tasks in Co-located Augmented Reality CollaborationProceedings of the 2021 ACM Symposium on Spatial User Interaction10.1145/3485279.3485297(1-12)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3485279.3485297
Poretski LLanir JMargalit RArazy O(2021)Physicality As an Anchor for Coordination: Examining Collocated Collaboration in Physical and Mobile Augmented Reality SettingsProceedings of the ACM on Human-Computer Interaction10.1145/34798575:CSCW2(1-29)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3479857
Johnson JGasques DSharkey TSchmitz EWeibel NKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Do You Really Need to Know Where “That” Is? Enhancing Support for Referencing in Collaborative Mixed Reality EnvironmentsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445246(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445246
Prilla M(2019)"I simply watched where she was looking at"Proceedings of the ACM on Human-Computer Interaction10.1145/33611273:GROUP(1-21)Online publication date: 5-Dec-2019
https://dl.acm.org/doi/10.1145/3361127
Müller JZagermann JWieland JPfeil UReiterer H(2019)A Qualitative Comparison Between Augmented and Virtual Reality Collaboration with Handheld DevicesProceedings of Mensch und Computer 201910.1145/3340764.3340773(399-410)Online publication date: 8-Sep-2019
https://dl.acm.org/doi/10.1145/3340764.3340773
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents