A Study on Collaborative Visual Data Analysis in Augmented Reality with Asymmetric Display Types
Authors: 
Judith Friedl-Knirsch, Christian Stach, Fabian Pointecker, Christoph Anthes, Daniel RothAuthors Info & Claims
Pages 2633 - 2643
Abstract
Collaboration is a key aspect of immersive visual data analysis. Due to its inherent benefit of seeing co-located collaborators, augmented reality is often useful in such collaborative scenarios. However, to enable the augmentation of the real environment, there are different types of technology available. While there are constant developments in specific devices, each of these device types provide different premises for collaborative visual data analysis. In our work we combine handheld, optical see-through and video see-through displays to explore and understand the impact of these different device types in collaborative immersive analytics. We conducted a mixed-methods collaborative user study where groups of three performed a shared data analysis task in augmented reality with each user working on a different device, to explore differences in collaborative behaviour, user experience and usage patterns. Both quantitative and qualitative data revealed differences in user experience and usage patterns. For collaboration, the different display types influenced how well participants could participate in the collaborative data analysis, nevertheless, there was no measurable effect in verbal communication.
References
[1]
R. T. Azuma. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, 6(4): pp. 355–385, Aug. 1997. 2.
[2]
H. Benko, E. Ishak, and S. Feiner. Collaborative Mixed Reality Visualization of an Archaeological Excavation. In Third IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 132–140. IEEE, Arlington, VA, USA, 2004. 2.
[3]
H. Benko, A. D. Wilson, and F. Zannier. Dyadic projected spatial augmented reality. In Proceedings of the 27th annual ACM symposium on User interface software and technology, pp. 645–655. ACM, Honolulu Hawaii USA, Oct. 2014. 2.
[4]
M. Billinghurst, M. Cordeil, A. Bezerianos, and T. Margolis. “Collaborative Immersive Analytics”. In K. Marriott, F. Schreiber, T. Dwyer, K. Klein, N. H. Riche, T. Itoh, W. Stuerzlinger, and B. H. Thomas, eds., Immersive Analytics, vol. 11190, pp. 221–257. Cham: Springer International Publishing. 2018. 1, 2.
[5]
M. Billinghurst and H. Kato. Collaborative mixed reality. In Proceedings of the first international symposium on mixed reality (ISMAR), pp. 261–284. 1999. 2.
[6]
M. Billinghurst, S. Weghorst, and T. Furness. Shared space: An augmented reality approach for computer supported collaborative work. Virtual Reality, 3(1): pp. 25–36, Mar. 1998. 2.
[7]
S. Butscher, S. Hubenschmid, J. Müller, J. Fuchs, and H. Reiterer. Clusters, Trends, and Outliers: How Immersive Technologies Can Facilitate the Collaborative Analysis of Multidimensional Data. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–12. ACM, Montreal QC Canada, Apr. 2018. 1, 2.
[8]
A. Butz, T. Hollerer, S. Feiner, B. MacIntyre, and C. Beshers. Enveloping users and computers in a collaborative 3D augmented reality. In Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99), pp. 35–44. IEEE Comput. Soc, San Francisco, CA, USA, 1999. 2.
[9]
R. M. Casseb do Carmo, B. S. Meiguins, A. S. G. Meiguins, S. C. V. Pinheiro, L. H. Almeida, and P. I. A. Godinho. Coordinated and Multiple Views in Augmented Reality Environment. In 2007 11 th International Conference Information Visualization (IV '07), pp. 156–162, 2007. 5.
[10]
M. Cavallo, M. Dolakia, M. Havlena, K. Ocheltree, and M. Podlaseck. Immersive Insights: A Hybrid Analytics System for Collaborative Exploratory Data Analysis. In Symposium on Virtual Reality Software and Technology (VRST), pp. 1–12. ACM, Parramatta NSW Australia, 2019. 1.
[11]
T. Chandler, M. Cordeil, T. Czauderna, T. Dwyer, J. Glowacki, C. Goncu, M. Klapperstueck, K. Klein, K. Marriott, F. Schreiber, and E. Wilson. “Immersive Analytics”. In 2015 Big Data Visual Analytics (BDVA), pp. 1–8. Hobart, Australia: IEEE, Sept. 2015. 1.
[12]
M. Cordeil, A. Cunningham, B. Bach, C. Hurter, B. H. Thomas, K. Marriott, and T. Dwyer. IATK: An Immersive Analytics Toolkit. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 200–209. IEEE, Osaka, Japan, Mar. 2019. 1, 4.
[13]
M. Cordeil, T. Dwyer, K. Klein, B. Laha, K. Marriott, and B. H. Thomas. Immersive Collaborative Analysis of Network Connectivity: CAVE-style or Head-Mounted Display? IEEE Transactions on Visualization and Computer Graphics, 23(1): pp. 441–450, Jan. 2017. 1.
[14]
J. Friedl-Knirsch, C. Stach, and C. Anthes. Exploring collaboration for data analysis in augmented reality for multiple devices. In 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 65–69, 65–69. 5.
[15]
B. Fröhler, C. Anthes, F. Pointecker, J. Friedl, D. Schwajda, A. Riegler, S. Tripathi, C. Holzmann, M. Brunner, H. Jodlbauer, H. Jetter, and C. Heinzl. A Survey on Cross-Virtuality Analytics. in Computer Graphics Forum, 41(1): pp. 465–494, Feb. 2022. 2.
[16]
M. Haller, M. Billinghurst, J. Leithinger, D. Leitner, and T. Seifried. Coeno: enhancing face-to-face collaboration. In Proceedings of the 2005 international conference on Augmented tele-existence - ICAT '05, p. 40. ACM Press, Christchurch, New Zealand, 2005. 2.
[17]
S. G. Hart. Nasa-Task Load Index (NASA-TLX); 20 Years Later. in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50(9): pp. 904–908, Oct. 2006. 6.
[18]
A. Henrysson, M. Billinghurst, and M. Ollila. Face to face collaborative AR on mobile phones. In Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05), pp. 80–89. IEEE, Vienna, Austria, 2005. 2.
[19]
S. Hubenschmid, J. Zagermann, S. Butscher, and H. Reiterer. STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI '21. Association for Computing Machinery, New York, NY, USA, 2021. 5.
[20]
R. Johansen. GroupWare: Computer Support for Business Teams. USA: The Free Press, 1988. 2.
[21]
R. S. Kennedy, N. E. Lane, K. S. Berbaum, and Michael G. Lilienthal. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology, 3(3): pp. 203–220, 1993. 6.
[22]
K. Kiyokawa, M. Billinghurst, S. Hayes, A. Gupta, Y. Sannohe, and H. Kato. Communication behaviors of co-located users in collaborative AR interfaces. In Proceedings. International Symposium on Mixed and Augmented Reality, pp. 139–148. IEEE Comput. Soc, Darmstadt, Germany, 2002. 5, 7, 9.
[23]
R. Langner, M. Satkowski, W. Büschel, and R. Dachselt. MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–17. ACM, Yokohama Japan, May 2021. 1, 2.
[24]
B. Laugwitz, T. Held, and M. Schrepp. Construction and Evaluation of a User Experience Questionnaire. In A. Holzinger, ed., in HCI and Usability for Education and Work, vol. 5298, pp. 63–76. Springer Berlin Heidelberg, Berlin, Heidelberg, 2008. 6.
[25]
B. Lee, X. Hu, M. Cordeil, A. Prouzeau, B. Jenny, and T. Dwyer. Shared Surfaces and Spaces: Collaborative Data Visualisation in a Co-located Immersive Environment. IEEE Transactions on Visualization and Computer Graphics, 27(2): pp. 1171–1181, Feb. 2021. 1.
[26]
A. MacWilliams, C. Sandor, M. Wagner, M. Bauer, G. Klinker, and B. Bruegge. Herding sheep: live system for distributed augmented reality. In The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings., pp. 123–132. IEEE Comput. Soc, Tokyo, Japan. 2003. 2.
[27]
T. Mahmood, E. Butler, N. Davis, J. Huang, and A. Lu. Building Multiple Coordinated Spaces for Effective Immersive Analytics through Distributed Cognition. In 2018 International Symposium on Big Data Visual and Immersive Analytics (BDVA), pp. 1–11. IEEE, Konstanz, Oct. 2018. 22.
[28]
P. Milgram, H. Takemura, A. Utsumi, and F. Kishino. “Augmented reality: a class of displays on the reality-virtuality continuum”. In H. Das, ed., Telemanipulator and telepresence technologies, pp. 282–292. Boston, MA, Dec. 1995. 1, 2, 3.
[29]
M. Mohring, C. Lessig, and O. Bimber. Video See-Through AR on Consumer Cell-Phones. In Third IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 252–253. IEEE, Arlington, VA, USA. 2004. 2.
[30]
S. Nilsson, B. Johansson, and A. Jonsson. Using AR to support cross-organisational collaboration in dynamic tasks. In 2009 8th IEEE International Symposium on Mixed and Augmented Reality, pp. 3–12. IEEE, Orlando, FL, USA, Oct. 2009. 2.
[31]
T. Ohshima, K. Satoh, H. Yamamoto, and H. Tamura. AR/sup 2/Hockey: a case study of collaborative augmented reality. In Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180), pp. 268–275. IEEE Comput. Soc, Atlanta, GA, USA, 1998. 2.
[32]
D. N. E. Phon, M. B. Ali, and N. D. A. Halim. Collaborative Augmented Reality in Education: A Review. In 2014 International Conference on Teaching and Learning in Computing and Engineering, pp. 78–83. IEEE, Kuching, Malaysia, Apr. 2014. 2.
[33]
C. Pidel and P. Ackermann. “Collaboration in Virtual and Augmented Reality: A Systematic Overview”. In L. T. De Paolis and P. Bourdot, eds., Augmented Reality, Virtual Reality, and Computer Graphics, vol. 12242, pp. 141–156. Cham: Springer International Publishing, 2020. 2.
[34]
F. Pointecker, D. Schwajda, D. List, and C. Anthes. A Generic Architecture for Cross-Virtuality. In ISS'21 Workshop Proceedings: “Transitional Interfaces in Mixed and Cross-Reality: A new frontier?”, 2021. 4.
[35]
I. Radu, V. Hv, and B. Schneider. Unequal Impacts of Augmented Reality on Learning and Collaboration During Robot Programming with Peers. in Proceedings of the ACM on Human-Computer Interaction, 4(CSCW3): pp. 1–23, Jan. 2021. 2.
[36]
P. Reipschlager, T. Flemisch, and R. Dachselt. Personal Augmented Reality for Information Visualization on Large Interactive Displays. IEEE Transactions on Visualization and Computer Graphics, 27(2): pp. 1182–1192, Feb. 2021. 2.
[37]
J. Rekimoto. Transvision: A Hand-Held Augmented Reality System for Collaborative Design. in Proceedings of Virtual Systems and Multi-Media (VSMM '96), 1996. 2.
[38]
A. Riegler, C. Anthes, H.-C. Jetter, C. Heinzl, C. Holzmann, H. Jodlbauer, M. Brunner, S. Auer, J. Friedl, B. Fröhler, C. Leitner, F. Pointecker, D. Schwajda, and S. Tripathi. Cross-Virtuality Visualization, Interaction and Collaboration. In International Workshop on Cross-Reality (XR) Interaction co-located with the 14th ACM International Conference on Interactive Surfaces and Spaces (ACM ISS 2020). Lisbon, Portugal, Nov. 2020. 1.
[39]
J. P. Rolland, R. L. Holloway, and H. Fuchs. “Comparison of optical and video see-through, head-mounted displays”. In H. Das, ed., Telemanipulator and Telepresence Technologies, pp. 293–307. Boston, MA, Dec. 1995. 1, 2, 3.
[40]
D. Schmalstieg, A. Fuhrmann, G. Hesina, Z. Szalavári, L. M. Encarnação, M. Gervautz, and W. Purgathofer. The Studierstube Augmented Reality Project. Presence: Teleoperators and Virtual Environments, 11(1): pp. 33–54, Feb. 2002. 2.
[41]
M. R. Seraji and W. Stuerzlinger. XVCollab: An Immersive Analytics Tool for Asymmetric Collaboration across the Virtuality Spectrum. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 146–154. IEEE, Singapore, Singapore, Oct. 2022. 1, 2.
[42]
M. Sereno, L. Besançon, and T. Isenberg. Supporting Volumetric Data Visualization and Analysis by Combining Augmented Reality Visuals with Multi-Touch Input. EuroVis 2019 - Posters, p. 3 pages, 2019. 2.
[43]
M. Sereno, X. Wang, L. Besancon, M. J. Mcguffin, and T. Isenberg. Collaborative Work in Augmented Reality: A Survey. IEEE Transactions on Visualization and Computer Graphics, pp. 1–1, 2020. 1, 2.
[44]
M. Slater. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1535): pp. 3549–3557, Dec. 2009. 3.
[45]
J. Smiley, B. Lee, S. Tandon, M. Cordeil, L. Besançon, J. Knibbe, B. Jenny, and T. Dwyer. The MADE-Axis: A Modular Actuated Device to Embody the Axis of a Data Dimension. in Proceedings of the ACM on Human-Computer Interaction, 5(ISS): 501: pp. 1–501: 23, Nov. 2021. 5.
[46]
T. A. Syed, M. S. Siddiqui, H. B. Abdullah, S. Jan, A. Namoun, A. Alzahrani, A. Nadeem, and A. B. Alkhodre. In-Depth Review of Augmented Reality: Tracking Technologies, Development Tools, AR Displays, Collaborative AR, and Security Concerns. Sensors, 23(1s): pp. 146, Dec. 2022. 2.
[47]
Z. Szalavari, D. Schmalstieg, A. Fuhrmann, and M. Gervautz. Studierstube: An environment for collaboration in augmented reality. Virtual Reality, 3(1): pp. 37–48, Mar. 1998. 2.
[48]
X. Wang, L. Besançon, D. Rousseau, M. Sereno, M. Ammi, and T. Isenberg. Towards an Understanding of Augmented Reality Extensions for Existing 3D Data Analysis Tools. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13. ACM, Honolulu HI USA, Apr. 2020. 2.
Recommendations
Collaborative Augmented Reality: Multi-user Interaction in Urban Simulation
IVIC '09: Proceedings of the 1st International Visual Informatics Conference on Visual Informatics: Bridging Research and PracticeAugmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration ...
Collaborative Augmented Reality Approach for Multi-user Interaction in Urban Simulation
ICIMT '09: Proceedings of the 2009 International Conference on Information and Multimedia TechnologyAugmented reality (AR) environment allows user or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban simulation, where users can interact naturally and intuitively. AR collaboration ...
Exploring User Behaviour in Asymmetric Collaborative Mixed Reality
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and TechnologyA common issue for collaborative mixed reality is the asymmetry of interaction with the shared virtual environment. For example, an augmented reality (AR) user might use one type of head-mounted display (HMD) in a physical environment, while a virtual ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© 2024 The Authors. This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/.
Publisher
IEEE Educational Activities Department
United States
Publication History
Published: 04 March 2024
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in