research-article

A Survey on Remote Assistance and Training in Mixed Reality Environments

Authors:

Catarina G. Fidalgo,

Maurício Sousa,

David Lindlbauer,

Joaquim JorgeAuthors Info & Claims

IEEE Transactions on Visualization and Computer Graphics, Volume 29, Issue 5

Pages 2291 - 2303

https://doi.org/10.1109/TVCG.2023.3247081

Published: 01 May 2023 Publication History

Abstract

The recent pandemic, war, and oil crises have caused many to reconsider their need to travel for education, training, and meetings. Providing assistance and training remotely has thus gained importance for many applications, from industrial maintenance to surgical telemonitoring. Current solutions such as video conferencing platforms lack essential communication cues such as spatial referencing, which negatively impacts both time completion and task performance. Mixed Reality (MR) offers opportunities to improve remote assistance and training, as it opens the way to increased spatial clarity and large interaction space. We contribute a survey of remote assistance and training in MR environments through a systematic literature review to provide a deeper understanding of current approaches, benefits and challenges. We analyze 62 articles and contextualize our findings along a taxonomy based on degree of collaboration, perspective sharing, MR space symmetry, time, input and output modality, visual display, and application domain. We identify the main gaps and opportunities in this research area, such as exploring collaboration scenarios beyond one-expert-to-one-trainee, enabling users to move across the reality-virtuality spectrum during a task, or exploring advanced interaction techniques that resort to hand or eye tracking. Our survey informs and helps researchers in different domains, including maintenance, medicine, engineering, or education, build and evaluate novel MR approaches to remote training and assistance. All supplemental materials are available at https://augmented-perception.org/publications/2023-training-survey.html.

References

[1]

P. Abtahi, S. Q. Hough, J. A. Landay, and S. Follmer. Beyond being real: A sensorimotor control perspective on interactions in virtual reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, CHI '22. Association for Computing Machinery, New York, NY, USA, 2022. 7.

Digital Library

[2]

M. Adcock, S. Anderson, and B. Thomas. Remotefusion: real time depth camera fusion for remote collaboration on physical tasks. In Proceedings of the 12th ACM SIGGRAPH international conference on virtual-reality continuum and its applications in industry, pp. 235–242, 2013. 14.

[3]

M. Adcock, D. Ranatunga, R. Smith, and B. H. Thomas. Object-based touch manipulation for remote guidance of physical tasks. In Proceedings of the 2nd ACM symposium on Spatial user interaction, pp. 113–122, 2014. 6, 14.

Digital Library

[4]

A. Ansar, D. Rodrigues, J. P. Desai, K. Daniilidis, V. Kumar, and M. F. Campos. Visual and haptic collaborative tele-presence. Computers & Graphics, 25(5):789–798, 2001. 6, 14.

[5]

D. Aschenbrenner, M. Li, R. Dukalski, J. Verlinden, and S. Lukosch. Collaborative production line planning with augmented fabrication. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 509–510. IEEE, 2018. 6, 14.

[6]

J. Auda, L. Busse, K. Pfeuffer, U. Gruenefeld, R. Rivu, F. Alt, and S. Schneegass. I'm in control! transferring object ownership between remote users with haptic props in virtual reality. In Symposium on Spatial User Interaction, pp. 1–10, 2021. 6,14.

[7]

H. Bai, P. Sasikumar, J. Yang, and M. Billinghurst. A user study on mixed reality remote collaboration with eye gaze and hand gesture sharing. In Proceedings of the 2020 CHI conference on human factors in computing systems, pp. 1–13, 2020. 14.

Digital Library

[8]

Z. Bai and A. F. Blackwell. Analytic review of usability evaluation in ismar. Interacting with Computers, 24(6):450–460, 2012. 3.

Digital Library

[9]

T. Bednarz, C. James, C. Caris, K. Haustein, M. Adcock, and C. Gunn. Applications of networked virtual reality for tele-operation and tele-assistance systems in the mining industry. In Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, pp. 459–462, 2011. 6,14.

Digital Library

[10]

S. Bottecchia, J.-M. Cieutat, and J.-P. Jessel. Tac: augmented reality system for collaborative tele-assistance in the field of maintenance through internet. In Proceedings of the 1st augmented human international conference,pp. 1–7, 2010.6,14.

[11]

F. Brudy, C. Holz, R. Rädle, C.-J. Wu, S. Houben, C. N. Klokmose, and N. Marquardt. Cross-device taxonomy: Survey, opportunities and challenges of interactions spanning across multiple devices. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI '19, p. 1–28. Association for Computing Machinery, New York, NY, USA, 2019. 7.

Digital Library

[12]

J. Carmigniani, B. Furht, M. Anisetti, P. Ceravolo, E. Damiani, and M. Ivkovic. Augmented reality technologies, systems and applications. Multimedia tools and applications, 51(1):341–377, 2011. 2.

Digital Library

[13]

X. Chen, Z. Chen, Y. Li, T. He, J. Hou, S. Liu, and Y. He. Immertai: Immersive motion learning in vr environments. Journal of Visual Communication and Image Representation, 58:416–427, 2019. 6.

[14]

M. Cidota, S. Lukosch, D. Datcu, and H. Lukosch. Workspace awareness in collaborative ar using hmds: a user study comparing audio and visual notifications. In Proceedings of the 7th Augmented Human International Conference 2016, pp. 1–8, 2016. 14.

[15]

D. Clergeaud, J. S. Roo, M. Hachet, and P. Guitton. Towards seamless interaction between physical and virtual locations for asymmetric collaboration. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, pp. 1–4, 2017.5,6, 14.

Digital Library

[16]

M. C. Davis, D. D. Can, J. Pindrik, B. G. Rocque, and J. M. Johnston. Virtual interactive presence in global surgical education: international collaboration through augmented reality. World neurosurgery, 86:103–111, 2016. 6, 14.

[17]

S. De Freitas and T. Neumann. Pedagogic strategies supporting the use of synchronous audiographic conferencing: A review of the literature. British Journal of Educational Technology, 40(6):980–998, 2009. 2.

[18]

V. Domova, E. Vartiainen, and M. Englund. Designing a remote video collaboration system for industrial settings. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces, pp. 229–238, 2014.6,14.

Digital Library

[19]

M. Feick, T. Mok, A. Tang, L. Oehlberg, and E. Sharlin. Perspective on and re-orientation of physical proxies in object-focused remote collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 281. ACM, 2018. 5.

[20]

M. Funk, M. Kritzler, and F. Michahelles. Holocollab: a shared virtual platform for physical assembly training using spatially-aware head-mounted displays. pp. 1–7, 102017. 3.

Digital Library

[21]

L. Gao, H. Bai, M. Billinghurst, and R. W. Lindeman. User behaviour analysis of mixed reality remote collaboration with a hybrid view interface. In 32nd Australian Conference on Human-Computer Interaction, pp. 629–638, 2020. 14.

Digital Library

[22]

D. Gasques, J. G. Johnson, T. Sharkey, Y. Feng, R. Wang, Z. R. Xu, E. Zavala, Y. Zhang, W. Xie, X. Zhanget al., Artemis: A collaborative mixed-reality system for immersive surgical telementoring. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–14, 2021. 14.

Digital Library

[23]

S. Gauglitz, B. Nuernberger, M. Turk, and T. Höllerer. In touch with the remote world: Remote collaboration with augmented reality drawings and virtual navigation. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology, pp. 197–205, 2014. 6, 14.

Digital Library

[24]

S. Gauglitz, B. Nuernberger, M. Turk, and T. Höllerer, World-stabilized annotations and virtual scene navigation for remote collaboration. In Proceedings of the 27th annual ACM symposium on User interface software and technology,pp.449–459, 2014. 6,14.

Digital Library

[25]

K. Gupta, G. A. Lee, and M. Billinghurst. Do you see what i see? the effect of gaze tracking on task space remote collaboration. IEEE transactions on visualization and computer graphics, 22(11):2413–2422, 2016. 14.

Digital Library

[26]

P. Gurevich, J. Lanir, and B. Cohen. Design and implementation of teleadvisor: a projection-based augmented reality system for remote collaboration. Computer Supported Cooperative Work (CSCW), 24(6):527–562, 2015. 6, 14.

Digital Library

[27]

P. Gurevich, J. Lanir, B. Cohen, and R. Stone. Teleadvisor: a versatile augmented reality tool for remote assistance. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 619–622, 2012. 6, 14.

Digital Library

[28]

J. Herder, N. Brettschneider, J. de Mooij, and B. Ryskeldiev. Avatars for co-located collaborations in hmd-based virtual environments. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 968–969, 2019. 2.

[29]

K. Higuch, R. Yonetani, and Y. Sato. Can eye help you? effects of visualizing eye fixations on remote collaboration scenarios for physical tasks. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 5180–5190, 2016. 14.

[30]

T. N. Hoang, M. Reinoso, F. Vetere, and E. Tanin. Onebody: remote posture guidance system using first person view in virtual environment. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction, pp. 1–10, 2016. 6, 14.

[31]

K. Holstein, B. M. McLaren, and V. Aleven. Intelligent tutors as teachers' aides: Exploring teacher needs for real-time analytics in blended classrooms. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference, LAK '17, p. 257–266. Association for Computing Machinery, New York, NY, USA, 2017. 7.

Digital Library

[32]

A. H. Hoppe, F. van de Camp, and R. Stiefelhagen. Shisha: enabling shared perspective with face-to-face collaboration using redirected avatars in virtual reality. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW3):1–22, 2021. 14.

[33]

H. Ishii, M. Kobayashi, and K. Arita. Iterative design of seamless collaboration media. Communications of the ACM, 37(8):83–97, 1994. 5.

Digital Library

[34]

D. Iwai, R. Matsukage, S. Aoyama, T. Kikukawa, and K. Sato. Geometrically consistent projection-based tabletop sharing for remote collaboration. IEEE Access, 6:6293–6302, 2017. 6, 14.

[35]

J. G. Johnson, D. Gasques, T. Sharkey, E. Schmitz, and N. Weibel. Do you really need to know where “that” is? enhancing support for referencing in collaborative mixed reality environments. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–14, 2021. 8, 14.

Digital Library

[36]

B. Jones, Y. Zhang, P. N. Wong, and S. Rintel. Belonging there: Vrooming into the uncanny valley of xr telepresence. Proceedings of the ACM on Human-Computer Interaction, 5(CSCWl):1–31, 2021. 14.

Digital Library

[37]

S. Kasahara, S. Nagai, and J. Rekimoto. Jackin head: Immersive visual telepresence system with omnidirectional wearable camera. IEEE transactions on visualization and computer graphics, 23(3):1222–1234, 2016. 14.

[38]

M. Kenoui. Telemedicine meets augmented reality: Healthcare services delivery and distance training. In 2020 4th International Symposium on Informatics and its Applications (ISIA), pp. 1–5. IEEE, 2020. 2.

[39]

C. Kervegant, J. Castet, J. Vauchez, and C. Bailly. Distant assist cursor (dac): Designing an augmented reality system to facilitate remote collaboration for novice users. In Interactive Surfaces and Spaces, pp. 8–11. 2021. 6,14.

[40]

K. Kim, M. Billinghurst, G. Bruder, H. B.-L. Duh, and G. F. Welch. Revisiting trends in augmented reality research: A review of the 2nd decade of ismar (2008–2017). IEEE transactions on visualization and computer graphics, 24(11):2947–2962, 2018. 3.

[41]

S. Kim, M. Billinghurst, and G. Lee. The effect of collaboration styles and view independence on video-mediated remote collaboration. Computer Supported Cooperative Work (CSCW), 27(3):569–607, 2018. 14.

Digital Library

[42]

S. Kim, G. Lee, W. Huang, H. Kim, W. Woo, and M. Billinghurst. Evaluating the combination of visual communication cues for hmd-based mixed reality remote collaboration. In Proceedings of the 2019 CHI conference on human factors in computing systems, pp. 1–13, 2019. 14.

Digital Library

[43]

S. Kim and J. Park. Collaborative haptic exploration of dynamic remote environments. IEEE Computer Graphics and Applications, 38(5):84–99, 2018. 6, 14.

[44]

J. Kolkmeier, E. Harmsen, S. Giesselink, D. Reidsma, M. Theune, and D. Heylen. With a little help from a holographic friend: The openimpress mixed reality telepresence toolkit for remote collaboration systems. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, pp. 1–11, 2018.6,14.

[45]

R. Komiyama, T. Miyaki, and J. Rekimoto. Jackin space: designing a seamless transition between first and third person view for effective telepresence collaborations. In Proceedings of the 8th Augmented Human International Conference, pp. 1–9, 2017. 14.

[46]

J.-F. Lapointe, H. Molyneaux, and M. S. Allili. A literature review of ar-based remote guidance tasks with user studies. In International Conference on Human-Computer Interaction, pp. 111–120. Springer, 2020. 2.

[47]

M. Le Chénéchal, T. Duval, V. Gouranton, J. Royan, and B. Arnaldi. Vishnu: virtual immersive support for helping users an interaction paradigm for collaborative remote guiding in mixed reality. I. 2016 IEEE Third VR International Workshop on Collaborative Virtual Environments (3DCVE), pp. 9–12. IEEE, 2016. 5, 8.

[48]

G. Lee, H. Kang, J. Lee, and J. Han. A user study on view-sharing techniques for one-to-many mixed reality collaborations. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 343–352. IEEE, 2020. 14.

[49]

G. A. Lee, T. Teo, S. Kim, and M. Billinghurst. A user study on mr remote collaboration using live 360 video. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 153–164. IEEE, 2018. 14.

[50]

C. Lin, E. Rojas-Munoz, M. E. Cabrera, N. Sanchez-Tamayo, D. Andersen, V. Popescu, J. A. B. Noguera, B. Zarzaur, P. Murphy, K. Anderson, et al.How about the mentor? effective workspace visualization in ar telementoring. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 212–220. IEEE, 2020. 5,6, 14.

[51]

T. J. Marion and S. K. Fixson. The transformation of the innovation process: How digital tools are changing work, collaboration, and organizations in new product development. Journal of Product Innovation Management, 38(1):192–215, 2021. 2.

[52]

B. Marques, S. Silva, P. Dias, and B. Sousa-Santos. Does size matter? exploring how standard and large-scale displays affect off-site experts during ar-remote collaboration. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces, pp. 1–3, 2022. 6,14.

Digital Library

[53]

K. Marriott, F. Schreiber, T. Dwyer, K. Klein, N. H. Riche, T. Itoh, W. Stuerzlinger, and B. H. Thomas, eds.Immersive Analytics, vol. 11190 of Lecture Notes in Computer Science. Springer, 2018. 2.

[54]

L. Merino, M. Schwarzl, M. Kraus, M. Sedlmair, D. Schmalstieg, and D. Weiskopf. Evaluating mixed and augmented reality: A systematic literature review (2009–2019). In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 438–451. IEEE, 2020. 3.

[55]

P. Milgram and F. Kishino. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems, 77(12):1321–1329, 1994.2,4.

[56]

P. Milgram, H. Takemura, A. Utsumi, and F. Kishino. Augmented reality: A class of displays on the reality-virtuality continuum. In Telemanipulator and telepresence technologies, vol. 2351, pp. 282–292. international Society for Optics and Photonics, 1995. 2, 4.

[57]

S. Minatani, I. Kitahara, Y. Kameda, and Y. Ohta. Face-to-face tabletop remote collaboration in mixed reality. In 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 43–46. IEEE, 2007. 14.

[58]

D. Moher, A. Liberati, J. Tetzlaff, D. G. Altmanet al., Preferred reporting items for systematic reviews and meta-analyses: the prisma statement. Int J Surg, 8(5):336–341, 2010. 2,3, 12.

[59]

P. Mohr, S. Mori, T. Langlotz, B. H. Thomas, D. Schmalstieg, and D. Kalkofen. Mixed reality light fields for interactive remote assistance. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–12, 2020. 2.

Digital Library

[60]

P. Mohr, S. Mori, T. Langlotz, B. H. Thomas, D. Schmalstieg, and D. Kalkofen. Mixed reality light fields for interactive remote assistance. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–12, 2020. 6, 14.

Digital Library

[61]

J. Müller, R. Rädle, and H. Reiterer. Remote collaboration with mixed reality displays: How shared virtual landmarks facilitate spatial referencing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 6481–6486, 2017. 6, 14.

[62]

B. Nuernberger, K.-C. Lien, L. Grinta, C. Sweeney, M. Turk, and T. Höllerer, Multi-view gesture annotations in image-based 3d reconstructed scenes. In Proceedings of the 22Nd ACM conference on virtual reality software and technology, pp. 129–138, 2016. 14.

Digital Library

[63]

O. Oda, C. Elvezio, M. Sukan, S. Feiner, and B. Tversky. Virtual replicas for remote assistance in virtual and augmented reality. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology,pp.405–415, 2015. 6,14.

Digital Library

[64]

H. Phan, J. Rivas, and T. Song. Collaboration: a literature review research report. 2011. 1.

[65]

C. Pidel and P. Ackermann. Collaboration in virtual and augmented reality: a systematic overview. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 141–156. Springer, 2020. 2.

Digital Library

[66]

T. Piumsomboon, G. A. Lee, J. D. Hart, B. Ens, R. W. Lindeman, B. H. Thomas, and M. Billinghurst. Mini-me: An adaptive avatar for mixed reality remote collaboration. In Proceedings of the 2018 CHI conference on human factors in computing systems, pp. 1–13, 2018. 5.

Digital Library

[67]

T. Piumsomboon, G. A. Lee, J. D. Hart, B. Ens, R. W. Lindeman, B. H. Thomas, and M. Billinghurst. Mini-me: An adaptive avatar for mixed reality remote collaboration. In Proceedings of the 2018 CHI conference on human factors in computing systems, pp. 1–13, 2018. 6,14.

Digital Library

[68]

T. Piumsomboon, G. A. Lee, A. Irlitti, B. Ens, B. H. Thomas, and M. Billinghurst. On the shoulder of the giant: A multi-scale mixed reality collaboration with 360 video sharing and tangible interaction. In Proceedings of the 2019 CHI conference on human factors in computing systems, pp. 1–17, 2019. 14.

[69]

T. Rhee, S. Thompson, D. Medeiros, R. Dos Anjos, and A. Chalmers. Augmented virtual teleportation for high-fidelity telecollaboration. IEEE transactions on visualization and computer graphics, 26(5):1923–1933, 2020. 14.

[70]

A. Santos-Torres, T. Zarraonandia, P. Díaz, and I. Aedo. Comparing visual representations of collaborative map interfaces for immersive virtual environments. IEEE Access, 2022. 14.

[71]

M. Sereno, X. Wang, L. Besançon, M. J. Mcguffin, and T. Isenberg. Collaborative work in augmented reality: A survey. IEEE Transactions on Visualization and Computer Graphics, 2020. 2.

[72]

R. Skarbez, M. Smith, and M. C. Whitton. Revisiting milgram and kishino's reality-virtuality continuum. Frontiers in Virtual Reality, 2:647997,2021. 2.

[73]

M. Sousa, D. Mendes, R. K. d. Anjos, D. S. Lopes, and J. Jorge. Negative space: Workspace awareness in 3d face-to-face remote collaboration. In The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry, pp. 1–2, 2019. 5.

Digital Library

[74]

M. Speicher, J. Cao, A. Yu, H. Zhang, and M. Nebeling. 360anywhere: Mobile ad-hoc collaboration in any environment using 360 video and augmented reality. Proceedings of the ACM on Human-Computer Interaction, 2(EICS):1–20, 2018. 5,6,14.

[75]

M. Speicher, B. D. Hall, and M. Nebeling. What is mixed reality. In Proceedings of the 2019 CHI conference on human factors in computing systems, pp. 1–15, 2019.2.

Digital Library

[76]

M. Sra, A. Mottelson, and P. Maes. Your place and mine: Designing a shared vr experience for remotely located users. In Proceedings of the 2018 Designing Interactive Systems Conference, pp. 85–97, 2018. 5,6,8, 14.

[77]

H. Sun, Z. Zhang, Y. Liu, and H. B. Duh. Optobridge: assisting skill acquisition in the remote experimental collaboration. In Proceedings of the 28th Australian Conference on Computer-Human Interaction, pp. 195–199, 2016.6,14.

Digital Library

[78]

L. Sun, H. A. Osman, and J. Lang. An augmented reality online assistance platform for repair tasks. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 17(2):1–23, 2021. 6,14.

Digital Library

[79]

M. Tait and M. Billinghurst. The effect of view independence in a collaborative ar system. Computer Supported Cooperative Work (CSCW), 24(6):563–589, 2015. 14.

Digital Library

[80]

F. Tecchia, L. Alem, and W. Huang. 3d helping hands: a gesture based mr system for remote collaboration. In Proceedings of the 11th ACM SIGGRAPH international conference on virtual-reality continuum and its applications in industry, pp. 323–328, 2012. 14.

[81]

T. Teo, A. F. Hayati, G. A. Lee, M. Billinghurst, and M. Adcock. A technique for mixed reality remote collaboration using 360 panoramas in 3d reconstructed scenes. In 25th ACM Symposium on Virtual Reality Software and Technology, pp. 1–11, 2019. 5, 14.

[82]

T. Teo, L. Lawrence, G. A. Lee, M. Billinghurst, and M. Adcock. Mixed reality remote collaboration combining 360 video and 3d reconstruction. In Proceedings of the 2019 CHI conference on human factors in computing systems, pp. 1–14, 2019. 14.

Digital Library

[83]

T. Teo, G. A. Lee, M. Billinghurst, and M. Adcock. Hand gestures and visual annotation in live 360 panorama-based mixed reality remote collaboration. In Proceedings of the 30th Australian Conference on Computer-Human Interaction, pp. 406–410, 2018. 14.

Digital Library

[84]

S. Thanyadit, P. Punpongsanon, and T.-C. Pong. Observar: Visualization system for observing virtual reality users using augmented reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 258–268. IEEE, 2019. 6,7,14.

[85]

B. Thoravi Kumaravel, F. Anderson, G. Fitzmaurice, B. Hartmann, and T. Grossman. Loki: Facilitating remote instruction of physical tasks using bi-directional mixed-reality telepresence. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 161–174, 2019.5,6,8,14.

[86]

R. van der Kleij, J. Maarten Schraagen, P. Werkhoven, and C. K. De Dreu. How conversations change over time in face-to-face and video-mediated communication. Small Group Research, 40(4):355–381, 2009. 2.

[87]

N. Vaughan, B. Gabrys, and V. N. Dubey. An overview of self-adaptive technologies within virtual reality training. Computer Science Review, 22:65–87, 2016. 2.

[88]

P. Wang, X. Bai, M. Billinghurst, S. Zhang, W. He, D. Han, Y. Wang, H. Min, W. Lan, and S. Han. Using a head pointer or eye gaze: The effect of gaze on spatial ar remote collaboration for physical tasks. Interacting with Computers, 32(2):153–169, 2020. 6,14.

[89]

P. Wang, X. Bai, M. Billinghurst, S. Zhang, X. Zhang, S. Wang, W. He, Y. Yan, and H. Ji. Ar/mr remote collaboration on physical tasks: a review. Robotics and Computer-Integrated Manufacturing, 72:102071, 2021. 2.

[90]

P. Wang, X. Bai, M. Billinghurst, S. Zhang, X. Zhang, S. Wang, W. He, Y. Yan, and H. Ji. Ar/mr remote collaboration on physical tasks: A review. Robotics and Computer-Integrated Manufacturing, 72:102071, 2021. 4.

[91]

S. Whittaker. Things to talk about when talking about things. Human-Computer Interaction, 18(1–2):149-170,2003. 5,8.

Digital Library

[92]

R. Wolff, D. J. Roberts, A. Steed, and O. Otto. A review of telecollaboration technologies with respect to closely coupled collaboration. International Journal of Computer Applications in Technology, 29(1):11–26, 2007. 2.

Digital Library

[93]

S. Yamada and N. P. Chandrasiri. Evaluation of hand gesture annotation in remote collaboration using augmented reality. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 727–728. IEEE, 2018. 14.

[94]

S. Yamamoto, H. Tamaki, Y. Okajima, K. Okada, and Y. Bannai. Symmetric model of remote collaborative mr using tangible replicas. In 2008 IEEE Virtual Reality Conference, pp. 71–74, 2008. 6, 14.

[95]

B. Yoon, H.-i. Kim, S. Y. Oh, and W. Woo. Evaluating remote virtual hands models on social presence in hand-based 3d remote collaboration. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 520–532. IEEE, 2020. 14.

[96]

J. Young, T. Langlotz, M. Cook, S. Mills, and H. Regenbrecht. Immersive telepresence and remote collaboration using mobile and wearable devices. IEEE transactions on visualization and computer graphics, 25(5):1908–1918, 2019. 14.

[97]

K. Yu, G. Gorbachev, U. Eck, F. Pankratz, N. Navab, and D. Roth. Avatars for teleconsultation: effects of avatar embodiment techniques on user perception in 3d asymmetric telepresence. IEEE Transactions on Visualization and Computer Graphics, 27(11):4129–4139, 2021. 14.

Digital Library

[98]

F. Zhou, H. B.-L. Duh, and M. Billinghurst. Trends in augmented reality tracking, interaction and display: A review of ten years of ismar. In 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 193–202. IEEE, 2008. 3.

Cited By

Orduna MPerez PKoniuch KGonzalez-Sosa EVillegas A(2024)Testing 360-Degree Video Communication in a Debate Training between Teens: An Exploratory Field StudyProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3689508(1-2)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3689508
Wu GQian JCastelo Quispe SChen SRulff JSilva C(2024)ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642772(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642772

Recommendations

Authorable augmented reality instructions for assistance and training in work environments
MUM '19: Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

Augmented Reality (AR) is a promising technology for assistance and training in work environments, as it can provide instructions and feedback contextualised. Not only, but especially impaired workers can benefit from this technology. While previous ...
Mixed-Reality for Object-Focused Remote Collaboration
UIST '18 Adjunct: Adjunct Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

In this paper we outline the design of a mixed-reality system to support object-focused remote collaboration. Here, being able to adjust collaborators' perspectives on the object as well as understand one another's perspective is essential to support ...
Helping Helpers: Supporting Volunteers in Remote Sighted Assistance with Augmented Reality Maps
DIS '22: Proceedings of the 2022 ACM Designing Interactive Systems Conference

Remote sighted assistance (RSA) has emerged as a conversational assistive service, where remote sighted workers, i.e., agents, provide real-time assistance to blind users via video-chat-like communication. Prior work identified several challenges for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Visualization and Computer Graphics

IEEE Transactions on Visualization and Computer Graphics Volume 29, Issue 5

May 2023

636 pages

ISSN:1077-2626

Issue’s Table of Contents

1077-2626 © 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.

Publisher

IEEE Educational Activities Department

United States

Publication History

Published: 01 May 2023

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Orduna MPerez PKoniuch KGonzalez-Sosa EVillegas A(2024)Testing 360-Degree Video Communication in a Debate Training between Teens: An Exploratory Field StudyProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3689508(1-2)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3689508
Wu GQian JCastelo Quispe SChen SRulff JSilva C(2024)ARTiST: Automated Text Simplification for Task Guidance in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642772(1-24)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642772

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents