research-article

Public Access

CollaVR: Collaborative In-Headset Review for VR Video

Authors:

Stephen DiVerdi,

Aaron Hertzmann,

Feng LiuAuthors Info & Claims

UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Pages 267 - 277

https://doi.org/10.1145/3126594.3126659

Published: 20 October 2017 Publication History

Abstract

Collaborative review and feedback is an important part of conventional filmmaking and now Virtual Reality (VR) video production as well. However, conventional collaborative review practices do not easily translate to VR video because VR video is normally viewed in a headset, which makes it difficult to align gaze, share context, and take notes. This paper presents CollaVR, an application that enables multiple users to review a VR video together while wearing headsets. We interviewed VR video professionals to distill key considerations in reviewing VR video. Based on these insights, we developed a set of networked tools that enable filmmakers to collaborate and review video in real-time. We conducted a preliminary expert study to solicit feedback from VR video professionals about our system and assess their usage of the system with and without collaboration features.

Supplementary Material

suppl.mov (uistf4597-file3.mp4)

Supplemental video

Download
39.47 MB

MP4 File (p267-nguyen.mp4)

Download
214.75 MB

References

[1]

Ellen Baker, John Geirland, Tom fisher, and Annmarie Chandler. 1999. Media Production: Towards Creative Collaboration Using Communication Networks. Computer Supported Cooperative Work (CSCW) 8, 4 (dec 1999), 303--332.

Digital Library

[2]

Paulo Bala, Mara Dionisio, Valentina Nisi, and Nuno Nunes. 2016. IVRUX: A tool for analyzing immersive narratives in virtual reality. In Interactive Storytelling, Ulrike Spierling and Nicolas Szilas (Eds.). Lecture Notes in Computer Science, Vol. 5334. Springer Berlin Heidelberg, 3--11.

[3]

Jessica J. Baldis. 2001. Effects of spatial audio on memory, comprehension, and preference during desktop conferences. In Proceedings of the SIGCHI conference on Human factors in computing systems. 166--173.

Digital Library

[4]

Steve Benford, Chris Greenhalgh, Tom Rodden, and James Pycock. 2001. Collaborative Virtual Environments. Commun. ACM 44, 7 (July 2001), 79--85.

Digital Library

[5]

M. L. Brown, S. L. Newsome, and E. P. Glinert. 1989. An experiment into the use of auditory cues to reduce visual workload. In Proceedings of the SIGCHI conference on Human factors in computing systems. 339--346.

Digital Library

[6]

Gerd Bruder, Frank Steinicke, Phil Wieland, and Markus Lappe. 2012. Tuning self-motion perception in virtual reality with visual illusions. IEEE Transactions on Visualization and Computer Graphics 18, 7 (July 2012), 1068--1078.

Digital Library

[7]

Mauro Cherubini, Marc-Antoine Nüssli, and Pierre Dillenbourg. 2008. Deixis and gaze in collaborative work at a distance (over a shared map): a computational model to detect misunderstandings. In Proceedings of the Symposium on Eye Tracking Research & Applications. 8.

Digital Library

[8]

cineSync. 2005. Retrieved 2017-04-03 from https://cospective.com/cinesync/

[9]

Maxime Cordeil, Tim Dwyer, Karsten Klein, Bireswar Laha, Kim Marriott, and Bruce H. Thomas. 2017. Immersive collaborative analysis of network connectivity: CAVE-style or head-mounted display? IEEE Transactions on Visualization and Computer Graphics 23, 1 (Jan. 2017), 441--450.

Digital Library

[10]

Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces. In Proceedings of the ACM conference on Computer-supported cooperative work. 107--114.

Digital Library

[11]

Ajoy S. Fernandes and Steven K. Feiner. 2016. Combating VR sickness through subtle dynamic field-of-view modification. In Proceedings of the IEEE Symposium on 3D User Interfaces. 201--210.

[12]

Mike Fraser, Steve Benford, Jon Hindmarsh, and Christian Heath. 1999. Supporting awareness and interaction through collaborative virtual interfaces. In Proceedings of the ACM symposium on User interface software and technology, Vol. 1. 27--36.

Digital Library

[13]

Jan Gugenheimer, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. 2017. ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, 4021--4033.

Digital Library

[14]

Carl Gutwin and Saul Greenberg. Design for individuals, design for groups: tradeoffs between power and workspace awareness. In Proceedings of the ACM conference on Computer supported cooperative work. 207--216.

Digital Library

[15]

Jefferson Han and Brian Smith. 1996. CU-SeeMe VR immersive desktop teleconferencing. In Proceedings of the ACM international conference on Multimedia. 199--207.

Digital Library

[16]

Jeffrey Heer and Maneesh Agrawala. 2008. Design considerations for collaborative visual analytics. Information Visualization 7, 1 (Jan. 2008), 49--62.

Digital Library

[17]

Rorik Henrikson, Bruno De Araujo, Fanny Chevalier, Karan Singh, and Ravin Balakrishnan. 2016a. Multi-device storyboards for cinematic narratives in VR. Proceedings of the ACM Symposium on User interface software and technology (2016), 787--796.

Digital Library

[18]

Rorik Henrikson, Bruno De Araujo, Fanny Chevalier, Karan Singh, and Ravin Balakrishnan. 2016b. Storeoboard: sketching stereoscopic storyboards. In Proceedings of the SIGCHI conference on Human factors in computing systems. 4587--4598.

Digital Library

[19]

Eugenia M. Kolasinski. 1995. Simulator sickness in virtual environments. Technical Report ARI-TR-1027. Army Research Institute for the Behavioral and Social Sciences.

[20]

Hao Li, Laura Trutoiu, Kyle Olszewski, Lingyu Wei, Tristan Trutna, Pei-Lun Hsieh, Aaron Nicholls, and Chongyang Ma. 2015. Facial performance sensing head-mounted display. ACM Transactions on Graphics (Proceedings of SIGGRAPH) 34, 4 (July 2015).

Digital Library

[21]

LookAt. 2017. Retrieved 2017-04-03 from https://www.lookat.io/

[22]

Thomas Löwe, Michael Stengel, Förster Emmy-Charlotte, Steve Grogorick, and Marcus Magnor. 2015. Visualization and analysis of head movement and gaze data for immersive video in head-mounted displays. Proceedings of the Workshop on Eye Tracking and Visualization 1 (2015), 1--5.

[23]

Andrew MacQuarrie and Anthony Steed. 2017. Cinematic virtual reality: Evaluating the effect of display type on the viewing experience for panoramic video. In 2017 IEEE Virtual Reality (VR). IEEE, 45--54.

[24]

Charles Malleson, Maggie Kosek, Martin Klaudiny, Ivan Huerta, Jean-Charles Bazin, Alexander Sorkine-Hornung, Mark Mine, and Kenny Mitchell. 2017. Rapid one-shot acquisition of dynamic VR avatars. In 2017 IEEE Virtual Reality (VR). 131--140.

[25]

Mark McGill, John H Williamson, and Stephen Brewster. 2016. Examining the role of smart TVs and VR HMDs in synchronous at-a-distance media consumption. ACM Transactions on Computer-Human Interaction 23, 5 (Nov. 2016), 1--57.

Digital Library

[26]

Meredith Ringel Morris and Eric Horvitz. 2007. SearchTogether: an interface for collaborative web search. In Proceedings of the ACM symposium on User interface software and technology. 3.

Digital Library

[27]

Cuong Nguyen, Stephen DiVerdi, Aaron Hertzmann, and Feng Liu. 2017. Vremiere: In-Headset Virtual Reality Video Editing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems.

Digital Library

[28]

Costas Panagiotakis and George Tziritas. 2005. A speech/music discriminator based on RMS and zero-crossings. IEEE Transactions on Multimedia 7, 1 (Feb. 2005), 155--166.

Digital Library

[29]

Amy Pavel, Dan B Goldman, Björn Hartmann, and Maneesh Agrawala. 2016. VidCrit: video-based asynchronous video review. In Proceedings of the Symposium on User interface software and technology. 517--528.

Digital Library

[30]

Julien Phalip, Ernest a. Edmonds, and David Jean. 2009. Supporting remote creative collaboration in film scoring. In Proceeding of the ACM conference on Creativity and cognition. 211.

Digital Library

[31]

Road to VR. 2016. Facebook social VR demo. Retrieved 2017-04-03 from https://www.youtube.com/watch?v=YuIgyKLPt3s

[32]

Anne Sèdes, Pierre Guillot, and Eliott Paris. 2014. The HOA library, review and prospects. In International Computer Music Conference | Sound and Music Computing. 855--860. https://hal.archives-ouvertes.fr/hal-01196453

[33]

Dave Snowdon, Elizabeth F Churchill, and Alan J Munro. 2000. Collaborative virtual environments: digital spaces and places for CSCW. Collaborative Virtual Environments (2000), 1--34.

[34]

Anthony Tang and Omid Fakourfar. 2017. Watching 360° videos together. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems.

Digital Library

[35]

James R. Wallace, Stacey D. Scott, Eugene Lai, and Deon Jajalla. 2011. Investigating the role of a large, shared display in multi-display environments. Computer Supported Cooperative Work 20, 6 (Dec. 2011), 529--561.

Digital Library

[36]

Robert Xiao and Hrvoje Benko. 2016. Augmenting the field-of-view of head-mounted displays with sparse peripheral displays. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1221--1232.

Digital Library

[37]

Dongwook Yoon, Nicholas Chen, François Guimbretière, and Abigail Sellen. 2014. RichReview: blending ink, speech, and gesture to support collaborative document review. In Proceedings of the ACM symposium on User interface software and technology. 481--490.

Digital Library

Cited By

Chen CNguyen CGroueix TKim VWeibel N(2024)MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design FeedbackACM Transactions on Computer-Human Interaction10.1145/369468131:5(1-41)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1145/3694681
Meijer WBourgeois Jvan der Vegte WKortuem G(2024)Sphere Window: Challenges and Opportunities of 360° Video in Collaborative Design Workshops.Proceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685407(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685407
Ning ZZhang ZBan JJiang KGan RTian YLi T(2024)MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on VideosProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656189(156-169)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656189
Show More Cited By

Index Terms

CollaVR: Collaborative In-Headset Review for VR Video
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Vremiere: In-Headset Virtual Reality Video Editing
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Creative professionals are creating Virtual Reality (VR) experiences today by capturing spherical videos, but video editing is still done primarily in traditional 2D desktop GUI applications such as Premiere. These interfaces provide limited ...
Exploring User Behaviour in Asymmetric Collaborative Mixed Reality
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

A common issue for collaborative mixed reality is the asymmetry of interaction with the shared virtual environment. For example, an augmented reality (AR) user might use one type of head-mounted display (HMD) in a physical environment, while a virtual ...
The collaborative cube puzzle: a comparison of virtual and real environments
CVE '00: Proceedings of the third international conference on Collaborative virtual environments

In this study we compared collaboration on a puzzle-solving task carried out by two persons in a virtual and a real environment. The task, putting together a cube consisting of different coloured blocks in a 'Rubiks' cubetype puzzle, was performed both ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

October 2017

870 pages

ISBN:9781450349819

DOI:10.1145/3126594

General Chair:
Krzysztof Gajos
Harvard University
,
Program Chairs:
Jennifer Mankoff
Carnegie Mellon University
,
Chris Harrison
Carnegie Mellon University

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

UIST '17

Sponsor:

UIST '17: The 30th Annual ACM Symposium on User Interface Software and Technology

October 22 - 25, 2017

QC, Québec City, Canada

Acceptance Rates

UIST '17 Paper Acceptance Rate 73 of 324 submissions, 23%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
1,459
Total Downloads

Downloads (Last 12 months)158
Downloads (Last 6 weeks)23

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen CNguyen CGroueix TKim VWeibel N(2024)MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design FeedbackACM Transactions on Computer-Human Interaction10.1145/369468131:5(1-41)Online publication date: 4-Sep-2024
https://dl.acm.org/doi/10.1145/3694681
Meijer WBourgeois Jvan der Vegte WKortuem G(2024)Sphere Window: Challenges and Opportunities of 360° Video in Collaborative Design Workshops.Proceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685407(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685407
Ning ZZhang ZBan JJiang KGan RTian YLi T(2024)MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on VideosProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656189(156-169)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3656189
Leake MLi W(2024)ChunkyEdit: Text-first video interview editing via chunkingProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642667(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642667
Jin QLiu YYuan YHan BQian FYarosh S(2024)Virtual Reality, Real Pedagogy: A Contextual Inquiry of Instructor Practices with VR VideoProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642510(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642510
Lammert ARendle GImmohr FNeidhardt ABrandenburg KRaake AFroehlich B(2024)Immersive Study Analyzer: Collaborative Immersive Analysis of Recorded Social VR StudiesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345614630:11(7214-7224)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456146
Li ZLuo YWang JPan YYu LLiang H(2024)Feasibility and performance enhancement of collaborative control of unmanned ground vehicles via virtual realityPersonal and Ubiquitous Computing10.1007/s00779-024-01799-428:3-4(579-595)Online publication date: 9-May-2024
https://doi.org/10.1007/s00779-024-01799-4
(2024)BibliographyRealizing the Metaverse10.1002/9781394188932.ref(133-171)Online publication date: 22-Nov-2024
https://doi.org/10.1002/9781394188932.ref
Wang YWang YLi XZhao CMa NGuo Z(2023)A Comparative Study of the Typing Performance of Two Mid-Air Text Input Methods in Virtual EnvironmentsSensors10.3390/s2315698823:15(6988)Online publication date: 6-Aug-2023
https://doi.org/10.3390/s23156988
Yoshida SXie HMiyata K(2023)Omnidirectional Haptic Stimulation System via Pneumatic Actuators for Presence PresentationSensors10.3390/s2302058423:2(584)Online publication date: 4-Jan-2023
https://doi.org/10.3390/s23020584
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents