research-article

JackIn head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration

Authors:

Shunichi Kasahara,

Jun RekimotoAuthors Info & Claims

VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology

Pages 217 - 225

https://doi.org/10.1145/2821592.2821608

Published: 13 November 2015 Publication History

Abstract

Remote collaboration to share abilities over the Internet is one of the ultimate goals of telepresence technology. In this paper, we present JackIn Head, a visual telepresence system with an omnidirectional wearable camera with image motion stabilization. Spherical omnidirectional video footage taken around the head of a local user is stabilized and then broadcast to others, allowing remote users to explore the scene independently of the local user's head direction. We describe the system design of JackIn Head and report the evaluation results of the system's motion decoupling. Then, through an exploratory observation study, we investigate how individuals can remotely interact, communicate with, and assist each other with our system. We report our observation and analysis of inter-personal communication, demonstrating the effectiveness of our system in augmenting remote collaboration.

Supplementary Material

MP4 File (p217-kasahara.mp4)

Download
20.31 MB

References

[1]

Ardouin, J., Lécuyer, A., Marchal, M., Riant, C., and Marchand, E. 2012. Flyviz: A novel display device to provide humans with 360 vision by coupling catadioptric camera with hmd. In Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST '12, 41--44.

Digital Library

[2]

Biocca, F., Harms, C., and Gregg, J. 2001. The networked minds measure of social presence: Pilot test of the factor structure and concurrent validity. In 4th annual International Workshop on Presence, Philadelphia, PA, 1--9.

[3]

Bouguet, J.-Y. 2001. Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corporation 5.

[4]

Boult, T. E. 1998. Remote reality via omni-directional imaging. In ACM SIGGRAPH 98 Conference Abstracts and Applications, ACM, New York, NY, USA, SIGGRAPH '98, 253--.

Digital Library

[5]

Carlon, N., and Menegatti, E. 2013. Visual gyroscope for omnidirectional cameras. In Intelligent Autonomous Systems 12. Springer, 335--344.

[6]

Cheng, L.-T., and Robinson, J. 1998. Dealing with speed and robustness issues for video-based registration on a wearable computing platform. In Wearable Computers, 1998. Digest of Papers. Second International Symposium on, 84--91.

Digital Library

[7]

Fussell, S. R., Setlock, L. D., and Kraut, R. E. 2003. Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI 03, 513--520.

Digital Library

[8]

Gauglitz, S., Nuernberger, B., Turk, M., and Höllerer, T. 2014. In touch with the remote world: Remote collaboration with augmented reality drawings and virtual navigation. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST '14, 197--205.

Digital Library

[9]

Gauglitz, S., Nuernberger, B., Turk, M., and Höllerer, T. 2014. World-stabilized annotations and virtual scene navigation for remote collaboration. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, ACM, New York, NY, USA, UIST '14, 449--459.

Digital Library

[10]

Gluckman, J., and Nayar, S. 1998. Ego-motion and omnidirectional cameras. In Computer Vision, 1998. Sixth International Conference on, 999--1005.

Digital Library

[11]

Goldberg, K., Song, D., and Levandowski, A. 2003. Collaborative teleoperation using networked spatial dynamic voting. Proceedings of the IEEE 91, 3 (Mar), 430--439.

[12]

Higuchi, K., and Rekimoto, J. 2013. Flying head: A head motion synchronization mechanism for unmanned aerial vehicle control. In CHI '13 Extended Abstracts on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI EA '13, 2029--2038.

Digital Library

[13]

Howarth, P., and Costello, P. 1997. The occurrence of virtual simulation sickness symptoms when an hmd was used as a personal viewing system. Displays 18, 2, 107--116.

[14]

Jones, B., Witcraft, A., Bateman, S., Neustaedter, C., and Tang, A. 2015. Mechanics of camera work in mobile video collaboration. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI '15, 957--966.

Digital Library

[15]

Kasahara, S., and Rekimoto, J. 2014. Jackin: Integrating first-person view with out-of-body vision generation for human-human augmentation. In Proceedings of the 5th Augmented Human International Conference, ACM, New York, NY, USA, AH '14, 46:1--46:8.

Digital Library

[16]

Kasahara, S., Nagai, S., and Rekimoto, J. 2015. First person omnidirectional video: System design and implications for immersive experience. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, ACM, New York, NY, USA, TVX '15, 33--42.

Digital Library

[17]

Kawasaki, H., Iizuka, H., Okamoto, S., Ando, H., and Maeda, T. 2010. Collaboration and skill transmission by first-person perspective view sharing system. In RO-MAN, 2010 IEEE, 125--131.

[18]

Kondo, K., Mukaigawa, Y., and Yagi, Y. 2009. Wearable imaging system for capturing omnidirectional movies from a first-person perspective. In Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, VRST '09, 11--18.

Digital Library

[19]

Kurata, T., Sakata, N., Kourogi, M., Kuzuoka, H., and Billinghurst, M. 2004. Remote collaboration using a shoulder-worn active camera/laser. In Wearable Computers, 2004. ISWC 2004. Eighth International Symposium on, vol. 1, 62--69.

Digital Library

[20]

Kuzuoka, H. 1992. Spatial workspace collaboration: A shared-view video support system for remote collaboration capability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI 92, 533--540.

Digital Library

[21]

Lanir, J., Stone, R., Cohen, B., and Gurevich, P. 2013. Ownership and control of point of view in remote assistance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI '13, 2243--2252.

Digital Library

[22]

Mann, S. 2000. Telepointer: Hands-free completely self contained wearable visual augmented reality without headwear and without any infrastructural reliance. In Proceedings of the 4th IEEE International Symposium on Wearable Computers, IEEE Computer Society, Washington, DC, USA, ISWC '00, 177--.

Digital Library

[23]

Misawa, K., and Rekimoto, J. 2015. Wearing another's personality: A human-surrogate system with a telepresence face. In Proceedings of the 2015 ACM International Symposium on Wearable Computers, ACM, New York, NY, USA, ISWC '15, 125--132.

Digital Library

[24]

Mori, H., Sekiguchi, D., Kuwashima, S., Inami, M., and Matsuno, F. 2005. Motionsphere. In ACM SIGGRAPH 2005 Emerging Technologies, ACM, New York, NY, USA, SIGGRAPH '05.

Digital Library

[25]

Nagai, S., Kasahara, S., and Rekimoto, J. 2015. Livesphere: Sharing the surrounding visual environment for immersive experience in remote collaboration. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction, ACM, New York, NY, USA, TEI '15, 113--116.

Digital Library

[26]

Rae, I., Venolia, G., Tang, J. C., and Molnar, D. 2015. A framework for understanding and designing telepresence. In Proc. CSCW 2015, ACM Association for Computing Machinery.

Digital Library

[27]

Scaramuzza, D., Martinelli, A., and Siegwart, R. 2006. A toolbox for easily calibrating omnidirectional cameras. In Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on, IEEE, 5695--5701.

[28]

Short, J., Williams, E., and Christie, B. 1976. The social psychology of telecommunications.

[29]

Stanney, K. M., Kennedy, R. S., and Drexler, J. M. 1997. Cybersickness is not simulator sickness. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 41, SAGE Publications, 1138--1142.

[30]

Tachi, S. 2015. Telexistence. Springer. Tsumaki, Y., Ono, F., and Tsukuda, T. 2012. The 20-dof miniature humanoid mh-2: A wearable communication system. In Robotics and Automation (ICRA), 2012 IEEE International Conference on, IEEE, 3930--3935.

Cited By

Monnai YMuramoto GYazaki TNaitou RSaito HMaekawa AInami M(2024)共進化するテラヘルツ無線技術と人間拡張工学IEICE Communications Society Magazine10.1587/bplus.18.14518:2(145-157)Online publication date: 2024
https://doi.org/10.1587/bplus.18.145
Pfeil KBadillo-Urquiola KBelga JSera-Josef JLaviola JWisniewski P(2024)Using Co-Design with Streamers and Viewers to Identify Values and Resolve Tensions in the Design of Interpersonal Wearable Telepresence SystemsProceedings of the ACM on Human-Computer Interaction10.1145/36374258:CSCW1(1-21)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637425
Huang XXiao R(2024)SurfShareProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314187:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631418
Show More Cited By

Index Terms

JackIn head: immersive visual telepresence system with omnidirectional wearable camera for remote collaboration

Recommendations

JackIn space: designing a seamless transition between first and third person view for effective telepresence collaborations
AH '17: Proceedings of the 8th Augmented Human International Conference

Traditional telepresence systems only supported first person view and users had difficulty in recognizing the surrounding situation of their remote workspace. JackIn Space is a telepresence system that solves this problem by seamlessly integrating first ...
ShowMe: A Remote Collaboration System that Supports Immersive Gestural Communication
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

ShowMe is an immersive mobile collaboration system that allows a remote user to communicate with a peer using video, audio and hand gestures. We explore the use of a Head Mounted Display and depth camera to create a system that (1) enables a remote user ...
JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera

Sharing one's own immersive experience over the Internet is one of the ultimate goals of telepresence technology. In this paper, we present JackIn Head, a visual telepresence system featuring an omnidirectional wearable camera with image motion ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology

November 2015

237 pages

ISBN:9781450339902

DOI:10.1145/2821592

Conference Chairs:
Qinping Zhao
Beihang Univerisity
,
Daniel Thalmann
Nanyang Technological University
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Enhua Wu
University of Macau & Institute of Software, Chinese Academy of Sciences
,
Ming C. Lin
University of North Carolina at Chapel Hill
,
Lili Wang
Beihang University

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Best Paper

Author Tags

Qualifiers

Research-article

Conference

VRST '15

Sponsor:

VRST '15: 21th ACM Symposium on Virtual Reality Software and Technology

November 13 - 15, 2015

Beijing, China

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Upcoming Conference

VRST '24

Sponsor:
sigchi
sigchi

30th ACM Symposium on Virtual Reality Software and Technology

October 9 - 11, 2024

Trier , Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

70
Total Citations
View Citations
1,364
Total Downloads

Downloads (Last 12 months)99
Downloads (Last 6 weeks)8

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Monnai YMuramoto GYazaki TNaitou RSaito HMaekawa AInami M(2024)共進化するテラヘルツ無線技術と人間拡張工学IEICE Communications Society Magazine10.1587/bplus.18.14518:2(145-157)Online publication date: 2024
https://doi.org/10.1587/bplus.18.145
Pfeil KBadillo-Urquiola KBelga JSera-Josef JLaviola JWisniewski P(2024)Using Co-Design with Streamers and Viewers to Identify Values and Resolve Tensions in the Design of Interpersonal Wearable Telepresence SystemsProceedings of the ACM on Human-Computer Interaction10.1145/36374258:CSCW1(1-21)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637425
Huang XXiao R(2024)SurfShareProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314187:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631418
Yazaki TUriu DWatanabe YTakagi RKashino ZInami M(2023)“Oh, could you also grab that?”: A case study on enabling elderly person to remotely explore a supermarket using a wearable telepresence systemProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627799(340-352)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3627799
Yazaki TWatanabe YKong LInami M(2023)Design and Field Study of Syn-Leap: A Symmetric Telepresence System for Immersion Switching and Walking Across Multiple LocationsProceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3627772(353-365)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3627772
Auda JGruenefeld UFaltaous SMayer SSchneegass S(2023)A Scoping Survey on Cross-reality SystemsACM Computing Surveys10.1145/361653656:4(1-38)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3616536
Zaman FAnslow CRhee T(2023)Vicarious: Context-aware Viewpoints Selection for Mixed Reality CollaborationProceedings of the 29th ACM Symposium on Virtual Reality Software and Technology10.1145/3611659.3615709(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3611659.3615709
Li LCarnell SHarris KWalters LReiners DCruz-Neira C(2023)LIFT - A System to Create Mixed 360° Video and 3D Content for Live Immersive Virtual Field TripProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596162(83-93)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3573381.3596162
Faridan MKumari BSuzuki R(2023)ChameleonControl: Teleoperating Real Human Surrogates through Mixed Reality Gestural Guidance for Remote Hands-on ClassroomsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581381(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581381
Maddali HLazar A(2023)Understanding Context to Capture when Reconstructing Meaningful Spaces for Remote Instruction and Connecting in XRProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581243(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581243
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents