Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3424616.3424696acmconferencesArticle/Chapter ViewAbstractPublication Pagesweb3dConference Proceedingsconference-collections
research-article

SYSTEM ARCHITECTURE FOR SUPPORTING MULTIPLE LIVE ACTORS IN WEB3D VIRTUAL CONFERENCE: Extended Abstract

Published: 09 November 2020 Publication History

Abstract

For live actors to perform as 3D models with seamless graphics computing, we need to overcome the huge challenges of developing a methodology to construct a cleaned and smooth model in real time and a system architecture design that supports the streaming of multi-model live actors. By applying the technique of semantic image segmentation to generate the entire human body, a 3D model needs to be built up with a segmented image as a texture. Moreover, to enable a live actor to virtually interact with others, multi-actor models must be produced for telecommuting systems. Therefore, by combining the concepts above, a system with multiple live actors can be created to conduct live group conferences in virtual reality that provide an immersive experience.

Supplementary Material

a20-hok-supplement1 (a20-hok-supplement1.mp4)
Deep lab demo
a20-hok-supplement2 (a20-hok-supplement2.mp4)
Multiple live actors test demo

References

[1]
Liang-Chieh Chen, Yukun Zhu, George Papandreou, Florian Schroff, and Hartwig Adam. 2018. “Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation,” arXiv:1802.02611 [cs], Feb. 2018
[2]
Ricardo Cabello. 2010.“three.js – JavaScript 3D library.” https://threejs.org/ (accessed Oct. 22, 2019)
[3]
Alan B Johnston and Daniel C Burnett. 2012. “WebRTC,” WebRTC. https://webrtc.org/ (accessed Jul. 03, 2020)
[4]
Kwan-Hee Yoo. 2016. “Standard Model for Live Actor and Entity Representation in Mixed and Augmented Reality,” Journal of Broadcast Engineering 21(2):192-199, vol. 21, pp. 192–199, Mar. 2016
[5]
Hok Tin, Min Borin, Seunghyeon Kang, Ga-Ae Ryu, and Kwan-Hee Yoo. 2019. “Real-Time Embedding Live Actors into an Immersive World,” ICCC, 2019
[6]
Vuthea Chheang and Kwan-Hee Yoo. 2017. “Information technology — Computer graphics, image processing and environmental data representation — Live actor and entity representation in mixed and augmented reality,” ISO/IEC JTC 1/SC 24 N 18040, 2017
[7]
WebXR API. 2019.“WebXR Device API.” https://immersive-web.github.io/webxr/ (accessed Oct. 22, 2019)

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
Web3D '20: Proceedings of the 25th International Conference on 3D Web Technology
November 2020
201 pages
ISBN:9781450381697
DOI:10.1145/3424616
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. DeepLab
  2. Multiple live actors
  3. ThreeJS
  4. Web3D
  5. WebRTC
  6. head-mounted display (HMD)
  7. live actor and entity (LAE)
  8. mixed augmented reality (MAR)

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

Web3D '20
Sponsor:
Web3D '20: The 25th International Conference on 3D Web Technology
November 9 - 13, 2020
Virtual Event, Republic of Korea

Acceptance Rates

Overall Acceptance Rate 27 of 71 submissions, 38%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 92
    Total Downloads
  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media