article

Towards coordinated bandwidth adaptations for hundred-scale 3D tele-immersive systems

Authors:

Mohammad Hosseini,

Gregorij Kurillo,

Seyed Rasoul Etesami,

Jiang YuAuthors Info & Claims

Multimedia Systems, Volume 23, Issue 4

Pages 421 - 434

https://doi.org/10.1007/s00530-016-0511-z

Published: 01 July 2017 Publication History

Abstract

3D tele-immersion improves the state of collaboration among geographically distributed participants. Unlike the traditional 2D videos, a 3D tele-immersive system employs multiple 3D cameras based in each physical site to cover a much larger field of view, generating a very large amount of stream data. One of the major challenges is how to efficiently transmit these bulky 3D streaming data to bandwidth-constrained sites. In this paper, we study an adaptive human visual system (HVS)-compliant bandwidth management framework for efficient delivery of hundred-scale streams produced from distributed 3D tele-immersive sites to a receiver site with limited bandwidth budget. Our adaptation framework exploits the semantics link of HVS with multiple 3D streams in the 3D tele-immersive environment. We developed TELEVIS, a visual simulation tool to showcase an HVS-aware tele-immersive system for realistic cases. Our evaluation results show that the proposed adaptation can improve the total quality per unit of bandwidth used to deliver streams in 3D tele-immersive systems.

References

[1]

Coolstreaming. http://www.coolstreaming.us/. Accessed 28 Mar 2016

[2]

Holodeck medicine: how immersive technology is changing the doctor's point of view (2016). http://www.telemedmag.com/content-pages/2016/2/18/holodeck-medicine-how-immersive-technology-is-changing-the-doctors-point-of-view. Accessed 28 Mar 2016

[3]

Immersive education initiative. http://immersiveeducation.org/. Accessed 30 Mar 2016

[4]

Livestream. http://livestream.com/. Accessed 30 Mar 2016

[5]

Media arts and technology at uc santa barbara. http://www.mat.ucsb.edu/. Accessed 28 Mar 2016

[6]

Youtube. http://www.youtube.com/. Accessed 28 Mar 2016

[7]

Cisco forecast (2013). http://blogs.cisco.com/. Accessed 28 Mar 2016

[8]

Ahmadyan, S.N., Kumar, J.A., Vasudevan, S.: Runtime verification of nonlinear analog circuits using incremental time-augmented rrt algorithm. In: Design, automation test in Europe conference exhibition (DATE), 2013, pp. 21---26 (2013).

[9]

Amir, E., McCanne, S., Katz, R.: Receiver-driven bandwidth adaptation for light-weight sessions. In: Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA '97, pp. 415---426. ACM, New York (1997)

[10]

Bai, B., Harms, J.: A multiview video transcoder. In: Proceedings of the 13th Annual ACM International Conference on Multimedia, pp. 503---506. ACM, New York (2005)

Digital Library

[11]

Baker, H.H., et al.: Understanding performance in coliseum, an immersive videoconferencing system. ACM Trans. Multimed. Comput. Commun. Appl. (TOMCCAP) 1(2), 190---210 (2005)

[12]

Chen, S., Nahrstedt, K., Gupta, I.: 3DTI amphitheater: a manageable 3dti environment with hierarchical stream prioritization. In: Proceedings of the 5th ACM Multimedia Systems Conference, MMSys '14. ACM, New York (2014)

[13]

Daly, D., Deavours, D., Doyle, J., Webster, P., Sanders, W.: Möbius: an extensible tool for performance and dependability modeling. In: Haverkort, B., Bohnenkamp, H., Smith, C. (eds.) Computer performance evaluation, modelling techniques and tools, Lecture Notes in Computer Science, vol. 1786, pp. 332---336. Springer, Berlin Heidelberg (2000)

[14]

DeVincenzi, A., Yao, L., Ishii, H., Raskar, R.: Kinected conference: augmenting video imaging with calibrated depth and audio. In: Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work, pp. 621---624. ACM, New York (2011)

[15]

Fechteler, P., et al.: A framework for realistic 3D tele-immersion. In: Proceedings of the 6th International Conference on Computer Vision/Computer Graphics Collaboration Techniques and Applications, p. 12. ACM, New York (2013)

[16]

Grinstead, C.M., Snell, J.L.: Introduction to Probability. American Mathematical Society, Providence (1998). ISBN 978-0-8218-9414-9

[17]

Healey, C.G., Sawant, A.P.: On the limits of resolution and visual angle in visualization. ACM Trans. Appl. Percept. (TAP) 9(4), 20 (2012)

[18]

Hosseini, M., Fedorova, A., Peters, J., Shirmohammadi, S.: Energy-aware adaptations in mobile 3D graphics. In: Proceedings of the 20th ACM International Conference on Multimedia, pp. 1017---1020. ACM, New York (2012)

Digital Library

[19]

Hosseini, M., Kurillo, G.: Coordinated bandwidth adaptations for distributed 3d tele-immersive systems. In: Proceedings of the 7th ACM International Workshop on Massively Multiuser Virtual Environments, MMVE '15, in conjunction with ACM Multimedia Systems Conference (MMSys'15), pp. 13---18. ACM, New York, NY, USA (2015)

[20]

Hosseini, M., Peters, J., Shirmohammadi, S.: Energy-budget-compliant adaptive 3D texture streaming in mobile games. In: Proceedings of the 4th ACM Multimedia Systems Conference, pp. 1---11. ACM, New York (2013)

Digital Library

[21]

Hosseini, M., Peters, J., Shirmohammadi, S.: Energy-efficient 3d texture streaming for mobile games. In: Proceedings of Workshop on Mobile Video Delivery, MoViD'14, pp. 5:1---5:6. ACM, New York (2013)

[22]

Kauff, P., Schreer, O.: An immersive 3D video-conferencing system using shared virtual team user environments. In: Proceedings of the 4th International Conference on Collaborative Virtual Environments, pp. 105---112. ACM, New York (2002)

Digital Library

[23]

Kim, G.: Designing virtual reality systems: the structured approach. Springer, London (2005). ISBN 978-1-84628-230-0

[24]

Kozanidis, G.: Solving the linear multiple choice knapsack problem with two objectives: profit and equity. Comput. Optim. Appl. 43(2), 261---294 (2009)

Digital Library

[25]

Kum, S.U., Mayer-Patel, K., Henry, F.: Real-time compression for dynamic 3D environments. In: MULTIMEDIA 03: Proceedings of the Eleventh ACM International Conference on Multimedia, pp. 185---194. ACM Press, New York (2003)

Digital Library

[26]

Kurillo, G., Vasudevan, R., Lobaton, E., Bajcsy, R.: A framework for collaborative real-time 3d teleimmersion in a geographically distributed environment. In: Multimedia, 2008. ISM 2008. Tenth IEEE International Symposium on, pp. 111---118 (2008).

[27]

Liu, H.H., et al.: Optimizing cost and performance for content multihoming. In: Proceedings of the ACM SIGCOMM 2012 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, pp. 371---382. ACM, New York (2012)

Digital Library

[28]

Liu, S., Chen, C.W.: 3d video transcoding for virtual views. In: Proceedings of the International Conference on Multimedia, MM '10, pp. 795---798. ACM, New York (2010)

[29]

Liu, X., Dobrian, F., Milner, H., Jiang, J., Sekar, V., Stoica, I., Zhang, H.: A case for a coordinated internet video control plane. In: Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication, pp. 359---370. ACM, New York, NY, USA (2012)

Digital Library

[30]

Minaee, S., Abdolrashidi, A., Wang, Y.: Iris recognition using scattering transform and textural features. In: Signal processing and signal processing education workshop (SP/SPE), 2015 IEEE, pp. 37---42 (2015)

[31]

Minaee, S., Abdolrashidi, A., Wang, Y.: Screen content image segmentation using sparse-smooth decomposition. In: 2015 49th asilomar conference on signals, systems and computers, pp. 1202---1206 (2015)

[32]

Minaee, S., Wang, Y.: Screen content image segmentation using least absolute deviation fitting. In: Image processing (ICIP), 2015 IEEE international conference on, pp. 3295---3299 (2015).

[33]

Mulligan, J., Daniilidis, K.: Real time trinocular stereo for tele-immersion. In: Image Processing, 2001. Proceedings. International Conference on, vol. 3, pp. 959---962. IEEE, Thessaloniki (2001)

[34]

Ott, D.E., Mayer-Patel, K.: Coordinated multi-streaming for 3D tele-immersion. In: Proceedings of the 12th Annual ACM International Conference on Multimedia, pp. 596---603. ACM, New York (2004)

Digital Library

[35]

Sharma, G., Mazumdar, R., Shroff, N.B.: Delay and capacity trade-offs in mobile ad hoc networks: a global perspective. IEEE/ACM Trans. Netw. (ToN) 15(5), 981---992 (2007)

[36]

Smardon, R.C., Palmer, J.F., Felleman, J.P., et al.: Foundations for visual project analysis. Wiley, New York (1986)

[37]

Stockhammer, T.: Dynamic adaptive streaming over HTTP: standards and design principles. In: Proceedings of the Second Annual ACM Conference on Multimedia Systems, pp. 133---144. ACM, New York (2011)

Digital Library

[38]

Stockhammer, T., Fröjdh, P., Sodagar, I., Rhyu, S.: Information technology-MPEG systems technologies-part 6: dynamic adaptive streaming over HTTP (DASH). ISO/IEC, MPEG Draft International Standard (2011)

[39]

Stoica, I., et al.: Chord: a scalable peer-to-peer lookup service for internet applications. In: Proceedings of the 2001 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, SIGCOMM '01, pp. 149---160. ACM, New York (2001).

Digital Library

[40]

Tan, S., Waugh, R.: Use of virtual-reality in teaching and learning molecular biology. In: Cai, Y. (ed.) 3D immersive and interactive learning, pp. 17---43. Springer, Oxford (2013)

[41]

Würmlin, S., Lamboray, E., Gross, M.: 3D video fragments: dynamic point samples for real-time free-viewpoint video. Comput. Graph. 28(1), 3---14 (2004)

[42]

Yang, Z., Yu, B., Nahrstedt, K., Bajscy, R.: A multi-stream adaptation framework for bandwidth management in 3D tele-immersion. In: Proceedings of the 2006 International Workshop on Network and Operating Systems Support for Digital Audio and Video, p. 14. ACM, New York (2006)

[43]

Yang, Z., Yu, B., Wu, W., Nahrstedt, K., Diankov, R., Bajscy, R.: A study of collaborative dancing in tele-immersive environments. In: Multimedia, 2006. ISM'06. Eighth IEEE international symposium on, pp. 177---184 (2006).

[44]

Zhang, C., Cai, Q., Chou, P., Zhang, Z., Martin-Brualla, R.: Viewport: a fully distributed immersive teleconferencing system with infrared dot pattern. IEEE MultiMed. 20(1), 17---27 (2013)

Digital Library

Cited By

Hsu CHung THsu C(2022)Optimizing Immersive Video Coding Configurations Using Deep Learning: A Case Study on TMIVACM Transactions on Multimedia Computing, Communications, and Applications10.1145/347119118:1(1-25)Online publication date: 27-Jan-2022
https://dl.acm.org/doi/10.1145/3471191
Bakhati BAlsadoon APrasad PAli RAlsadoon O(2021)Modified quality video: transmission control protocol (TCP) friendly for controlling a congestionMultimedia Tools and Applications10.1007/s11042-021-10737-y80:14(20907-20928)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1007/s11042-021-10737-y
Gahatraj SAlsadoon APrasad PHaddad SAlrubaie APham LDeva AHsu J(2019)A novel solution for an efficient tele‐collaborating in surgical medical educationTransactions on Emerging Telecommunications Technologies10.1002/ett.360830:6Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1002/ett.3608
Show More Cited By

Recommendations

Coordinated bandwidth adaptations for distributed 3D tele-immersive systems
MMVE '15: Proceedings of the 7th ACM International Workshop on Massively Multiuser Virtual Environments

3D tele-immersion improves the state of collaboration among geographically distributed participants. Unlike the traditional 2D videos, a 3D tele-immersive system employs multiple 3D cameras based in each physical site to cover a much larger field of ...
Enabling multi-party 3D tele-immersive environments with ViewCast

Three-dimensional tele-immersive (3DTI) environments have great potential to promote collaborative work among geographically distributed users. However, most existing 3DTI systems only work with two sites due to the huge demand of resources and the lack ...
A multi-stream adaptation framework for bandwidth management in 3D tele-immersion
NOSSDAV '06: Proceedings of the 2006 international workshop on Network and operating systems support for digital audio and video

Tele-immersive environments will improve the state of collaboration among distributed participants. However, along with the promise a new set of challenges have emerged including the real-time acquisition, streaming and rendering of 3D scenes to convey ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Multimedia Systems

Multimedia Systems Volume 23, Issue 4

July 2017

118 pages

ISSN:0942-4962

Issue’s Table of Contents

Copyright © Copyright © 2017 Springer-Verlag GmbH Germany.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 July 2017

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hsu CHung THsu C(2022)Optimizing Immersive Video Coding Configurations Using Deep Learning: A Case Study on TMIVACM Transactions on Multimedia Computing, Communications, and Applications10.1145/347119118:1(1-25)Online publication date: 27-Jan-2022
https://dl.acm.org/doi/10.1145/3471191
Bakhati BAlsadoon APrasad PAli RAlsadoon O(2021)Modified quality video: transmission control protocol (TCP) friendly for controlling a congestionMultimedia Tools and Applications10.1007/s11042-021-10737-y80:14(20907-20928)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1007/s11042-021-10737-y
Gahatraj SAlsadoon APrasad PHaddad SAlrubaie APham LDeva AHsu J(2019)A novel solution for an efficient tele‐collaborating in surgical medical educationTransactions on Emerging Telecommunications Technologies10.1002/ett.360830:6Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1002/ett.3608
Hosseini MJiang YBerlin RSha LSong H(2017)Toward Physiology-Aware DASH: Bandwidth-Compliant Prioritized Clinical Multimedia Communication in AmbulancesIEEE Transactions on Multimedia10.1109/TMM.2017.273329819:10(2307-2321)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1109/TMM.2017.2733298

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents