research-article

Last N: relevance-based selectivity for forwarding video in multimedia conferences

Authors:

Lyubomir Marinov,

Emil IvovAuthors Info & Claims

NOSSDAV '15: Proceedings of the 25th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

Pages 19 - 24

https://doi.org/10.1145/2736084.2736094

Published: 18 March 2015 Publication History

Abstract

Multiparty conferencing has traditionally been a relatively expensive application that was only used in enterprise scenarios. Recently, however, the landscape has started to shift in ways that could change this. Ever-increasing bandwidth and processing capabilities make it possible for mobile endpoints and laptop computers to easily handle multiple incoming media streams (both audio and video). The development of Web Real-Time Communications (WebRTC) has also significantly simplified the development of video conferencing applications and made them mainstream. Both of these changes provide a way of replacing expensive video mixers (that produce composited videos) with light-weight video routers (that selectively forward streams). In this paper, we describe a Multipoint Control Unit (MCU) that identifies and selects the last N dominant speakers and forwards their streams to all the conference participants. We evaluate the performance of this Selective Forwarding Unit (SFU) against a simplistic everyone-to-everyone (full-star) MCU. Our results show that the SFU uses 45% less CPU and 63% less bandwidth when forwarding media for 10 of the endpoints in a 30-participant conference.

References

[1]

H. Alvestrand. RTCP message for Receiver Estimated Maximum Bitrate, October 2013. IETF Internet Draft.

[2]

Peter Amon, Madhurani Sapre, and Andreas Hutter. Compressed domain stitching of hevc streams for video conferencing applications. In Packet Video Workshop (PV), 2012 19th International, pages 36--40. IEEE, 2012.

[3]

Eli Brosh, Salman Abdul Baset, Dan Rubenstein, and Henning Schulzrinne. The Delay-Friendliness of TCP. In Proc. of ACM SIGMETRICS, 2008.

Digital Library

[4]

Safiqul Islam, Michael Welzl, Stein Gjessing, and Naeem Khademi. Coupled congestion control for rtp media. In Proceedings of the 2014 ACM SIGCOMM Workshop on Capacity Sharing Workshop, CSWS '14. ACM, 2014.

Digital Library

[5]

Emil Ivov, Lyubomir Marinov, and Philipp Hancke. COnferences with LIghtweight BRIdging (COLIBRI), XMPP Standards Foundation XEP-0340, January 2014.

[6]

Ingemar Johansson. Self-clocked rate adaptation for conversational video in lte. In Proceedings of the 2014 ACM SIGCOMM Workshop on Capacity Sharing Workshop, CSWS '14. ACM, 2014.

Digital Library

[7]

J. Lennox, E. Ivov, and E. Marocco. A Real-time Transport Protocol (RTP) Header Extension for Client-to-Mixer Audio Level Indication, IETF RFC 6464, December 2011.

[8]

Scott Ludwig, Joe Beda, Peter Saint-Andre, Robert McQueen, Sean Egan, and Joe Hildebrand. Jingle, XMPP Standards Foundation XEP-0166, December 2009.

[9]

H Lundin, S Holmer, H Alvestrand, L De Cicco, and S Mascolo. A Google Congestion Control Algorithm for Real-Time Communication on the World Wide Web, 2014. IETF Internet Draft.

[10]

J. Mattsson, D. McGrew, D. Wing, and F. Andreasen. Encrypted Key Transport for Secure RTP, October 2014. IETF Internet Draft.

[11]

Marcin Nagy, Varun Singh, Jörg Ott, and Lars Eggert. Congestion control using fec for conversational multimedia communication. In Proceedings of the 5th ACM Multimedia Systems Conference, MMSys '14, pages 191--202. ACM, 2014.

Digital Library

[12]

Piers O'Hanlon and Ken Carlberg. Dflow: Low latency congestion control. In Proceedings of the 2013 IEEE ICNP Workshop on Capacity Sharing Workshop, CSWS '13. IEEE, 2013.

[13]

E. Rescorla. WebRTC Security Architecture, July 2014. IETF Internet Draft.

[14]

J. Rosenberg, H. Schulzrinne, and O. Levin. A Session Initiation Protocol (SIP) Event Package for Conference State, August 2006. RFC 4575.

[15]

A. Saurin. Congestion Control for Video-conferencing Applications. Master's thesis, University of Glasgow, December 2006.

[16]

H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson. RTP: A Transport Protocol for Real-Time Applications, IETF RFC 3550, July 2003.

Digital Library

[17]

Varun Singh, Albert Abello Lozano, and Jörg Ott. Performance analysis of receive-side real-time congestion control for webrtc. In Proc. of IEEE Workshop on Packet Video, PV '13, 2013.

[18]

Varun Singh, Stephen McQuistin, Martin Ellis, and Colin Perkins. Circuit breakers for multimedia congestion control. In Packet Video Workshop (PV), 2013 20th International, pages 1--8. IEEE, 2013.

[19]

Varun Singh, Joerg Ott, and Igor Curcio. Rate adaptation for conversational 3G video. In Proc. of INFOCOM Workshop, Rio de Janeiro, BR, 2009.

Digital Library

[20]

Varun Singh, Joerg Ott, and Igor Curcio. Rate-control for Conversational Video Communication in Heterogeneous Networks. In in Proc. of IEEE WoWMoM Workshop, SFO, CA, USA, 2012.

[21]

Ilana Volfin and Israel Cohen. Dominant speaker identification for multipoint videoconferencing. Computer Speech Language, 27(4): 895--910, 2013.

Digital Library

[22]

M. Westerlund and S. Wenger. RTP Topologies, November 2014. IETF Internet Draft.

[23]

X. Zhu and R. Pan. NADA: A Unified Congestion Control Scheme for Low-Latency Live Video. In Proc. of IEEE Workshop on Packet Video, PV '13, 2013.

Cited By

Ko KRyu SVan Tu NHong J(2024)Optimizing Video Conferencing QoS: A DRL-based Bitrate Allocation FrameworkNOMS 2024-2024 IEEE Network Operations and Management Symposium10.1109/NOMS59830.2024.10575889(1-10)Online publication date: 6-May-2024
https://doi.org/10.1109/NOMS59830.2024.10575889
He JAmmar MZegura E(2023)A Measurement-Derived Functional Model for the Interaction Between Congestion Control and QoE in Video ConferencingPassive and Active Measurement10.1007/978-3-031-28486-1_7(129-159)Online publication date: 10-Mar-2023
https://doi.org/10.1007/978-3-031-28486-1_7
Xue LMarina MLi GZheng K(2022)PAINT: Path Aware Iterative Network Tomography for Link Metric Inference2022 IEEE 30th International Conference on Network Protocols (ICNP)10.1109/ICNP55882.2022.9940432(1-12)Online publication date: 30-Oct-2022
https://doi.org/10.1109/ICNP55882.2022.9940432
Show More Cited By

Index Terms

Last N: relevance-based selectivity for forwarding video in multimedia conferences
1. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools
        Web conferencing

Recommendations

A practical assessment approach of the interplay between WebRTC and QUIC
IMC '22: Proceedings of the 22nd ACM Internet Measurement Conference

In the last years, Real-Time media transport using QUIC has aroused general interest. Ongoing research is studying protocol mechanisms to transport media with QUIC to build a new streaming protocol or to map existing ones like RTP onto QUIC. Our work ...
Congestion control using FEC for conversational multimedia communication
MMSys '14: Proceedings of the 5th ACM Multimedia Systems Conference

In this paper, we propose a new rate control algorithm for conversational multimedia flows. In our approach, along with Real-time Transport Protocol (RTP) media packets, we propose sending redundant packets to probe for available bandwidth. These ...
RFC 4815: RObust Header Compression (ROHC): Corrections and Clarifications to RFC 3095

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

NOSSDAV '15: Proceedings of the 25th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

March 2015

83 pages

ISBN:9781450333528

DOI:10.1145/2736084

Program Chairs:
Wu-chi Feng
Portland State University
,
Michael Zink
University of Massachusetts, Amherst

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MMSys '15

Sponsor:

MMSys '15: Multimedia Systems Conference 2015

March 18 - 20, 2015

Oregon, Portland

Acceptance Rates

NOSSDAV '15 Paper Acceptance Rate 12 of 43 submissions, 28%;

Overall Acceptance Rate 118 of 363 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
306
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ko KRyu SVan Tu NHong J(2024)Optimizing Video Conferencing QoS: A DRL-based Bitrate Allocation FrameworkNOMS 2024-2024 IEEE Network Operations and Management Symposium10.1109/NOMS59830.2024.10575889(1-10)Online publication date: 6-May-2024
https://doi.org/10.1109/NOMS59830.2024.10575889
He JAmmar MZegura E(2023)A Measurement-Derived Functional Model for the Interaction Between Congestion Control and QoE in Video ConferencingPassive and Active Measurement10.1007/978-3-031-28486-1_7(129-159)Online publication date: 10-Mar-2023
https://doi.org/10.1007/978-3-031-28486-1_7
Xue LMarina MLi GZheng K(2022)PAINT: Path Aware Iterative Network Tomography for Link Metric Inference2022 IEEE 30th International Conference on Network Protocols (ICNP)10.1109/ICNP55882.2022.9940432(1-12)Online publication date: 30-Oct-2022
https://doi.org/10.1109/ICNP55882.2022.9940432
Dai J(2022)Selective Forwarding Unit Placement in Edge Computing Based on DQN for Real-Time CommunicationsGLOBECOM 2022 - 2022 IEEE Global Communications Conference10.1109/GLOBECOM48099.2022.10000886(4510-4516)Online publication date: 4-Dec-2022
https://doi.org/10.1109/GLOBECOM48099.2022.10000886
Jo JChae YJang HKong J(2021)Federated-Access Management System and Videoconferencing Applications: Results from a Pilot Service during COVID-19 PandemicElectronics10.3390/electronics1018223910:18(2239)Online publication date: 12-Sep-2021
https://doi.org/10.3390/electronics10182239
Papalini MCarofiglio GCompagno AMantellini AMuscariello LSamain JSardara M(2020)On the Scalability of WebRTC with Information-Centric Networking2020 IEEE International Symposium on Local and Metropolitan Area Networks (LANMAN10.1109/LANMAN49260.2020.9153228(1-6)Online publication date: Jul-2020
https://doi.org/10.1109/LANMAN49260.2020.9153228
Petrangeli SPauwels DVan Der Hooft J?Iak MSlowack JWauters TDe Turck F(2019)A scalable WebRTC-based framework for remote video collaboration applicationsMultimedia Tools and Applications10.1007/s11042-018-6460-078:6(7419-7452)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1007/s11042-018-6460-0
Petrangeli SPauwels Dvan der Hooft JWauters TDe Turck FSlowack JCesar PZink MMurray N(2018)Improving quality and scalability of webRTC video collaboration applicationsProceedings of the 9th ACM Multimedia Systems Conference10.1145/3204949.3208109(533-536)Online publication date: 12-Jun-2018
https://dl.acm.org/doi/10.1145/3204949.3208109
Petrangeli SPauwels Dvan der Hooft JSlowack JWauters TDe Turck F(2018)Dynamic video bitrate adaptation for WebRTC-based remote teaching applicationsNOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS.2018.8406217(1-5)Online publication date: Apr-2018
https://doi.org/10.1109/NOMS.2018.8406217
Andre ELe Breton NLemesle ARoux LGouaillard A(2018)Comparative Study of WebRTC Open Source SFUs for Video Conferencing2018 Principles, Systems and Applications of IP Telecommunications (IPTComm)10.1109/IPTCOMM.2018.8567642(1-8)Online publication date: Oct-2018
https://doi.org/10.1109/IPTCOMM.2018.8567642
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents