research-article

Intelligent Video Ingestion for Real-time Traffic Monitoring

Authors:

Zhan MaAuthors Info & Claims

ACM Transactions on Sensor Networks (TOSN), Volume 18, Issue 3

Article No.: 47, Pages 1 - 13

https://doi.org/10.1145/3529511

Published: 14 September 2022 Publication History

Abstract

As an indispensable part of modern critical infrastructures, cameras deployed at strategic places and prime junctions in an intelligent transportation system can help operators in observing traffic flow, identifying any emergency situation, or making decisions regarding road congestion without arriving on the scene. However, these cameras are usually equipped with heterogeneous and turbulent networks, making the real-time smooth playback of traffic monitoring videos with high quality a grand challenge. In this article, we propose a lightweight Deep Reinforcement Learning-based approach, namely, sRC-C (smart bitRate Control with a Continuous action space), to enhance the quality of real-time traffic monitoring by adjusting the video bitrate adaptively. Distinguished from the existing bitrate adjusting approaches, sRC-C can overcome the bias incurred by deterministic discretization of candidate bitrates by adjusting the video bitrate with more fine-grained control from a continuous action space, thus significantly improving the Quality-of-Service (QoS). With carefully designed state space and neural network model, sRC-C can be implemented on cameras with scarce resources to support real-time live video streaming with low inference time. Extensive experiments show that sRC-C can reduce the frame loss counts and hold time by 24% and 15.5%, respectively, even with comparable bandwidth utilization. Meanwhile, compared to the-state-of-art approaches, sRC-C can improve the QoS by 30.4%.

References

[1]

Christian Creß and Alois C. Knoll. 2021. Intelligent transportation systems with the use of external infrastructure: A literature survey. Retrieved from https://arXiv:2112.05615.

[2]

Laizhong Cui, Dongyuan Su, Yipeng Zhou, Lei Zhang, Yulei Wu, and Shiping Chen. 2021. Edge learning for surveillance video uploading sharing in public transport systems. IEEE Trans. Intell. Transport. Syst. 22, 4 (2021), 2274–2285. DOI:

[3]

Yulei Wu, Hong-Ning Dai, and Hao Wang. 2021. Convergence of blockchain and edge computing for secure and scalable IIoT critical infrastructures in industry 4.0. IEEE Internet Things J. 8, 4 (2021), 2300–2317. DOI:

[4]

Zichuan Liu, Rui Zhang, Chen Wang, and Hongbo Jiang. 2021. Spatial-temporal conv-sequence learning with accident encoding for traffic flow prediction. Retrieved from https://arXiv:2105.10478.

[5]

Myounggyu Won. 2020. Intelligent traffic monitoring systems for vehicle classification: A survey. IEEE Access 8 (2020), 73340–73358.

[6]

H. Pang, Z. Wang, C. Yan, Q. Ding, K. Yi, J. Liu, and L. Sun. 2019. Content harvest network: Optimizing first mile for crowdsourced live streaming. IEEE Trans. Circ. Syst. Video Technol. 29, 7 (2019), 2112–2125.

[7]

Zhiqian Jiang, Xu Zhang, Wei Huang, Hao Chen, Yiling Xu, Jenq-Neng Hwang, Zhan Ma, and Jun Sun. 2020. A hierarchical buffer management approach to rate adaptation for 360-degree video streaming. IEEE Trans. Vehic. Technol. 69, 2 (2020), 2157–2170. DOI:

[8]

Kevin Spiteri, Rahul Urgaonkar, and Ramesh K. Sitaraman. 2016. BOLA: Near-optimal bitrate adaptation for online videos. In Proceedings of the IEEE 35th Annual IEEE International Conference on Computer Communications (INFOCOM’16). IEEE, 1–9.

Digital Library

[9]

Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural adaptive video streaming with Pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. ACM, 197–210.

Digital Library

[10]

Tianchi Huang, Rui-Xiao Zhang, Chao Zhou, and Lifeng Sun. 2018. QARC: Video quality aware rate control for real-time video streaming based on deep reinforcement learning. In Proceedings of the 26th ACM International Conference on Multimedia (MM’18). Association for Computing Machinery, New York, NY, 1208–1216. DOI:

Digital Library

[11]

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. Retrieved from https://arXiv:1707.06347.

[12]

Devdeep Ray, Jack Kosaian, K. V. Rashmi, and Srinivasan Seshan. 2019. Vantage: Optimizing video upload for time-shifted viewing of social live streams. In Proceedings of the ACM Special Interest Group on Data Communication. ACM, 380–393.

Digital Library

[13]

Jaehong Kim, Youngmok Jung, Hyunho Yeo, Juncheol Ye, and Dongsu Han. 2020. Neural-enhanced live streaming: Improving live video ingest via online learning. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM’20). Association for Computing Machinery, New York, NY, 107–125. DOI:

Digital Library

[14]

Gaetano Carlucci, Luca De Cicco, Stefan Holmer, and Saverio Mascolo. 2016. Analysis and design of the Google congestion control for web real-time communication (WebRTC). In Proceedings of the 7th International Conference on Multimedia Systems (MMSys’16). Association for Computing Machinery, New York, NY, Article 13, 12 pages. DOI:

Digital Library

[15]

Eymen Kurdoglu, Yong Liu, Yao Wang, Yongfang Shi, ChenChen Gu, and Jing Lyu. 2016. Real-time bandwidth prediction and rate adaptation for video calls over cellular networks. In Proceedings of the 7th International Conference on Multimedia Systems (MMSys’16). Association for Computing Machinery, New York, NY, Article 12, 11 pages. DOI:

Digital Library

[16]

H. Chen, X. Zhang, Y. Xu, J. Ren, J. Fan, Z. Ma, and W. Zhang. 2019. T-gaming: A cost-efficient cloud gaming system at scale. IEEE Trans. Parallel Distrib. Syst. 30, 12 (Dec. 2019), 2849–2865. DOI:

[17]

Gaetano Carlucci, Luca De Cicco, Stefan Holmer, and Saverio Mascolo. 2016. Analysis and design of the Google congestion control for web real-time communication (WebRTC). In Proceedings of the 7th International Conference on Multimedia Systems. ACM, 13.

Digital Library

[18]

R. Rejaie, M. Handley, and D. Estrin. 1999. RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet. In Proceedings of the 18th Annual Joint Conference of the IEEE Computer and Communications Societies: The Future is Now (INFOCOM’99), Vol. 3. 1337–1345.

[19]

L. S. Brakmo and L. L. Peterson. 1995. TCP vegas: End to end congestion avoidance on a global internet. IEEE J. Select. Areas Commun. 13, 8 (1995), 1465–1480.

Digital Library

[20]

Sadjad Fouladi, John Emmons, Emre Orbay, Catherine Wu, Riad S. Wahby, and Keith Winstein. 2018. Salsify:\(\lbrace\)Low-Latency\(\rbrace\) network video through tighter integration between a video codec and a transport protocol. In Proceedings of the 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI’18). 267–282.

[21]

Tianchi Huang, Chao Zhou, Rui-Xiao Zhang, Chenglei Wu, Xin Yao, and Lifeng Sun. 2019. Comyco: Quality-aware adaptive video streaming via imitation learning. In Proceedings of the 27th ACM International Conference on Multimedia (MM’19). Association for Computing Machinery, New York, NY, 429–437. DOI:

Digital Library

[22]

Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014. A buffer-based approach to rate adaptation: Evidence from a large video streaming service. In ACM SIGCOMM Computer Communication Review, Vol. 44. ACM, 187–198.

[23]

Yi Sun, Xiaoqi Yin, Junchen Jiang, Vyas Sekar, Fuyuan Lin, Nanshu Wang, Tao Liu, and Bruno Sinopoli. 2016. CS2P: Improving video bitrate selection and adaptation with data-driven throughput prediction. In Proceedings of the ACM SIGCOMM Conference. ACM, 272–285.

Digital Library

[24]

Zhongxia Yan, Jingguo Ge, Yulei Wu, Liangxiong Li, and Tong Li. 2020. Automatic virtual network embedding: A deep reinforcement learning approach with graph convolutional networks. IEEE J. Select. Areas Commun. 38, 6 (2020), 1040–1057. DOI:

[25]

Jin Cheng, Yulei Wu, Yuepeng E., Junling You, Tong Li, Hui Li, and Jingguo Ge. 2021. MATEC: A lightweight neural network for online encrypted traffic classification. Comput. Netw. 199 (2021), 108472. DOI:

Digital Library

[26]

Xu Zhang, Zhengnan Qi, Geyong Min, Wang Miao, Qilin Fan, and Zhan Ma. 2022. Cooperative edge caching based on temporal convolutional networks. IEEE Transactions on Parallel and Distributed Systems 33, 9, (2022), 2093–2105.

[27]

Xiang Gao. 2018. Deep reinforcement learning for time series: Playing idealized trading games. Retrieved from http://arxiv.org/abs/1803.03916.

[28]

Zahaib Akhtar, Yun Seong Nam, Ramesh Govindan, Sanjay Rao, Jessica Chen, Ethan Katz-Bassett, Bruno Ribeiro, Jibin Zhan, and Hui Zhang. 2018. Oboe: Auto-tuning video ABR algorithms to network conditions. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. ACM, 44–58.

Digital Library

[29]

Florin Dobrian, Vyas Sekar, Asad Awan, Ion Stoica, Dilip Joseph, Aditya Ganjam, Jibin Zhan, and Hui Zhang. 2011. Understanding the impact of video quality on user engagement. ACM SIGCOMM Comput. Commun. Rev. 41, 4 (2011), 362–373.

Digital Library

[30]

Rui-Xiao Zhang, Ming Ma, Tianchi Huang, Haitian Pang, Xin Yao, Chenglei Wu, Jiangchuan Liu, and Lifeng Sun. 2019. Livesmart: A QoS-guaranteed cost-minimum framework of viewer scheduling for crowdsourced live streaming. In Proceedings of the 27th ACM International Conference on Multimedia. 420–428.

Digital Library

[31]

John Schulman, Sergey Levine, Pieter Abbeel, Michael Jordan, and Philipp Moritz. 2015. Trust region policy optimization. In Proceedings of the International Conference on Machine Learning. 1889–1897.

[32]

FCC. 2018. Raw Data—Measuring Broadband America—Eighth Report. Retrieved from https://www.fcc.gov/reports-research/reports/measuring-broadband-america/raw-data-measuring-broadband-america-eighth.

[33]

J. van der Hooft, S. Petrangeli, T. Wauters, R. Huysegems, P. R. Alface, T. Bostoen, and F. De Turck. 2016. HTTP/2-based adaptive streaming of HEVC video over 4G/LTE networks. IEEE Commun. Lett. 20, 11 (2016), 2177–2180.

[34]

Haakon Riiser, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2013. Commute path bandwidth traces from 3G networks: Analysis and applications. In Proceedings of the 4th ACM Multimedia Systems Conference. ACM, 114–118.

Digital Library

[35]

Ravi Netravali, Anirudh Sivaraman, Somak Das, Ameesh Goyal, Keith Winstein, James Mickens, and Hari Balakrishnan. 2015. Mahimahi: Accurate record-and-replay for HTTP. In Proceedings of the USENIX Annual Technical Conference (USENIX ATC’15). 417–429.

Cited By

Li TLiu YOuyang TZhang HYang KZhang X(2025)Multi-Hop Task Offloading and Relay Selection for IoT Devices in Mobile Edge ComputingIEEE Transactions on Mobile Computing10.1109/TMC.2024.346273124:1(466-481)Online publication date: Jan-2025
https://doi.org/10.1109/TMC.2024.3462731
Zhao RZhang YWen WLan RXiang Y(2024)E-TPE: Efficient Thumbnail-Preserving Encryption for Privacy Protection in Visual Sensor NetworksACM Transactions on Sensor Networks10.1145/359261120:4(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3592611
Li ZLu MZhang XFeng XAsif MMa Z(2024)Efficient Visual Computing With Camera RAW SnapshotsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.335932646:7(4684-4701)Online publication date: Jul-2024
https://doi.org/10.1109/TPAMI.2024.3359326
Show More Cited By

Index Terms

Intelligent Video Ingestion for Real-time Traffic Monitoring

Recommendations

Real-Time Traffic Transmission Over the Internet
A study on the monitoring model development for quality measurement of internet traffic

The recent trend of integration among new network services such as the long-term evolution (LTE) based on internet protocol (IP) needs reputable analyses and prediction information on the internet traffic. The IP along with increased internet traffics ...
Design and performance analysis of a new RTM algorithm for VBR traffic in ATM networks

This paper presents a new RTM (real-time traffic management) scheme that can effectively manage VBR (variable bit rate) traffic having unpredictable characteristics in ATM (asynchronous transfer mode) networks. In addition to its precise cell control ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Sensor Networks

ACM Transactions on Sensor Networks Volume 18, Issue 3

August 2022

480 pages

ISSN:1550-4859

EISSN:1550-4867

DOI:10.1145/3531537

Editor:
Yunhao Liu
Tsinghua University, China

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 14 September 2022

Online AM: 19 April 2022

Accepted: 29 March 2022

Revised: 21 February 2022

Received: 01 November 2021

Published in TOSN Volume 18, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

National Key Research and Development Program of China
European Union’s Horizon 2020
EU Horizon 2020 INITIATE
Leading Technology of Jiangsu Basic Research Plan
National Natural Science Foundation of China
Chongqing Key Laboratory of Digital Cinema Art Theory and Technology

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
508
Total Downloads

Downloads (Last 12 months)82
Downloads (Last 6 weeks)10

Reflects downloads up to 14 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Li TLiu YOuyang TZhang HYang KZhang X(2025)Multi-Hop Task Offloading and Relay Selection for IoT Devices in Mobile Edge ComputingIEEE Transactions on Mobile Computing10.1109/TMC.2024.346273124:1(466-481)Online publication date: Jan-2025
https://doi.org/10.1109/TMC.2024.3462731
Zhao RZhang YWen WLan RXiang Y(2024)E-TPE: Efficient Thumbnail-Preserving Encryption for Privacy Protection in Visual Sensor NetworksACM Transactions on Sensor Networks10.1145/359261120:4(1-26)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3592611
Li ZLu MZhang XFeng XAsif MMa Z(2024)Efficient Visual Computing With Camera RAW SnapshotsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.335932646:7(4684-4701)Online publication date: Jul-2024
https://doi.org/10.1109/TPAMI.2024.3359326
Wang HZhong ZYin JXu YYang L(2024)Enhancing Real-Time Video Streaming with Joint Frame Size and Rate Adaptation2024 IEEE International Symposium on Circuits and Systems (ISCAS)10.1109/ISCAS58744.2024.10557847(1-5)Online publication date: 19-May-2024
https://doi.org/10.1109/ISCAS58744.2024.10557847
Si THe FLi P(2024)UnifiedSC: a unified framework via collaborative optimization for multi-task person re-identificationApplied Intelligence10.1007/s10489-024-05333-054:4(2962-2975)Online publication date: 22-Feb-2024
https://dl.acm.org/doi/10.1007/s10489-024-05333-0
Lee JKim DLee J(2023)WALTZ: Leveraging Zone Append to Tighten the Tail Latency of LSM Tree on ZNS SSDProceedings of the VLDB Endowment10.14778/3611479.361149516:11(2884-2896)Online publication date: 1-Jul-2023
https://dl.acm.org/doi/10.14778/3611479.3611495
He QZheng ZHu H(2023)A Feature Map is Worth a Video Frame: Rethinking Convolutional Features for Visible-Infrared Person Re-identificationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/361737520:2(1-20)Online publication date: 18-Oct-2023
https://dl.acm.org/doi/10.1145/3617375
Huang DFeng DLiu QDing BZhao WWei XTong W(2023)SplitZNS: Towards an Efficient LSM-Tree on Zoned Namespace SSDsACM Transactions on Architecture and Code Optimization10.1145/360847620:3(1-26)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3608476
Wang HWang YYu BZhan YYuan CYang W(2023)Attentional Composition Networks for Long-Tailed Human Action RecognitionACM Transactions on Multimedia Computing, Communications, and Applications10.1145/360325320:1(1-18)Online publication date: 9-Jun-2023
https://dl.acm.org/doi/10.1145/3603253
Zhang CNie SWang JLiu SWu W(2023)MCB: a multidevice cooperative buffer management strategy for boosting the write performance of the SSD-SMR hybrid storageThe Journal of Supercomputing10.1007/s11227-023-05201-779:12(13462-13489)Online publication date: 25-Mar-2023
https://dl.acm.org/doi/10.1007/s11227-023-05201-7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents