Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Troubleshooting solution for traffic congestion control

Published: 19 September 2024 Publication History

Abstract

The Internet has existed since the 1970s as a means of data exchange between network devices in small networks. In the early stage, there was a small number of devices, but today there is an ever-increasing number of devices, leading to congestion in the network. Therefore, congestion control has attracted so much attention in the academic community and the industry for the past 30 years. Recently, Google has developed BBR (Bottleneck Bandwidth and Round-Trip Time), a rate-based congestion control algorithm. BBR controls transmission rates based on delivery rate and round-trip time (RTT). However, such a static congestion control algorithm (e.g., BBR, etc.) cannot achieve high performance in various network conditions (e.g., low bandwidth, etc.). Concretely, these static algorithms cannot adapt to the dynamic changes of the network environment. Therefore, in this paper, we propose an adaptive algorithm (called ABBR) for congestion control in next-generation networks. ABBR takes into account the reinforcement learning algorithm to learn relevant policies to change the transmission rate corresponding to each congestion control algorithm to optimize long-term performance. The experimental results show that our proposal can achieve good performance in terms of throughput, RTT, and fairness compared to the benchmarks.

References

[1]
Aina J., Mhamdi L., Hamdi H., F-dctcp: Fair congestion control for sdn-based data center networks, in: 2019 International Symposium on Networks, Computers and Communications, ISNCC, IEEE, 2019, pp. 1–6.
[2]
Anitha P., Vimala H., Shreyas J., Comprehensive review on congestion detection, alleviation, and control for iot networks, J. Netw. Comput. Appl. (2023).
[4]
Bannour F., Souihi S., Mellouk A., Adaptive distributed sdn controllers: Application to content-centric delivery networks, Future Gener. Comput. Syst. 113 (2020) 78–93.
[5]
Cao, Y., Jain, A., Sharma, K., Balasubramanian, A., Gandhi, A., 2019. When to use and when not to use bbr: An empirical analysis and evaluation study. In: Proceedings of the Internet Measurement Conference. pp. 130–136.
[6]
Chen Y.-R., Rezapour A., Tzeng W.-G., Tsai S.-C., Rl-routing: An sdn routing algorithm based on deep reinforcement learning, IEEE Trans. Netw. Sci. Eng. 7 (4) (2020) 3185–3199.
[7]
Chuat L., Legner M., Basin D., Hausheer D., Hitz S., Müller P., Perrig A., The complete guide to scion, Inf. Secur. Cryptography (2022).
[8]
Clifton J., Laber E., Q-learning: Theory and applications, Annu. Rev. Stat. Appl. 7 (2020) 279–301.
[9]
Cui Y., Li T., Liu C., Wang X., Kühlewind M., Innovating transport with quic: Design approaches and research challenges, IEEE Internet Comput. 21 (2) (2017) 72–76.
[10]
Dholakiya D., Kshirsagar T., Nayak A., Survey of mininet challenges, opportunities, and application in software-defined network(sdn), in: International Conference on Information and Communication Technology for Intelligent Systems, Springer, 2020, pp. 213–221.
[11]
Gartner M., Krüger T., Hausheer D., Bittorrent over scion: Leveraging unused network capacities in the internet, in: NOMS 2023-2023 IEEE/IFIP Network Operations and Management Symposium, IEEE, 2023, pp. 1–5.
[12]
Guendouzi B.S., Ouchani S., EL Assaad H., EL Zaher M., A systematic review of federated learning: Challenges, aggregation methods, and development tools, J. Netw. Comput. Appl. 220 (2023),.
[13]
He B., Wang J., Qi Q., Sun H., Liao J., Du C., Yang X., Han Z., Deepcc: Multi-agent deep reinforcement learning congestion control for multi-path tcp based on self-attention, IEEE Trans. Netw. Serv. Manag. (2021).
[14]
Hock M., Bless R., Zitterbart M., Experimental evaluation of bbr congestion control, in: 2017 IEEE 25th International Conference on Network Protocols, ICNP, IEEE, 2017, pp. 1–10.
[15]
Hwang J., Yoo J., Lee S.-H., Jin H.-W., Scalable congestion control protocol based on sdn in data center networks, in: 2015 IEEE Global Communications Conference, GLOBECOM, IEEE, 2015, pp. 1–6.
[16]
Jay N., Rotman N., Godfrey B., Schapira M., Tamar A., A deep reinforcement learning perspective on internet congestion control, in: International Conference on Machine Learning, PMLR, 2019, pp. 3050–3059.
[17]
Jiang H., Li Q., Jiang Y., Shen G., Sinnott R., Tian C., Xu M., When machine learning meets congestion control: A survey and comparison, Comput. Netw. 192 (2021).
[18]
Jiang W., Li H., Liu Z., Wu J., Huang J., Shan D., Wang J., Copa+: Analysis and improvement of the delay-based congestion control algorithm copa, in: IEEE INFOCOM 2022-IEEE Conference on Computer Communications, IEEE, 2022, pp. 920–929.
[19]
Khan S., Hussain A., Nazir S., Khan F., Oad A., Alshehri M.D., Efficient and reliable hybrid deep learning-enabled model for congestion control in 5g/6 g networks, Comput. Commun. 182 (2022) 31–40.
[20]
Kharat P., Kulkarni M., Modquic protocol performance verification with cubic and bbr congestion control mechanisms, Int. J. Internet Protocol Technol. 14 (3) (2021) 177–187.
[21]
Kim G.-H., Song Y.-J., Cho Y.-Z., Improvement of inter-protocol fairness for bbr congestion control using machine learning, in: 2020 International Conference on Artificial Intelligence in Information and Communication, ICAIIC, IEEE, 2020, pp. 501–504.
[22]
Kosek M., Shreedhar T., Bajpai V., Beyond quic v1: A first look at recent transport layer ietf standardization efforts, IEEE Commun. Mag. 59 (4) (2021) 24–29.
[23]
Li W., Zhou F., Chowdhury K.R., Meleis W., Qtcp: Adaptive congestion control with reinforcement learning, IEEE Trans. Netw. Sci. Eng. 6 (3) (2018) 445–458.
[24]
Liu X., Zhou Q., Cheng C.-T., Liu C., A greedy-model-based reinforcement learning algorithm for beyond-5 g cooperative data collection, Phys. Commun. 50 (2022).
[25]
Mahmud I., Cho Y.-Z., Bbr advanced(bbr-a)—reduced retransmissions with improved fairness, ICT Express 6 (4) (2020) 343–347.
[26]
Midhula K., et al., An adaptive congestion control protocol for wireless networks using deep reinforcement learning, IEEE Trans. Netw. Serv. Manag. (2023).
[27]
Mittal R., Lam V.T., Dukkipati N., Blem E., Wassel H., Ghobadi M., Vahdat A., Wang Y., Wetherall D., Zats D., Timely: Rtt-based congestion control for the datacenter, ACM SIGCOMM Comput. Commun. Rev. 45 (4) (2015) 537–550.
[28]
Nie X., Zhao Y., Li Z., Chen G., Sui K., Zhang J., Ye Z., Pei D., Dynamic tcp initial windows and congestion control schemes through reinforcement learning, IEEE J. Sel. Areas Commun. 37 (6) (2019) 1231–1247.
[29]
Pan W., Li X., Tan H., Xu J., Li X., Improvement of rtt fairness problem in bbr congestion control algorithm by gamma correction, Sensors 21 (12) (2021) 4128.
[30]
Sutton R.S., Barto A.G., Reinforcement Learning: An Introduction, MIT Press, 2018.
[31]
Ullah Z., Al-Turjman F., Mostarda L., Gagliardi R., Applications of artificial intelligence and machine learning in smart cities, Comput. Commun. 154 (2020) 313–323.
[32]
Verma L.P., Sharma V.K., Kumar M., Kanellopoulos D., A novel delay-based adaptive congestion control tcp variant, Comput. Electr. Eng. 101 (2022).
[33]
Wang, J., Zheng, Y., Ni, Y., Xu, C., Qian, F., Li, W., Jiang, W., Cheng, Y., Cheng, Z., Li, Y., et al., 2019. An active-passive measurement study of tcp performance over lte on high-speed rails. In: The 25th Annual International Conference on Mobile Computing and Networking. pp. 1–16.
[34]
Watkins C.J., Dayan P., Q-learning, Mach. Learn. 8 (1992) 279–292.
[35]
Xiao Y., Liu J., Wu J., Ansari N., Leveraging deep reinforcement learning for traffic engineering: A survey, IEEE Commun. Surv. Tutor. 23 (4) (2021) 2064–2097.
[36]
Xu L., Harfoush K., Rhee I., Binary increase congestion control(bic) for fast long-distance networks, IEEE INFOCOM 2004, vol. 4, IEEE, 2004, pp. 2514–2524.
[37]
Xu Z., Tang J., Yin C., Wang Y., Xue G., Experience-driven congestion control: When multi-path tcp meets deep reinforcement learning, IEEE J. Sel. Areas Commun. 37 (6) (2019) 1325–1336.
[38]
Yan, F.Y., Ma, J., Hill, G.D., Raghavan, D., Wahby, R.S., Levis, P., Winstein, K., 2018. Pantheon: The training ground for internet congestion-control research. In: 2018 { U S E N I X } Annual Technical Conference({ U S E N I X } { A T C } 18). pp. 731–743.
[39]
Zhang S., An evaluation of bbr and its variants, 2019, arXiv preprint arXiv:1909.03673.
[40]
Zhang L., Cui Y., Wang M., Yang Z., Jiang Y., Machine learning for internet congestion control: Techniques and challenges, IEEE Internet Comput. 23 (5) (2019) 59–64.
[41]
Zhang T., Mao S., Machine learning for end-to-end congestion control, IEEE Commun. Mag. 58 (6) (2020) 52–57.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Network and Computer Applications
Journal of Network and Computer Applications  Volume 229, Issue C
Sep 2024
282 pages

Publisher

Academic Press Ltd.

United Kingdom

Publication History

Published: 19 September 2024

Author Tags

  1. Congestion control
  2. BBR
  3. Reinforcement learning
  4. QUIC

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 31 Dec 2024

Other Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media