Deep Reinforcement Learning for Smart Queue Management

Authors

  • Hassan Fawaz Télécom SudParis - Institut Polytechnique de Paris
  • Djamal Zeghlache Télécom SudParis
  • Tran Anh Pham Huawei Technologies
  • Jérémie Leguay Huawei - French Research Center
  • Paolo Medagliani Mathematical and Algorithmic Sciences Lab, France Research Center, Huawei Technologies Co. Ltd.

DOI:

https://doi.org/10.14279/tuj.eceasst.80.1139

Abstract

With the goal of meeting the stringent throughput and delay requirements of classified network flows, we propose a Deep Q-learning Network (DQN) for optimal weight selection in an active queue management system based on Weighted Fair Queuing (WFQ). Our system schedules flows belonging to different priority classes (Gold, Silver, and Bronze) into separate queues, and learns how and when to dequeue from each queue. The neural network implements deep reinforcement learning tools such as target networks and replay buffers to help learn the best weights depending on the network state. We show, via simulations, that our algorithm converges to an efficient model capable of adapting to the flow demands, producing thus lower delays with respect to traditional WFQ.

Downloads

Published

2021-09-08

How to Cite

[1]
H. Fawaz, D. Zeghlache, T. A. Pham, J. Leguay, and P. Medagliani, “Deep Reinforcement Learning for Smart Queue Management”, eceasst, vol. 80, Sep. 2021.