Affiliations: State Grid Information and Telecommunication Co., Ltd., Changping District, Beijing, China
Correspondence:
[*]
Corresponding author: Nan Zhang, State Grid Information and Telecommunication Co.,Ltd., Changping District, Beijing 100031, China. E-mail: cara0526@163.com
Abstract: The Internet of Things has a large number of terminal devices and a wide range of deployment. This feature has higher requirements for reliable transmission and parallel connection, and is more prone to network congestion resulting in the loss of power information flow and excessive delay. The traditional congestion control algorithm is not suitable for the high concurrent mass heterogeneous iot terminal access control and mass information flow storage control. In this paper, the Transformer BBR algorithm is proposed, which is a congestion control algorithm based on BBR deep reinforcement learning combined with Transformer’s excellent long-term prediction ability. In the BBR algorithm bandwidth detection stage, transformer model is used as an agent to detect the network state and map it to the congestion window, so as to find the network changing state in time and make the corresponding decision action. Firstly, the congestion control strategy is learned in the simulation network environment, and then the efficiency is verified in the simulation environment. Finally, the experiment shows that the algorithm can reduce the delay while ensuring good bandwidth performance, and is superior to the main application algorithms in network throughput.
Keywords: Congestion control, deep reinforcement learning, transformer, web caching
