Deep Reinforcement Learning for Online Resource Allocation in Network Slicing

Abstract

Network slicing is a key enabler of 5G and beyond networks to satisfy the diverse quality of service (QoS) requirements of different services simultaneously. In network slicing, radio access network (RAN) slicing is essential to establish a functional network slice by connecting mobile devices and mapping virtualized resource units to different slices. This requires a highly efficient resource allocation scheme to maximize resource utilization efficiency and meet the diverse QoS requirements. In this paper, we propose a dynamic RAN slicing model that incorporates multiple distributions to accommodate different user request types and diverse priorities among traffic types in the same slice, where the total available resources are dynamically changing over time. We formulate resource allocation as a time-sequential dynamic optimization problem that takes into account system stability, resource limitation, different timescales, long-term system performance, and user priority. We propose a deep reinforcement learning-based (DRL-based) approach referred to as prediction-aided weighted DRL (PW-DRL) to online infer the power allocation and user acceptance decisions that can maximize a predefined reward function. Additionally, a prediction network is formulated to capture the correlation between current and future states. Simulation results validate that our proposed PW-DRL significantly outperforms state-of-the-art approaches by achieving the highest long-term reward and fastest convergence.