Distance-aware Multi-Agent Reinforcement Learning for Task Offloading in MEC Network

Abstract

Mobile Edge Computing (MEC) offers hugeous computing power and transmission capacity to allow various mobile terminal devices to offload their computation-intensive and delay-sensitive tasks to the nearby edge server. In this paper, we formulate the task offloading problem of multi-user and multi-server environment into multi-agent paradigm by describing each terminal device as an agent/ user. Multi-Agent Reinforcement Learning (MARL) is more applicable and effective to solve this problem in decentralized way other than in centralized way like single-agent methods. We propose a task offloading strategy named Distance-aware Multi-Agent Deep Deterministic Policy Gradient (DA-MA) and our system consists of mobile terminals, MEC servers, and various task sequences generated from different task arrival patterns. The optimization objective is to minimize the task completion delay under the condition of occupying transmission uplink exclusively to the same destination server. Each agent's partial observation includes its task features, offloading link's access state, the computational capacity of servers, and especially the distance to each MEC server. Finally, extensive experimental results show that our DA-MA algorithm has good convergence and it can achieve the better performance compared to other baselines. Furthermore, we depict cooperation among agents and among task priorities within whole offloading process in detail.