Deep Reinforcement Learning for Energy-Efficient Task Offloading in Cooperative Vehicular Edge Networks

Abstract

In the Internet of Vehicle ecosystem, multi-access edge computing (MEC) enables mobile nodes to improve their communication and computation capabilities by executing transactions in near real-time. However, the limited energy and computation capabilities of MEC servers limit the efficiency of task computation. Moreover, the use of static edge servers in dense vehicular networks may lead to an influx of service requests that negatively impact the quality of service (QoS) of the edge network. To enhance the QoS and optimize network resources, minimizing offloading computation costs in terms of reduced latency and energy consumption is crucial. In this paper, we propose a cooperative offloading scheme for vehicular nodes, using vehicles as mobile edge servers, which minimizes energy consumption and network delay. In addition, an optimization problem is presented, which is formulated as a Markov Decision Process (MDP). The solution proposed is a deep reinforcement-based Twin Delayed Deep Deterministic policy gradient (TD3), ensuring an optimal balance between task computation time delay and the energy consumption of the system.