Enhanced-SETL: A multi-variable deep reinforcement learning approach for contention window optimization in dense Wi-Fi networks

Abstract

In this paper, we introduce the Enhanced Smart Exponential-Threshold-Linear (Enhanced-SETL) algorithm, a new approach that uses the multi-variable Deep Reinforcement Learning (DRL) framework to simultaneously optimize multiple settings of the Contention Window (CW) in IEEE 802.11 wireless networks. Unlike traditional DRL methods that adjust only a single CW parameter, our innovative approach simultaneously optimizes both the CW minimum (CWmin) and CW Threshold (CWThreshold), significantly improving network traffic control. We utilize a Double Deep Q-learning Network (DDQN) for dynamic updates of these CW settings, broadcasted across the dense Wi-Fi networks. This dual adjustment method, coupled with dynamic, data-driven updates, not only enhances throughput, but also reduces collision rates, and ensures fairness access across both static and dynamic wireless environments. Enhanced-SETL achieves a throughput improvement ranging from 3.55% up to 43.73% and from 3.98% up to 30.15% in static and dynamic scenarios over standard protocols and state-of-the-art DRL models, while maintaining a fairness index near 99% across diverse stations, showcasing its effectiveness and adaptability in various network conditions.