Optimized Edge Aggregation for Hierarchical Federated Learning

Abstract

In this paper, we consider a hierarchical federated learning system and formulate a joint problem of edge aggregation interval control and time allocation to minimize the weighted sum of training loss and training latency. To quantify the learning performance, an upper bound of the average global gradient deviation, in terms of the edge aggregation interval, the time allocated for training, and the number of successfully participating devices, is derived. Then an alternative problem is formulated, which can be decoupled into two sub-problems and solved with two steps. In the first step, given the time allocation strategy, a relaxation and rounding method is proposed to optimize the edge aggregation interval. In the second step, with the results of the obtained edge aggregation interval and based on the convex optimization theory, an optimal time allocation can be evaluated. Simulation results show that the proposed scheme, compared to the benchmarks, can achieve higher learning performance with lower training latency.