Personalized client-edge-cloud hierarchical federated learning in mobile edge computing

Abstract

Abstract Mobile edge computing aims to deploy mobile applications at the edge of wireless networks. Federated learning in mobile edge computing is a forward-looking distributed framework for deploying deep learning algorithms in many application scenarios. One challenge of federated learning in mobile edge computing is data heterogeneity since the unified model of federated learning performs poorly when client data are non-independent and identically distributed. Personalized federated learning can obtain amazing models in scenarios where client data are non-independent and identically distributed. This is because the personalized model captures the features of users’ local data more accurately than the unified model. The personalized federated learning problem under two-tier (server-client) federated learning structures has been widely studied and applied. However, a lot of research results exhibit three distinct limitations: 1) suboptimal communication efficiency, 2) slow model convergence, and 3) underutilization of the relationships within user data, resulting in lower accuracy of personalized models. In this paper, we present the first personalized federated learning algorithm based on the client-edge-cloud structure. The edge server is responsible for model personalization and employs a learnable mixing parameter to mix the local model and the global model. We also utilize two learnable normalization parameters trained by clients to improve the performance of personalized models. Furthermore, in order to facilitate the collaboration among edge servers, we propose a similarity aggregation method to assign aggregation weights based on the Tanimoto coefficients between models. The experimental results show that the proposed algorithm not only increases the convergence speed of personalized models but also improves their testing accuracy.