Emotiongan: Facial Expression Synthesis Based on Pre-Trained Generator

Abstract

Abstract Since the Generative Adversarial Networks (GANs) was proposed, researches on image generation attract many scholars’ general attention and good graces. Traditional GANs generate a sample by playing a minimax game between generator and discriminator. In this paper, we propose a new method called EmotionGAN for generating facial expression. Specifically, the inverse of the generator is firstly utilized to establish the mapping between the input and feature vector. Then the Generalized Linear Model (GLM) is used to fit the changing direction of different expressions in the feature space, which provide a linear guidance to the feature vector along the expression axis, and thus spatial distribution consistence with the target feature vector is assured. Finally the generator is applied to reconstruct the facial image of the expression. By controlling the intensity of the feature vector, the generated image can be smoothly changed on a specific expression. Experiments have shown that EmotionGAN can quickly generate face images with arbitrary expressions while ensuring identity information is not changed, and the image attributes are more accurate and the resolution is higher.