Facial Expression Recognition Based on Multi-dataset Neural Network

Abstract

Facial activity is the most powerful and natural means for understanding emotional expression for humans. Recent years, extensive efforts have been devoted to facial expression recognition by using neural networks. However, automated emotion recognition in the wild from facial images remains a challenging problem. In this paper, an effective facial expression recognition scheme is proposed. A multi-dataset neural network is developed to learn facial expression features in several different but related datasets. The novel multi-dataset network fuses the intermediate layers of a deep convolutional neural network (CNN) by using separate CNNs and a multi-dataset loss function. Experimental results performed on emotion database demonstrate that our proposed method outperforms state-of-the-art.