Face Emotion Recognition from Static Image Based on Convolution Neural Networks

M. A. Nasri, M. A. Hmani, A. Mtibaa, D. Petrovska-Delacretaz, M. Ben Slima, A. Ben Hamida

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Human-Machine Interaction systems have not yet reached all the emotional and social capacities. In this paper, we propose a face emotion recognition system from static image based on the Xception convolution neural network architecture and the K-fold-cross-validation strategy. The proposed system was improved using the fine-tuning method. The Xception model pre-trained on ImageNet database for objects recognition was fine-tuned to recognize seven emotional states. The proposed system is evaluated on the database recorded during the Empathic project and the AffectNet database. Our experimental results achieve an accuracy of 62%, 69% on Empathic and AffectNet databases respectively using the fine-tuning strategy. Combined the AffectNet and Empathic databases to train our proposed model, show significant improvement in the emotion recognition that achieves an accuracy of 91.2% on Empathic database.

Original languageEnglish
Title of host publication2020 International Conference on Advanced Technologies for Signal and Image Processing, ATSIP 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728175133
DOIs
Publication statusPublished - 1 Sept 2020
Externally publishedYes
Event5th International Conference on Advanced Technologies for Signal and Image Processing, ATSIP 2020 - Sfax, Tunisia
Duration: 2 Sept 20205 Sept 2020

Publication series

Name2020 International Conference on Advanced Technologies for Signal and Image Processing, ATSIP 2020

Conference

Conference5th International Conference on Advanced Technologies for Signal and Image Processing, ATSIP 2020
Country/TerritoryTunisia
CitySfax
Period2/09/205/09/20

Keywords

  • Convolution neural networks
  • Deep learning
  • Emotions
  • Facials expression
  • Recognition

Fingerprint

Dive into the research topics of 'Face Emotion Recognition from Static Image Based on Convolution Neural Networks'. Together they form a unique fingerprint.

Cite this