Skip to main navigation Skip to search Skip to main content

Evaluating Speech Emotion Recognition Systems: From Traditional Low-Level Features to Transformer-Based Models

  • Department of Telecommunications
  • University 'Politehnica' of Bucharest
  • Telecom Sudparis

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Speech Emotion Recognition (SER) plays a crucial role in affective computing, human-computer interaction, and psychological assessment. This paper presents a comparative analysis of traditional and transformer-based feature extraction techniques for SER. First, Mel-Frequency Cepstral Coefficients (MFCCs) and Mel-Spectrograms (Mel-Specs) are employed to train a three-layer Convolutional Neural Network (CNN) from scratch, assessing their effectiveness in classifying emotions. Subsequently, features extracted from a pretrained transformer model are evaluated using both Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP) classifiers. Experimental results demonstrate that the MLP classifier applied to transformer-extracted features achieves the highest classification accuracy, reaching 89.94% on the RAVDESS and 84.75% on SAVEE. Finally, a detailed misclassification analysis reveals systematic confusion patterns, suggesting that SER models capture subtle affective cues beyond discrete emotion categories.

Original languageEnglish
Title of host publicationAdvances in Digital Health and Medical Bioengineering 2 - Volume 2
Subtitle of host publicationHealth Technology Assessment, Biomedical Signal Processing, Medicine and Informatics
EditorsHariton-Nicolae Costin, Ratko Magjarevic, Gladiola Gabriela Petroiu
PublisherSpringer Science and Business Media Deutschland GmbH
Pages81-88
Number of pages8
ISBN (Print)9783032240446
DOIs
Publication statusPublished - 1 Jan 2026
Event13th International Conference on E-Health and Bioengineering, EHB 2025 - Iasi, Romania
Duration: 13 Nov 2025 → 14 Nov 2025

Publication series

NameIFMBE Proceedings
Volume143 IFMBE
ISSN (Print)1680-0737
ISSN (Electronic)1433-9277

Conference

Conference13th International Conference on E-Health and Bioengineering, EHB 2025
Country/TerritoryRomania
CityIasi
Period13/11/25 → 14/11/25

Keywords

  • Objective evaluation
  • Speech emotion recognition
  • Traditional low-level features
  • Transformer model

Fingerprint

Dive into the research topics of 'Evaluating Speech Emotion Recognition Systems: From Traditional Low-Level Features to Transformer-Based Models'. Together they form a unique fingerprint.

Cite this