Leveraging extensive feature modeling for facial emotion recognition
by Milica Tufegdzic, Nevena Tufegdzic, Marija Mojsilovic
Computing and Artificial Intelligence, Vol.3, No.4, 2025;
Facial emotion recognition (FER) is an important area of affective computing with applications in human–computer interaction, healthcare, education, and intelligent systems. Although recent FER research is largely dominated by deep learning and transformer-based approaches, handcrafted feature modeling remains attractive due to its interpretability and lower computational requirements. This study proposes an Action Unit–based machine learning (AU-ML) framework for recognizing basic emotions from lateral facial expressions using the Karolinska Directed Emotional Faces (KDEF) dataset. Facial Action Units (AUs) were extracted, and manual feature selection was performed to retain only AU intensity and presence information relevant to emotion recognition. This process significantly reduced the original feature vector, improving computational efficiency while preserving classification performance. To compensate for the reduced dataset size after extracting lateral images, data augmentation techniques, including horizontal flipping, shifting, scaling, rotation, and brightness and contrast adjustments, were applied prior to AU extraction. Several machine learning algorithms were evaluated, including K-Nearest Neighbors, Support Vector Classifier, Decision Tree, Naïve Bayes, Random Forest, AdaBoost, Bagging, Voting, and Stacking Classifiers, CatBoost, and Extreme Gradient Boosting. The results demonstrated that ensemble methods generally outperformed simpler classifiers, with CatBoost achieving the best classification performance. The findings indicate that extensive feature modeling remains a reliable approach to emotion recognition, and that AU-based representations provide an interpretable and computationally efficient alternative to deep learning approaches.
show more