Zum Inhalt springen

Nur-Lesen-Fassung: Das Forschungsinformationssystem (FIS) ist aus Sicherheitsgründen vorübergehend durch diese Nur-Lesen-Fassung ersetzt. Alle öffentlichen Inhalte und Volltexte sind weiterhin abrufbar; Anmeldung, Bearbeitung, Einreichung und Statistiken stehen nicht zur Verfügung. Bei Fragen: fis@uni-bamberg.de

Start › Publikationen › FMC-Net : A Human-Guided Deep Learning Framework for Adaptable and Transparent Facial Expression Recognition in Real-World Scenarios

Publikation

FMC-Net : A Human-Guided Deep Learning Framework for Adaptable and Transparent Facial Expression Recognition in Real-World Scenarios

Rieger, Ines; Pahl, Jasper; Schmid, Ute (2025): FMC-Net : A Human-Guided Deep Learning Framework for Adaptable and Transparent Facial Expression Recognition in Real-World Scenarios, in: Applied intelligence : the international journal of artificial intelligence, neural networks, and complex problem-solving technologies, Dordrecht [u.a.]: Springer Science + Business Media B.V, Jg. 55, Nr. 18, 1127, S. 1–19, doi: 10.1007/s10489-025-07017-9.

Details

Fakultät/Lehrstuhl
Autorin(nen)/Autor(en)
Titel der Zeitschrift
Applied intelligence : the international journal of artificial intelligence, neural networks, and complex problem-solving technologies
ISSN
1573-7497
0924-669X
Verlagsangabe
Springer Science + Business Media B.V : Dordrecht [u.a.]
Erscheinungsjahr
2025
Jahrgang
55
Heft
18, 1127
Sprache(n)
Englisch
DOI
Abstract

We introduce FMC-Net, a facial expression recognition (FER) framework that leverages the hierarchical relationship between discrete facial muscle movements, known as Action Units (AUs), and Facial Expressions (FEs) by integrating two complementary constraint layers. This framework couples data-driven learning with psychology-grounded structure. First, a training-time correlation constraint aligns the two tasks within a multi-task network by softly regularizing a target statistical relationship. This can improve sample efficiency and generalization, particularly under limited or biased data. Second, an inference-time fuzzy rule layer maps the networks probabilistic AU predictions to FEs using compact, human-editable from psychological research, yielding transparent, per-decision attributions. An ensemble then combines the model and rule-based pathways and exposes a disagreement-based risk score for human-in-the-loop triage. This two-layer constraint integration addresses the limitations of single-mechanism approaches: training-time constraints shape the learned representations but lack case-wise transparency, while inference-time rules explain decisions but cannot improve the underlying features. Experiments across diverse datasets, including in-the-wild video and cross-dataset evaluation, validate our approach. Constraint-guided training consistently produces models that outperform competitive baselines, while the rule-based pathway can provide transparency and actionable risk signals towards reliable deployment. The proposed methodology is also generalizable to other machine learning tasks with interdependent outputs.

Freie Schlagwort(e)
Deep learning
Facial expression recognition
Constraint integration
Human-guided AI
Dokumenttyp
Artikel in einer Zeitschrift / Postprint
URI
Datum der Freischaltung
12.12.2025
Projekt(e)

Permalink: https://fis.uni-bamberg.de/handle/uniba/112138 · Daten als JSON · Zitieren: BibTeX · RIS

Datenstand: 15.11.2026

Eingeschränkter Lesezugriff: Anmeldung, Bearbeitung und Einreichung sind vorübergehend deaktiviert.