TY - CPAPER TI - Proceedings of the Second Workshop on AI in Production AU - Alsheikh, Ahmad AU - Fischer, Andreas AU - Banf, Michael AU - Kuhn, Johannes AU - Fichtel, Lars AU - Seuß, Dominik AU - Marchl, Andreas AU - Kasper, Maximilian AU - Geis, Simon AU - Deutel, Mark AU - Plinge, Axel AU - Mattick, Alexander AU - Sturm, Louis AU - Müller, Felix AU - Loftus, Sebastian AU - Asif, Haris AU - Mutschler, Christopher AU - Pahl, Jasper AU - Göttl, Quirin AU - Mayat, Nils AU - Schönekehs, Chris AU - Padrón Hinrichs, Marcos AU - Weisser, Tim AU - Schmitt, Robert ED - Knoblach, Judith ED - Krockert, Martin ED - Bahr, Lukas ED - Voigt, Erik PY - 2026 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-114337 UR - https://fis.uni-bamberg.de/handle/uniba/114337 LA - eng AB - The 2nd Workshop on Artificial Intelligence in Production (AIP) was held as part of the 48th German Conference on Artificial Intelligence in Potsdam on September 16, 2025. The workshop was organised jointly by academic and industrial partners from the University of Bamberg, HTW Dresden, and the BMW Group. The aim of the AIP workshop is to bring together researchers and practitioners from Artificial Intelligence (AI) and production to exchange ideas, experiences, and solutions for applying AI across production planning, control, and optimisation. By fostering interdisciplinary dialogue and sharing transferable approaches, the workshop seeks to advance effective, scalable, and sustainable AI applications in production and related domains, and strengthening the connection between academic research and industrial practice. In the 2025 edition, seven researchers and practitioners presented their latest work in the field. The workshop received eight submissions, of which seven were accepted after a peer-review process involving two members of the programme committee per paper. We would like to thank all authors, reviewers, and participants for their valuable contributions, which made the workshop a success. KW - AI KW - Production ER - TY - JOUR TI - FMC-Net : A Human-Guided Deep Learning Framework for Adaptable and Transparent Facial Expression Recognition in Real-World Scenarios AU - Rieger, Ines AU - Pahl, Jasper AU - Schmid, Ute PY - 2025 SP - 1-19 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/112139 LA - eng AB - We introduce FMC-Net, a facial expression recognition (FER) framework that leverages the hierarchical relationship between discrete facial muscle movements, known as Action Units (AUs), and Facial Expressions (FEs) by integrating two complementary constraint layers. This framework couples data-driven learning with psychology-grounded structure. First, a training-time correlation constraint aligns the two tasks within a multi-task network by softly regularizing a target statistical relationship. This can improve sample efficiency and generalization, particularly under limited or biased data. Second, an inference-time fuzzy rule layer maps the networks probabilistic AU predictions to FEs using compact, human-editable from psychological research, yielding transparent, per-decision attributions. An ensemble then combines the model and rule-based pathways and exposes a disagreement-based risk score for human-in-the-loop triage. This two-layer constraint integration addresses the limitations of single-mechanism approaches: training-time constraints shape the learned representations but lack case-wise transparency, while inference-time rules explain decisions but cannot improve the underlying features. Experiments across diverse datasets, including in-the-wild video and cross-dataset evaluation, validate our approach. Constraint-guided training consistently produces models that outperform competitive baselines, while the rule-based pathway can provide transparency and actionable risk signals towards reliable deployment. The proposed methodology is also generalizable to other machine learning tasks with interdependent outputs. KW - Deep learning KW - Facial expression recognition KW - Constraint integration KW - Human-guided AI ER - TY - JOUR TI - FMC-Net : A Human-Guided Deep Learning Framework for Adaptable and Transparent Facial Expression Recognition in Real-World Scenarios AU - Rieger, Ines AU - Pahl, Jasper AU - Schmid, Ute PY - 2025 JO - Applied intelligence : the international journal of artificial intelligence, neural networks, and complex problem-solving technologies VL - 55 IS - 18, 1127 SP - 1-19 PB - Springer Science + Business Media B.V CY - Dordrecht [u.a.] SN - 1573-7497 DO - 10.1007/s10489-025-07017-9 UR - https://fis.uni-bamberg.de/handle/uniba/112138 LA - eng AB - We introduce FMC-Net, a facial expression recognition (FER) framework that leverages the hierarchical relationship between discrete facial muscle movements, known as Action Units (AUs), and Facial Expressions (FEs) by integrating two complementary constraint layers. This framework couples data-driven learning with psychology-grounded structure. First, a training-time correlation constraint aligns the two tasks within a multi-task network by softly regularizing a target statistical relationship. This can improve sample efficiency and generalization, particularly under limited or biased data. Second, an inference-time fuzzy rule layer maps the networks probabilistic AU predictions to FEs using compact, human-editable from psychological research, yielding transparent, per-decision attributions. An ensemble then combines the model and rule-based pathways and exposes a disagreement-based risk score for human-in-the-loop triage. This two-layer constraint integration addresses the limitations of single-mechanism approaches: training-time constraints shape the learned representations but lack case-wise transparency, while inference-time rules explain decisions but cannot improve the underlying features. Experiments across diverse datasets, including in-the-wild video and cross-dataset evaluation, validate our approach. Constraint-guided training consistently produces models that outperform competitive baselines, while the rule-based pathway can provide transparency and actionable risk signals towards reliable deployment. The proposed methodology is also generalizable to other machine learning tasks with interdependent outputs. KW - Deep learning KW - Facial expression recognition KW - Constraint integration KW - Human-guided AI ER - TY - CPAPER TI - CorrLoss : Integrating Co-Occurrence Domain Knowledge for Affect Recognition AU - Rieger, Ines AU - Pahl, Jaspar AU - Finzel, Bettina AU - Schmid, Ute PY - 2022 T2 - 2022 26th International Conference on Pattern Recognition (ICPR): Proceedings SP - 798-804 PB - IEEE SN - 978-1-6654-9062-7 DO - 10.1109/ICPR56361.2022.9956319 UR - https://fis.uni-bamberg.de/handle/uniba/58025 LA - eng ER - TY - CPAPER TI - Female, white, 27? : Bias Evaluation on Data and Algorithms for Affect Recognition in Faces AU - Pahl, Jaspar AU - Rieger, Ines AU - Möller, Anna AU - Wittenberg, Thomas AU - Schmid, Ute PY - 2022 SP - 973-987 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/55613 LA - eng AB - Nowadays, Artificial Intelligence (AI) algorithms show a strong performance for many use cases, making them desirable for real-world scenarios where the algorithms provide high-impact decisions. However, one major drawback of AI algorithms is their susceptibility to bias and resulting unfairness. This has a huge influence for their application, as they have a higher failure rate for certain subgroups. In this paper, we focus on the field of affective computing and particularly on the detection of bias for facial expressions. Depending on the deployment scenario, bias in facial expression models can have a disadvantageous impact and it is therefore essential to evaluate the bias and limitations of the model. In order to analyze the metadata distribution in affective computing datasets, we annotate several benchmark training datasets, containing both Action Units and categorical emotions, with age, gender, ethnicity, glasses, and beards. We show that there is a significantly skewed distribution, particularly for ethnicity and age. Based on this metadata annotation, we evaluate two trained state-of-the-art affective computing algorithms. Our evaluation shows that the strongest bias is in age, with the best performance for persons under 34 and a sharp decrease for older persons. Furthermore, we see an ethnicity bias with varying direction depending on the algorithm, a slight gender bias and worse performance for facial parts occluded by glasses. KW - affective computing KW - action units KW - categorical emotions KW - metadata post-annotation KW - bias KW - fairness KW - data evaluation, KW - algorithm evaluation ER - TY - CPAPER TI - Deriving Temporal Prototypes from Saliency Map Clusters for the Analysis of Deep-Learning-based Facial Action Unit Classification AU - Finzel, Bettina AU - Kollmann, Rene AU - Rieger, Ines AU - Pahl, Jaspar AU - Schmid, Ute PY - 2022 SP - 86-97 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/55380 LA - eng AB - Reliably determining the emotional state of a person is a difficult task for both humans as well as machines. Automatic detection and evaluation of facial expressions is particularly important if people are unable to express their emotional state themselves, for example due to cognitive impairments. Identifying the presence of Action Units in a human’s face is a psychologically validated approach of quantifying which emotion is expressed. To automate the detection process of Action Units Neural Networks have been trained. However, the black-box nature of Deep Neural Networks provides no insight on the relevant features identified during the decision process. Approaches of Explainable Artificial Intelligence have to be applied to provide an explanation why the network came to a certain conclusion. In this work "Layer-Wise Relevance Propagation" (LRP) in combination with the meta analysis approach "Spectral Relevance Analysis" (SpRAy) is used to derive temporal prototypes from predictions in video sequences. Temporal prototypes provide an aggregated view on the prediction of the network by grouping together similar frames by considering relevance. Additionally, a specific visualization method for temporal prototypes is presented that highlights the most relevant areas for a prediction of an Action Unit. A quantitative evaluation of our approach shows that temporal prototypes aggregate temporal information well. The proposed method can be used to generate concise visual explanations for a sequence of interpretable saliency maps. Based on the above, this work shall provide the foundation for a new temporal analysis method as well as an explanation approach that is supposed to help researchers and experts to gain a deeper understanding of how the underlying network decides which Action Units are active in a particular emotional state. KW - Temporal Prototypes KW - Facial Action Unit Detection KW - Layer-wise Relevance Propagation KW - Spectral Clustering KW - Affective Computing KW - Correlation Analysis ER - TY - CPAPER TI - Female, white, 27? : Bias Evaluation on Data and Algorithms for Affect Recognition in Faces AU - Pahl, Jaspar AU - Rieger, Ines AU - Möller, Anna AU - Wittenberg, Thomas AU - Schmid, Ute PY - 2022 T2 - FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency : 2022 Proceeding SP - 973-987 PB - Association for Computing Machinery SN - 978-1-4503-9352-2 DO - 10.1145/3531146.3533159 UR - https://fis.uni-bamberg.de/handle/uniba/55036 LA - eng AB - Nowadays, Artificial Intelligence (AI) algorithms show a strong performance for many use cases, making them desirable for real-world scenarios where the algorithms provide high-impact decisions. However, one major drawback of AI algorithms is their susceptibility to bias and resulting unfairness. This has a huge influence for their application, as they have a higher failure rate for certain subgroups. In this paper, we focus on the field of affective computing and particularly on the detection of bias for facial expressions. Depending on the deployment scenario, bias in facial expression models can have a disadvantageous impact and it is therefore essential to evaluate the bias and limitations of the model. In order to analyze the metadata distribution in affective computing datasets, we annotate several benchmark training datasets, containing both Action Units and categorical emotions, with age, gender, ethnicity, glasses, and beards. We show that there is a significantly skewed distribution, particularly for ethnicity and age. Based on this metadata annotation, we evaluate two trained state-of-the-art affective computing algorithms. Our evaluation shows that the strongest bias is in age, with the best performance for persons under 34 and a sharp decrease for older persons. Furthermore, we see an ethnicity bias with varying direction depending on the algorithm, a slight gender bias and worse performance for facial parts occluded by glasses. KW - affective computing KW - action units KW - categorical emotions KW - metadata post-annotation KW - bias KW - fairness KW - data evaluation, KW - algorithm evaluation ER - TY - CPAPER TI - Deriving Temporal Prototypes from Saliency Map Clusters for the Analysis of Deep-Learning-based Facial Action Unit Classification AU - Finzel, Bettina AU - Kollmann, Rene AU - Rieger, Ines AU - Pahl, Jaspar AU - Schmid, Ute PY - 2021 T2 - Proceedings of the LWDA 2021 Workshops: FGWM, KDML, FGWI-BIA, and FGIR SP - 86-97 PB - RWTH Aachen CY - Aachen, Germany UR - https://fis.uni-bamberg.de/handle/uniba/55037 LA - eng AB - Reliably determining the emotional state of a person is a difficult task for both humans as well as machines. Automatic detection and evaluation of facial expressions is particularly important if people are unable to express their emotional state themselves, for example due to cognitive impairments. Identifying the presence of Action Units in a human’s face is a psychologically validated approach of quantifying which emotion is expressed. To automate the detection process of Action Units Neural Networks have been trained. However, the black-box nature of Deep Neural Networks provides no insight on the relevant features identified during the decision process. Approaches of Explainable Artificial Intelligence have to be applied to provide an explanation why the network came to a certain conclusion. In this work "Layer-Wise Relevance Propagation" (LRP) in combination with the meta analysis approach "Spectral Relevance Analysis" (SpRAy) is used to derive temporal prototypes from predictions in video sequences. Temporal prototypes provide an aggregated view on the prediction of the network by grouping together similar frames by considering relevance. Additionally, a specific visualization method for temporal prototypes is presented that highlights the most relevant areas for a prediction of an Action Unit. A quantitative evaluation of our approach shows that temporal prototypes aggregate temporal information well. The proposed method can be used to generate concise visual explanations for a sequence of interpretable saliency maps. Based on the above, this work shall provide the foundation for a new temporal analysis method as well as an explanation approach that is supposed to help researchers and experts to gain a deeper understanding of how the underlying network decides which Action Units are active in a particular emotional state. KW - Temporal Prototypes KW - Facial Action Unit Detection KW - Layer-wise Relevance Propagation KW - Spectral Clustering KW - Affective Computing KW - Correlation Analysis ER - TY - CPAPER TI - Multi-label Learning with Missing Values using Combined Facial Action Unit Datasets AU - Pahl, Jaspar AU - Rieger, Ines AU - Seuß, Dominik PY - 2020 PB - arXiv UR - https://fis.uni-bamberg.de/handle/uniba/50306 LA - eng ER - TY - CPAPER TI - Unique Class Group Based Multi-Label Balancing Optimizer for Action Unit Detection AU - Rieger, Ines AU - Pahl, Jaspar AU - Seuß, Dominik PY - 2020 T2 - 2020: 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), proceedings SP - 619-623 PB - IEEE SN - 978-1-7281-3079-8 DO - 10.1109/FG47880.2020.00101 UR - https://fis.uni-bamberg.de/handle/uniba/50307 LA - eng ER -