TY - THES TI - Methods, Mechanisms, and Effects of Explainable AI-based Decision Support AU - Haag, Felix PY - 2026 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-115736 UR - https://fis.uni-bamberg.de/handle/uniba/115736 LA - eng AB - Entwicklungen im Bereich der Künstlichen Intelligenz (KI) haben die Bearbeitung vieler Aufgaben in unserem Alltag und Berufsleben verändert. Empirische Studien zeigen, dass KI-Systeme in spezifischen Anwendungsfeldern Aufgaben automatisiert mit hoher Genauigkeit und teils überlegener Performanz im Vergleich zu vielen menschlichen Experten ausführen können (z. B. Esteva et al., 2017; Silver et al., 2016). Trotz beeindruckender Leistungen der KI verbleibt die Verantwortung für die Konsequenzen von KI-basierten Entscheidungen beim Menschen (Sturm et al., 2023). Damit verschiebt sich der Fokus für viele Aufgaben von der automatisierten Aufgabenausführung hin zu einer kollaborativen Interaktion zwischen Mensch und KI-basierter Entscheidungsunterstützung (Wilson und Daugherty, 2018). Ein zentraler Erfolgsfaktor für diese Kollaboration scheint die Erklärbarkeit der zugrunde liegenden Modelle des maschinellen Lernens zu sein (vgl. Hemmer et al., 2022), die im Zentrum des Forschungsfelds der erklärbaren KI steht (vgl. Adadi und Berrada, 2018). Studien in der Literatur zu Informationssystemen (IS) verweisen auf Vorteile durch Erklärungen, wie beispielsweise ein höheres Vertrauen in KI (z. B. Meske und Bunde, 2022), eine höhere Akzeptanz (z. B. Gönül et al., 2006) sowie eine verbesserte menschliche Entscheidungsperformanz (z. B. Förster et al., 2025). Wobei sich in der Literatur ein relativ konsistentes Bild hinsichtlich des Einflusses von Erklärbarkeit auf Vertrauen zeigt (vgl. Atf und Lewis, 2025), ist das Bild zur Entscheidungsperformanz ambivalent: Während einige Studien positive Effekte durch erklärbare KI-basierte Entscheidungsunterstützung berichten (z. B. Lai et al., 2020), finden andere keine oder sogar negative Effekte (z. B. Bauer et al., 2023; Carton et al., 2020). Diese Heterogenität der Effekte legt nahe, dass die Effektivität von erklärbarer KI (d. h. die Wirkung von Erklärbarkeit als Merkmal von KI) für die Entscheidungsunterstützung von verschiedenen Einflussfaktoren abhängt – und weniger robust und konsistent ist, als häufig angenommen (vgl. Schemmer et al., 2022). Für die Diskrepanz zwischen der angenommenen und beobachteten Effektivität könnten mehrere Faktoren eine entscheidende Rolle spielen. Einerseits könnten Einschränkungen der derzeitigen Methoden, etwa in Bezug auf die Qualität der bereitgestellten Erklärungen, von Bedeutung sein (vgl. Rudin, 2019). Andererseits könnten menschliche Faktoren, wie Präferenzen oder kognitive Prozesse bei der Nutzung von Erklärungen, maßgeblich zur Heterogenität der Effekte beitragen (vgl. Bauer et al., 2021; Fürnkranz et al., 2020). Zudem wurden die Effekte von erklärbarer KI-basierter Entscheidungsunterstützung vor allem in kontrollierten Umgebungen untersucht (z. B. Förster et al., 2025), wohingegen Feldstudien, die reale Anwendungskontexte berücksichtigen, bislang selten sind (Brasse et al., 2023). Vor diesem Hintergrund wird deutlich, dass Erklärbarkeit zwar häufig als Schlüsselfaktor für die Effektivität von KI-basierter Entscheidungsunterstützung angeführt wird (z. B. Hemmer et al., 2022), ihr tatsächlicher Beitrag zur Mensch-KI-Kollaboration in großen Teilen bislang jedoch unzureichend verstanden ist. Entsprechende Erkenntnisse könnten daher sowohl das theoretische Fundament für die effektive Interaktion zwischen Mensch und erklärbarer KI erweitern als auch praktische Implikationen für die Gestaltung von erklärbaren KI-basierten Entscheidungsunterstützungssystemen aufzeigen. Diese Dissertation adressiert diesen Forschungsbedarf, indem sie Methoden, Mechanismen und Effekte erklärbarer KI-basierter Entscheidungsunterstützung untersucht. Dazu (i) synthetisiert sie die bisherigen Befunde zum Effekt von erklärbarer KI-basierter Entscheidungsunterstützung auf die menschliche Entscheidungsperformanz, (ii) analysiert die zugrunde liegenden Mechanismen, mit welchen Erklärungen diese Performanz potenziell beeinflussen und (iii) ergänzt diese Arbeiten durch die Untersuchung eines erklärbare KI-basierten Entscheidungsunterstützungssystems im Feld. Damit leistet diese Dissertation einerseits theoretische Beiträge zur Interaktion zwischen Mensch und erklärbarer KI und zeigt andererseits praktische Implikationen, etwa zur Gestaltung von erklärbare KI-basierten Entscheidungsunterstützungssystemen, auf. Die Arbeiten stützen sich auf Anwendungen in unterschiedlichen Domänen, darunter die Energiebranche und digitale Hochschullehre. Insgesamt umfasst die Dissertation ein Rahmenpapier sowie neun wissenschaftliche Artikel, die in drei Kapiteln gebündelt sind. Kapitel 1 schafft zunächst ein grundlegendes Verständnis für den Gesamteffekt von erklärbarer KI-basierter Entscheidungsunterstützung auf die menschliche Entscheidungsperformanz, indem es die Befunde der Literatur in einer Meta-Analyse synthetisiert. Die Ergebnisse bestätigen die zuvor postulierte Heterogenität: Die berichteten Effekte variieren deutlich zwischen den Studien. Zudem zeigt die Analyse, dass der über alle Studien hinweg zusammengefasste zusätzliche Effekt von Erklärungen im Vergleich zu reiner KI-Unterstützung zwar positiv, aber klein ist. Eine Moderationsanalyse zum Risiko des Bias in den berichteten Studienergebnissen zeigt darüber hinaus, dass ein höheres Bias-Risiko systematisch mit größeren berichteten Effekten assoziiert ist. Dies legt nahe, dass die tatsächliche Effektgröße noch kleiner ist, was die Effektivität erklärbarer KI-basierter Entscheidungsunterstützung zusätzlich infrage stellt. Darüber hinaus prüft das Kapitel den Erklärungstyp als moderierenden Faktor, der in der Literatur als wichtig angeführt wird (Herm, 2023) und potenziell Unterschiede im Effekt von erklärbare KI-basierter Entscheidungsunterstützung erklären könnte. Die Ergebnisse zeigen, dass der Erklärungstyp allein die Variabilität der Effekte zwischen den Studien nicht erklären kann. Damit konsolidiert das Kapitel die Ergebnisse der Literatur, bestätigt die Heterogenität der Befunde und motiviert die vertiefte Untersuchung von Mechanismen in domänenspezifischen Kontexten. Kapitel 2 widmet sich detaillierten, domänenspezifischen Untersuchungen von potenziellen Mechanismen zur Erklärung von Unterschieden in der Effektivität erklärbarer KI-basierter Entscheidungsunterstützung. Das Kapitel betrachtet diese Mechanismen aus zwei Perspektiven: Einer methodenzentrierten und einer menschenzentrierten. Am Beispiel einer Cross-Selling-Vorhersage zu Produkten eines Energieversorgers zeigt das Kapitel, dass die Erklärungen einer erklärbaren KI-Methode für jenen Fall eine zeitliche Beständigkeit aufweisen. Darüber hinaus lassen die Ergebnisse erkennen, dass gängige post-hoc-Methoden in ihrer Erklärungsgüte zwar valide, jedoch begrenzt sind. Die Befunde der menschenzentrierten Perspektive legen nahe, dass Unterschiede in der Verständlichkeit und Präferenz von Visualisierungen Mechanismen darstellen, die Unterschiede in der Entscheidungsperformanz erklären können. Zudem deuten die Ergebnisse darauf hin, dass die Effektivität von Erklärungen auch von ihrer Salienz abhängt, indem diese die Aufmerksamkeit der Nutzenden lenkt. Die Entscheidungsperformanz verbesserte sich durch eine Erklärung marginal statistisch signifikant nur dann, wenn kein starker externer Reiz (hier: numerischer Anker) dominierte. Darüber hinaus zeigen die Befunde, dass sowohl KI-gestützte als auch durch Erklärungen ergänzte Unterstützung den negativen Einfluss des Anker-Bias abschwächen kann. Damit liefert das Kapitel empirische Evidenz für eine Proposition, die auf dem Selective Accessibility Model, einem theoretischen Modell zur Erklärung des Anker-Bias-Phänomens, basiert (vgl. Mussweiler et al., 2000). Zusammengefasst identifiziert Kapitel 2 Mechanismen für die Effektivität erklärbarer KI-basierter Entscheidungsunterstützung und erweitert damit das theoretische Fundament für eine effektive Interaktion zwischen Mensch und erklärbarer KI. Kapitel 3 erweitert die bislang seltene Evidenz aus Feldexperimenten (vgl. Brasse et al., 2023) und geht über bestehende Forschungsarbeiten hinaus, indem es ein neuartiges erklärbare KI-basiertes Entscheidungsunterstützungssystem instanziiert. Das System basiert auf Erkenntnissen der Theorie des selbstregulierten Lernens sowie auf kontrafaktischen Erklärungen aus der erklärbaren KI. Ziel der Instanziierung ist es, die Heterogenität der Lernenden bei der Feedbackbereitstellung zu berücksichtigen. Mithilfe auf historischen Daten trainierter Modelle generiert das System personalisiertes Feedback und schlägt Lernaktionen zur Verbesserung des prognostizierten Klausurergebnisses vor. Die Evaluation in einem Feldexperiment zeigt, dass das System die Lernergebnisse der Studierenden verbessert: Während der Interventionsphase verbrachten die Teilnehmenden der Treatmentgruppe pro Woche im Durchschnitt 80,7 % mehr Zeit in der digitalen Lernumgebung als die Kontrollgruppe. Die Treatmentgruppe erzielte zudem 13,2 Punkte (von 90 möglichen Punkten) mehr in der Klausur. Darüber hinaus profitieren Lernende – anders als in vielen anderen Studien (z. B. Leung et al., 2023; Mousavi et al., 2025) – unabhängig von Lernercharakteristika, die mit selbstreguliertem Lernen zusammenhängen (Metakognition, Prokrastination). Zusammenfassend zeigt Kapitel 3 einen Weg für den effektiven Einsatz erklärbarer KI-basierter Entscheidungsunterstützung in einem realen Anwendungskontext. Es verbindet dabei die in der Theorie des selbstregulierten Lernens beschriebene Heterogenität von Lernenden mit der Instanziierung adaptiver IS, die diese Unterschiede adressieren. Damit legt Kapitel 3 die Grundlage für eine neue Form von Entscheidungsunterstützungssystemen, die erklärbare KI einsetzt, um personalisiertes Feedback bereitzustellen. Insgesamt leistet diese Dissertation einen Beitrag zum Verständnis der Methoden, Mechanismen und Effekte von erklärbarer KI-basierter Entscheidungsunterstützung. Durch die Identifikation von Mechanismen erweitert sie das theoretische Fundament für die Interaktion zwischen Mensch und erklärbarer KI. Zugleich bilden die Untersuchungen eine Grundlage für die effektive Gestaltung erklärbarer KI-basierter Entscheidungsunterstützungssysteme, die bei wichtigen Aufgaben im Alltag und im Berufsleben wirksam unterstützen können. KW - explainable artificial intelligence (XAI) KW - machine learning KW - human-AI collaboration KW - human decision-making KW - XAI-based decision support KW - decision support systems ER - TY - JOUR TI - How explanations from XAI-based decision support affect human task performance : a meta-analysis AU - Haag, Felix PY - 2026 SP - 1-28 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/115620 LA - eng AB - Artificial intelligence (AI) increasingly supports human decision-making across domains. Yet, many AI-based decision support systems (DSS) rely on machine learning models that are ‘black boxes’ to humans. This opacity has driven the development of explainable AI (XAI) methods that explain model outputs in human-understandable terms. Empirical findings, however, remain inconsistent regarding whether and how such explanations affect users’ decision performance: some studies report improvements, while others find negligible or even negative effects. To reconcile these inconsistencies, we conduct a meta-analysis with 4589 participants comparing XAI-supported decisions to unaided decisions and 7706 participants comparing XAI-supported to AI-only supported decisions. Our analyses indicate that, on average, XAI-based decision support is associated with higher task performance compared to no support, whereas the additional gains of explanations over AI-only support are small. We also find that studies’ risk of bias levels are associated with the magnitude of reported effects, suggesting larger reported performance gains in studies with higher risk of bias. Interestingly, explanation type alone does not show a significant moderating effect on task performance across studies. Overall, these findings provide a better understanding of how XAI explanations influence human decision-making and inform the design of XAI-based DSS. KW - Explainable artificial intelligence (XAI) KW - interpretable machine learning KW - decision performance KW - explanation types KW - risk of bias ER - TY - JOUR TI - How explanations from XAI-based decision support affect human task performance : a meta-analysis AU - Haag, Felix PY - 2026 JO - Journal of decision systems VL - 35 IS - 1, 2616693 SP - 1-28 PB - Taylor & Francis CY - Abingdon SN - 2116-7052 DO - 10.1080/12460125.2026.2616693 UR - https://fis.uni-bamberg.de/handle/uniba/115619 LA - eng AB - Artificial intelligence (AI) increasingly supports human decision-making across domains. Yet, many AI-based decision support systems (DSS) rely on machine learning models that are ‘black boxes’ to humans. This opacity has driven the development of explainable AI (XAI) methods that explain model outputs in human-understandable terms. Empirical findings, however, remain inconsistent regarding whether and how such explanations affect users’ decision performance: some studies report improvements, while others find negligible or even negative effects. To reconcile these inconsistencies, we conduct a meta-analysis with 4589 participants comparing XAI-supported decisions to unaided decisions and 7706 participants comparing XAI-supported to AI-only supported decisions. Our analyses indicate that, on average, XAI-based decision support is associated with higher task performance compared to no support, whereas the additional gains of explanations over AI-only support are small. We also find that studies’ risk of bias levels are associated with the magnitude of reported effects, suggesting larger reported performance gains in studies with higher risk of bias. Interestingly, explanation type alone does not show a significant moderating effect on task performance across studies. Overall, these findings provide a better understanding of how XAI explanations influence human decision-making and inform the design of XAI-based DSS. KW - Explainable artificial intelligence (XAI) KW - interpretable machine learning KW - decision performance KW - explanation types KW - risk of bias ER - TY - JOUR TI - Validating Explainer Methods : A Functionally Grounded Approach for Numerical Forecasting AU - Haag, Felix AU - Hopf, Konstantin AU - Staake, Thorsten PY - 2026 SP - 819-836 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/113131 LA - eng AB - Forecasting systems have a long tradition in providing outputs accompanied by explanations. While the vast majority of such explanations relies on inherently interpretable linear statistical models, research has put forth eXplainable Artificial Intelligence (XAI) methods to improve the comprehensibility of nonlinear machine learning models. As explanations related to forecasts constitute important building blocks in forecasting systems, the validation of explainer methods is an essential part of system selection, parameterization, and adoption. Current research on explainer method assessment focuses on metrics for classification rather than numerical forecasting and predominantly assesses explanation quality within time-consuming, costly, and subjective studies involving humans. Given that the functional validation of explanations is of core interest to research on forecasting, our paper makes three contributions: First, we establish an approach for functionally grounded validations of explainer methods for numerical forecasting. Second, we propose computational rules for the metrics consistency, stability, and faithfulness. Third, we demonstrate our approach for the forecasting case of electricity demand estimation for energy benchmarks and compare a linear statistical approach with the state-of-the-art XAI methods SHapley Additive exPlanations (SHAP), Local Interpretable Model-agnostic Explanations (LIME), and Explainable Boosting Machine (EBM). Our work allows research and practice to validate and compare the quality of explainer methods on a functionally grounded level. KW - explainable artificial intelligence KW - explainer method validation KW - explanation quality KW - interpretable machine learning KW - numerical forecasting ER - TY - CPAPER TI - Fostering active student engagement in flipped classroom teaching with social normative feedback AU - May, Maximilian AU - Hopf, Konstantin AU - Haag, Felix AU - Staake, Thorsten AU - Wortmann, Felix PY - 2026 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/112514 LA - eng AB - Abstract. Digital learning platforms have reshaped traditional education by enabling more flexible access to learning materials. Building on this foundation, the flipped classroom model facilitates independent knowledge acquisition while offering interactive support for knowledge application. However, students often struggle with timely completion of graded assignments and underutilize voluntary assignments, which impacts learning outcomes. This study examines the potential of social normative feedback in addressing these challenges. We conduct a randomized controlled trial (N = 140) in a Bachelor’s course, providing students with social normative feedback on correct assignment completion. Our findings indicate that the intervention reduced late submissions of graded assignments by 8.4 percentage points (18.5 %), which correlates with higher performance. However, the intervention did not yield significant effects on engagement with voluntary assignments, leaving room for future research. This study contributes to digital interventions in education, offering insights into how behavioral interventions can optimize student participation in flipped classrooms. KW - Flipped Classroom, KW - Social Normative Feedback KW - Self Regulated Learning KW - Digital Interventions ER - TY - JOUR TI - Validating Explainer Methods : A Functionally Grounded Approach for Numerical Forecasting AU - Haag, Felix AU - Hopf, Konstantin AU - Staake, Thorsten PY - 2026 JO - Journal of Forecasting VL - 45 IS - 2 SP - 819-836 PB - Wiley Interscience CY - New York, NY SN - 0277-6693 DO - 10.1002/for.70060 UR - https://fis.uni-bamberg.de/handle/uniba/112074 LA - eng AB - Forecasting systems have a long tradition in providing outputs accompanied by explanations. While the vast majority of such explanations relies on inherently interpretable linear statistical models, research has put forth eXplainable Artificial Intelligence (XAI) methods to improve the comprehensibility of nonlinear machine learning models. As explanations related to forecasts constitute important building blocks in forecasting systems, the validation of explainer methods is an essential part of system selection, parameterization, and adoption. Current research on explainer method assessment focuses on metrics for classification rather than numerical forecasting and predominantly assesses explanation quality within time-consuming, costly, and subjective studies involving humans. Given that the functional validation of explanations is of core interest to research on forecasting, our paper makes three contributions: First, we establish an approach for functionally grounded validations of explainer methods for numerical forecasting. Second, we propose computational rules for the metrics consistency, stability, and faithfulness. Third, we demonstrate our approach for the forecasting case of electricity demand estimation for energy benchmarks and compare a linear statistical approach with the state-of-the-art XAI methods SHapley Additive exPlanations (SHAP), Local Interpretable Model-agnostic Explanations (LIME), and Explainable Boosting Machine (EBM). Our work allows research and practice to validate and compare the quality of explainer methods on a functionally grounded level. KW - explainable artificial intelligence KW - explainer method validation KW - explanation quality KW - interpretable machine learning KW - numerical forecasting ER - TY - CPAPER TI - Fostering active student engagement in flipped classroom teaching with social normative feedback AU - May, Maximilian AU - Hopf, Konstantin AU - Haag, Felix AU - Staake, Thorsten AU - Wortmann, Felix PY - 2025 T2 - Wirtschaftsinformatik 2025 Proceedings PB - AISel UR - https://fis.uni-bamberg.de/handle/uniba/112880 LA - eng AB - Abstract. Digital learning platforms have reshaped traditional education by enabling more flexible access to learning materials. Building on this foundation, the flipped classroom model facilitates independent knowledge acquisition while offering interactive support for knowledge application. However, students often struggle with timely completion of graded assignments and underutilize voluntary assignments, which impacts learning outcomes. This study examines the potential of social normative feedback in addressing these challenges. We conduct a randomized controlled trial (N = 140) in a Bachelor’s course, providing students with social normative feedback on correct assignment completion. Our findings indicate that the intervention reduced late submissions of graded assignments by 8.4 percentage points (18.5 %), which correlates with higher performance. However, the intervention did not yield significant effects on engagement with voluntary assignments, leaving room for future research. This study contributes to digital interventions in education, offering insights into how behavioral interventions can optimize student participation in flipped classrooms. KW - Flipped Classroom, KW - Social Normative Feedback KW - Self Regulated Learning KW - Digital Interventions ER - TY - CHAP TI - A feedback component that leverages counterfactual explanations for smart learning support AU - Günther, Sebastian A. AU - Haag, Felix AU - Hopf, Konstantin AU - Handschuh, Philipp AU - Klose, Maria AU - Staake, Thorsten PY - 2025 SP - 285-291 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/112236 LA - eng AB - The growing prevalence of digital learning in higher education is accompanied by challenges regarding students’ self-regulated learning. While there is a plethora of behavioral interventions that aim at supporting students’ self-regulated learning, they often do not consider the heterogeneity of students in their intervention design. This paper presents a novel feedback intervention that leverages the potential of machine learning and counterfactual explanations for providing personalized feedback to support students’ learning. Ultimately, this approach could automatically adapt to different courses and thereby empower scalable and effective feedback. KW - Learning analytics KW - Explainable artificial intelligence KW - Counterfactual explanations KW - Feedback intervention KW - Experiment KW - Self-regulated learning ER - TY - CPAPER TI - Addressing Learners’ Heterogeneity in Higher Education : An Explainable AI-Based Feedback Artifact for Digital Learning Environments AU - Haag, Felix AU - Günther, Sebastian AU - Hopf, Konstantin AU - Handschuh, Philipp AU - Klose, Maria AU - Staake, Thorsten PY - 2025 T2 - Transforming the Digitally Sustainable Enterprise : Proceedings of the 18th International Conference on Wirtschaftsinformatik, Paderborn, Germany, 2023 SP - 511-527 PB - Springer Nature Switzerland CY - Cham SN - 978-3-031-80124-2 DO - 10.1007/978-3-031-80125-9_30 UR - https://fis.uni-bamberg.de/handle/uniba/110516 LA - eng ER - TY - CPAPER TI - Electricity Demand Forecasting in Future Grid States : A Digital Twin-Based Simulation Study AU - Bayer, Daniel R. AU - Haag, Felix AU - Pruckner, Marco AU - Hopf, Konstantin PY - 2024 SP - 1-6 PB - IEEE DO - 10.23919/splitech61897.2024.10612563 UR - https://fis.uni-bamberg.de/handle/uniba/97289 LA - eng ER - TY - CPAPER TI - Overcoming Anchoring Bias : the Potential of AI and XAI-based Decision Support AU - Haag, Felix AU - Stingl, Carlo AU - Zerfass, Katrin AU - Hopf, Konstantin AU - Staake, Thorsten PY - 2024 SP - 1-17 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-91986 UR - https://fis.uni-bamberg.de/handle/uniba/91986 LA - eng AB - Information systems (IS) are frequently designed to leverage the negative effect of anchoring bias to influence individuals’ decision-making (e.g., by manipulating purchase decisions). Recent advances in Artificial Intelligence (AI) and the explanations of its decisions through explainable AI (XAI) have opened new opportunities for mitigating biased decisions. So far, the potential of these technological advances to overcome anchoring bias remains widely unclear. To this end, we conducted two online experiments with a total of N=390 participants in the context of purchase decisions to examine the impact of AI and XAI-based decision support on anchoring bias. Our results show that AI alone and its combination with XAI help to mitigate the negative effect of anchoring bias. Ultimately, our findings have implications for the design of AI and XAI-based decision support and IS to overcome cognitive biases. KW - Artificial Intelligence (AI) KW - Explainable AI (XAI) KW - Decision Support KW - Anchoring Bias KW - Cognitive Bias ER - TY - CHAP TI - A feedback component that leverages counterfactual explanations for smart learning support AU - Günther, Sebastian A. AU - Haag, Felix AU - Hopf, Konstantin AU - Handschuh, Philipp AU - Klose, Maria AU - Staake, Thorsten Robert PY - 2023 T2 - Digitale Kulturen der Lehre entwickeln : Rahmenbedingungen, Konzepte und Werkzeuge SP - 285-291 PB - Springer VS CY - Wiesbaden, Germany SN - 978-3-658-43378-9 DO - 10.1007/978-3-658-43379-6_19 UR - https://fis.uni-bamberg.de/handle/uniba/105946 LA - eng AB - The growing prevalence of digital learning in higher education is accompanied by challenges regarding students’ self-regulated learning. While there is a plethora of behavioral interventions that aim at supporting students’ self-regulated learning, they often do not consider the heterogeneity of students in their intervention design. This paper presents a novel feedback intervention that leverages the potential of machine learning and counterfactual explanations for providing personalized feedback to support students’ learning. Ultimately, this approach could automatically adapt to different courses and thereby empower scalable and effective feedback. KW - Learning analytics KW - Explainable artificial intelligence KW - Counterfactual explanations KW - Feedback intervention KW - Experiment KW - Self-regulated learning ER - TY - CPAPER TI - Overcoming Anchoring Bias : the Potential of AI and XAI-based Decision Support AU - Haag, Felix AU - Stingl, Carlo AU - Zerfass, Katrin AU - Hopf, Konstantin AU - Staake, Thorsten PY - 2023 T2 - ICIS 2023 Proceedings SP - 1-17 PB - AISeL CY - New York UR - https://fis.uni-bamberg.de/handle/uniba/95220 LA - eng AB - Information systems (IS) are frequently designed to leverage the negative effect of anchoring bias to influence individuals’ decision-making (e.g., by manipulating purchase decisions). Recent advances in Artificial Intelligence (AI) and the explanations of its decisions through explainable AI (XAI) have opened new opportunities for mitigating biased decisions. So far, the potential of these technological advances to overcome anchoring bias remains widely unclear. To this end, we conducted two online experiments with a total of N=390 participants in the context of purchase decisions to examine the impact of AI and XAI-based decision support on anchoring bias. Our results show that AI alone and its combination with XAI help to mitigate the negative effect of anchoring bias. Ultimately, our findings have implications for the design of AI and XAI-based decision support and IS to overcome cognitive biases. KW - Artificial Intelligence (AI) KW - Explainable AI (XAI) KW - Decision Support KW - Anchoring Bias KW - Cognitive Bias ER - TY - CPAPER TI - Addressing Learners' Heterogeneity in Higher Education : an Explainable AI-based Feedback Artifact for Digital Learning Environments AU - Haag, Felix AU - Günther, Sebastian AU - Hopf, Konstantin AU - Handschuh, Philipp AU - Klose, Maria AU - Staake, Thorsten Robert PY - 2023 T2 - Proceedings of the 18th Internationale Tagung Wirtschaftsinformatik PB - AISeL CY - AIS electronic library UR - https://fis.uni-bamberg.de/handle/uniba/92292 LA - eng ER - TY - CPAPER TI - Short-Term Electricity Load Forecasting Using the Temporal Fusion Transformer : Effect of Grid Hierarchies and Data Sources AU - Giacomazzi, Elena AU - Haag, Felix AU - Hopf, Konstantin PY - 2023 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/89942 LA - eng AB - Recent developments related to the energy transition pose particular challenges for distribution grids. Hence, precise load forecasts become more and more important for efective grid management. Novel modeling approaches such as the Transformer architecture, in particular the Temporal Fusion Transformer (TFT), have emerged as promising methods for time series forecasting. To date, just a handful of studies apply TFTs to electricity load forecasting problems, mostly considering only single datasets and a few covariates. Therefore, we examine the potential of the TFT architecture for hourly short-term load forecasting across diferent time horizons (day-ahead and week-ahead) and network levels (grid and substation level). We fnd that the TFT architecture does not offer higher predictive performance than a state-of-the-art LSTM model for day-ahead forecasting on the entire grid. However, the results display signifcant improvements for the TFT when applied at the substation level with a subsequent aggregation to the upper grid-level, resulting in a prediction error of 2.43% (MAPE) for the best-performing scenario. In addition, the TFT appears to ofer remarkable improvements over the LSTM approach for week-ahead forecasting (yielding a predictive error of 2.52% (MAPE) at the lowest). We outline avenues for future research using the TFT approach for load forecasting, including the exploration of various grid levels (e.g., grid, substation, and household level). KW - Short-Term Load Forecasting KW - Artifcial Neural Networks KW - Temporal Fusion Transformer (TFT) KW - Long-Term Short-Term Memory (LSTM) ER - TY - CPAPER TI - Short-Term Electricity Load Forecasting Using the Temporal Fusion Transformer : Effect of Grid Hierarchies and Data Sources AU - Giacomazzi, Elena AU - Haag, Felix AU - Hopf, Konstantin PY - 2023 T2 - Proceedings of the 14th ACM International Conference on Future Energy Systems SP - 353–360 PB - ACM CY - New York SN - 979-8-4007-0032-3 DO - 10.1145/3575813.3597345 UR - https://fis.uni-bamberg.de/handle/uniba/89923 LA - eng AB - Recent developments related to the energy transition pose particular challenges for distribution grids. Hence, precise load forecasts become more and more important for efective grid management. Novel modeling approaches such as the Transformer architecture, in particular the Temporal Fusion Transformer (TFT), have emerged as promising methods for time series forecasting. To date, just a handful of studies apply TFTs to electricity load forecasting problems, mostly considering only single datasets and a few covariates. Therefore, we examine the potential of the TFT architecture for hourly short-term load forecasting across diferent time horizons (day-ahead and week-ahead) and network levels (grid and substation level). We fnd that the TFT architecture does not offer higher predictive performance than a state-of-the-art LSTM model for day-ahead forecasting on the entire grid. However, the results display signifcant improvements for the TFT when applied at the substation level with a subsequent aggregation to the upper grid-level, resulting in a prediction error of 2.43% (MAPE) for the best-performing scenario. In addition, the TFT appears to ofer remarkable improvements over the LSTM approach for week-ahead forecasting (yielding a predictive error of 2.52% (MAPE) at the lowest). We outline avenues for future research using the TFT approach for load forecasting, including the exploration of various grid levels (e.g., grid, substation, and household level). KW - Short-Term Load Forecasting KW - Artifcial Neural Networks KW - Temporal Fusion Transformer (TFT) KW - Long-Term Short-Term Memory (LSTM) ER - TY - CPAPER TI - Augmented Cross-Selling Through Explainable AI : a Case From Energy Retailing AU - Haag, Felix AU - Hopf, Konstantin AU - Menelau Vasconcelos, Pedro AU - Staake, Thorsten PY - 2022 SP - 1-19 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/54308 LA - eng AB - The advance of Machine Learning (ML) has led to a strong interest in this technology to support decision making. While complex ML models provide predictions that are often more accurate than those of traditional tools, such models often hide the reasoning behind the prediction from their users, which can lead to lower adoption and lack of insight. Motivated by this tension, research has put forth Explainable Artificial Intelligence (XAI) techniques that uncover patterns discovered by ML. Despite the high hopes in both ML and XAI, there is little empirical evidence of the benefits to traditional businesses. To this end, we analyze data on 220,185 customers of an energy retailer, predict cross-purchases with up to 86% correctness (AUC), and show that the XAI method SHAP provides explanations that hold for actual buyers. We further outline implications for research in information systems, XAI, and relationship marketing. KW - Cross-Selling KW - Energy Retailing KW - Explainable Artificial Intelligence KW - Machine Learning KW - Relationship Marketing KW - Task Augmentation ER - TY - CPAPER TI - Augmented Cross-Selling Through Explainable AI : a Case From Energy Retailing AU - Haag, Felix AU - Hopf, Konstantin AU - Menelau Vasconcelos, Pedro AU - Staake, Thorsten PY - 2022 T2 - ECIS 2022 Proceedings SP - 1-19 PB - AISeL UR - https://fis.uni-bamberg.de/handle/uniba/54316 LA - eng AB - The advance of Machine Learning (ML) has led to a strong interest in this technology to support decision making. While complex ML models provide predictions that are often more accurate than those of traditional tools, such models often hide the reasoning behind the prediction from their users, which can lead to lower adoption and lack of insight. Motivated by this tension, research has put forth Explainable Artificial Intelligence (XAI) techniques that uncover patterns discovered by ML. Despite the high hopes in both ML and XAI, there is little empirical evidence of the benefits to traditional businesses. To this end, we analyze data on 220,185 customers of an energy retailer, predict cross-purchases with up to 86% correctness (AUC), and show that the XAI method SHAP provides explanations that hold for actual buyers. We further outline implications for research in information systems, XAI, and relationship marketing. KW - Cross-Selling KW - Energy Retailing KW - Explainable Artificial Intelligence KW - Machine Learning KW - Relationship Marketing KW - Task Augmentation ER - TY - CPAPER TI - Explainable AI for Tailored Electricity Consumption Feedback : An Experimental Evaluation of Visualizations AU - Wastensteiner, Jacqueline AU - Weiss, Tobias M. AU - Haag, Felix AU - Hopf, Konstantin PY - 2021 T2 - ECIS 2021 Proceedings SP - 1-19 PB - Association for Information Systems (AIS) SN - 978-1-7336325-6-0 UR - https://fis.uni-bamberg.de/handle/uniba/53989 LA - eng AB - Machine learning (ML) methods can effectively analyse data, recognize patterns in them, and make high-quality predictions. Good predictions usually come along with “black-box” models that are unable to present the detected patterns in a human-readable way. Technical developments recently led to eXplainable Artificial Intelligence (XAI) techniques that aim to open such black-boxes and enable humans to gain new insights from detected patterns. We investigated the application of XAI in an area where specific insights can have a significant effect on consumer behaviour, namely electricity use. Knowing that specific feedback on individuals’ electricity consumption triggers resource conservation, we created five visualizations with ML and XAI methods from electricity consumption time series for highly personalized feedback, considering existing domain-specific design knowledge. Our experimental evaluation with 152 participants showed that humans can assimilate the pattern displayed by XAI visualizations, but such visualizations should follow known visualization patterns to be well-understood by users. KW - eXplainable Artificial Intelligence KW - Visualizations KW - Energy Conservation KW - Machine Learning KW - Feedback. ER - TY - CPAPER TI - Explainable AI for Tailored Electricity Consumption Feedback : An Experimental Evaluation of Visualizations AU - Wastensteiner, Jacqueline AU - Weiss, Tobias M. AU - Haag, Felix AU - Hopf, Konstantin PY - 2021 SP - 1-19 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-49912 UR - https://fis.uni-bamberg.de/handle/uniba/49912 LA - eng AB - Machine learning (ML) methods can effectively analyse data, recognize patterns in them, and make high-quality predictions. Good predictions usually come along with “black-box” models that are unable to present the detected patterns in a human-readable way. Technical developments recently led to eXplainable Artificial Intelligence (XAI) techniques that aim to open such black-boxes and enable humans to gain new insights from detected patterns. We investigated the application of XAI in an area where specific insights can have a significant effect on consumer behaviour, namely electricity use. Knowing that specific feedback on individuals’ electricity consumption triggers resource conservation, we created five visualizations with ML and XAI methods from electricity consumption time series for highly personalized feedback, considering existing domain-specific design knowledge. Our experimental evaluation with 152 participants showed that humans can assimilate the pattern displayed by XAI visualizations, but such visualizations should follow known visualization patterns to be well-understood by users. KW - eXplainable Artificial Intelligence KW - Visualizations KW - Energy Conservation KW - Machine Learning KW - Feedback. ER -