TY - THES TI - Not Just Pass or Fail : Examining Online Learning Behavior and Rethinking Success in Formal and Non-Formal Online Courses AU - Klose, Maria PY - 2026 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-113083 UR - https://fis.uni-bamberg.de/handle/uniba/113083 LA - eng AB - As online courses become an increasingly important part of the educational landscape and technological advancements continue to reshape how learning is delivered and experienced, research on how learners engage with and succeed in these environments is essential. This dissertation examines online learning behavior and success across formal and non-formal online courses covering three studies, each addressing different dimensions of learner engagement. Study 1 employs a meta-analytical approach to explore how course design characteristics influence the relationship between general online activity and learning outcomes in formal online courses. The findings highlight the complexity of digital learning environments and underscore the need for more fine-grained analyses of how specific digital tools are implemented and used. Study 2 investigates motivational trajectories in non-formal online courses, revealing a remarkable stability in intrinsic motivation and discussing the adequacy of traditional success metrics like course completion. Study 3 draws on this perspective, demonstrating that learners’ enrollment intentions and commitment to the course, rather than course design features, are key predictors of learners’ engagement with self-tests. Together, these studies challenge conventional definitions of learning success and emphasize the importance of aligning course designs with learners’ intentions. The findings suggest that effective online course design should go beyond merely providing digital tools and instead focus on fostering meaningful engagement through guidance, personalized interventions, and incentive structures. This dissertation advances a more nuanced, learner-centered understanding of online learning behavior and success in formal and non-formal online courses. KW - online learning KW - non-formal learning KW - formal learning KW - self-regulated learning KW - motivation ER - TY - JOUR TI - Embracing the challenge : Predicting self-testing in non-formal online courses using machine learning AU - Klose, Maria AU - Handschuh, Philipp AU - Steger, Diana AU - Artelt, Cordula PY - 2026 JO - Computers & education : an international journal VL - 242 IS - 105507 SP - 1-13 PB - Elsevier Science CY - Amsterdam [u.a.] SN - 1873-782X DO - 10.1016/j.compedu.2025.105507 UR - https://fis.uni-bamberg.de/handle/uniba/112131 LA - eng AB - Technology-driven advancements have made adaptive and interactive learning techniques more accessible. Online courses increasingly integrate self-tests that offer automated and immediate feedback. Self-tests can help learners to identify knowledge gaps and to reinforce their retention and comprehension. However, not all learners readily use self-tests, raising the question of which factors may impact learners' engagement with self-tests. The present study focused on non-formal education, covering 45 online courses offered by Bavarian universities. Analyses were based on a sample of N = 1261 participants aged 16–84 years. We used a machine learning approach to predict learners' engagement with self-tests and to identify important influencing factors. Therefore, we included 50 predictor variables in an elastic net regression to explore the role of learner- and course-related characteristics. The predictor variables were drawn from self-report, process, and meta data. Overall, learners differed substantially in their self-testing behavior. The prediction model explained 11 % of the variance in learners' engagement with self-tests. Despite the model's modest explanatory power, the analysis identified potentially relevant predictors. The two most important predictor variables were learner commitment and the intention to obtain a confirmation of participation. Accordingly, course designers might implement extrinsic incentives—such as confirmations of participation—as a potentially useful strategy to encourage learners' engagement with self-tests. From a methodological perspective, the study highlights the importance of using appropriate statistical methods—such as machine learning algorithms—to understand complex learning behaviors. KW - Online learning KW - Technology-enhanced learning KW - Lifelong learning KW - Self-testing KW - Machine learning ER - TY - JOUR TI - Not easy to get off track : Motivational trajectories of learners completing a non-formal online course AU - Klose, Maria AU - Handschuh, Philipp AU - Steger, Diana AU - Artelt, Cordula PY - 2024 SP - 1-13 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/96888 LA - eng AB - Non-formal learning is becoming increasingly important in everyday life. Both the availability of open online learning opportunities and the number of participants in online courses continue to grow. Initially learners report high levels of motivation, but completion rates tend to be low. In the present study, we examined motivational trajectories of learners completing a non-formal online course. To this end, 450 learners of 49 open online courses offered by Bavarian universities completed up to three online questionnaires throughout the course. First, we used latent profile analysis to explore motivational trajectories within five subtypes of situational motivation, which resulted in four different motivational profiles. However, all profiles were characterized by remarkable stability over time, and differences only in the actual levels of the five motivational subtypes. Second, we used bivariate latent change score models to focus on differences of change in intrinsic motivation when analyzing simultaneously with situational interest. In addition, we considered self-regulation and mastery goal orientation as predictors of change in motivation. For intrinsic motivation there was only a small mean change and compensating effect from T1 to T2. We discuss the findings in the light of the fact that there are high dropout rates in non-formal online courses and offer practical advice on how to better address non-completers in future research. KW - Non-formal learning KW - Online learning KW - Situational motivation KW - Motivational trajectories ER - TY - JOUR TI - Not easy to get off track : Motivational trajectories of learners completing a non-formal online course AU - Klose, Maria AU - Handschuh, Philipp AU - Steger, Diana AU - Artelt, Cordula PY - 2024 JO - Computers in Human Behavior VL - 159 IS - October 2024, 108322 SP - 1-13 PB - Elsevier Science CY - Amsterdam [u.a.] SN - 0747-5632 DO - 10.1016/j.chb.2024.108322 UR - https://fis.uni-bamberg.de/handle/uniba/95832 LA - eng AB - Non-formal learning is becoming increasingly important in everyday life. Both the availability of open online learning opportunities and the number of participants in online courses continue to grow. Initially learners report high levels of motivation, but completion rates tend to be low. In the present study, we examined motivational trajectories of learners completing a non-formal online course. To this end, 450 learners of 49 open online courses offered by Bavarian universities completed up to three online questionnaires throughout the course. First, we used latent profile analysis to explore motivational trajectories within five subtypes of situational motivation, which resulted in four different motivational profiles. However, all profiles were characterized by remarkable stability over time, and differences only in the actual levels of the five motivational subtypes. Second, we used bivariate latent change score models to focus on differences of change in intrinsic motivation when analyzing simultaneously with situational interest. In addition, we considered self-regulation and mastery goal orientation as predictors of change in motivation. For intrinsic motivation there was only a small mean change and compensating effect from T1 to T2. We discuss the findings in the light of the fact that there are high dropout rates in non-formal online courses and offer practical advice on how to better address non-completers in future research. KW - Non-formal learning KW - Online learning KW - Situational motivation KW - Motivational trajectories ER - TY - CHAP TI - A feedback component that leverages counterfactual explanations for smart learning support AU - Günther, Sebastian A. AU - Haag, Felix AU - Hopf, Konstantin AU - Handschuh, Philipp AU - Klose, Maria AU - Staake, Thorsten Robert PY - 2023 T2 - Digitale Kulturen der Lehre entwickeln : Rahmenbedingungen, Konzepte und Werkzeuge SP - 285-291 PB - Springer VS CY - Wiesbaden, Germany SN - 978-3-658-43378-9 DO - 10.1007/978-3-658-43379-6_19 UR - https://fis.uni-bamberg.de/handle/uniba/105946 LA - eng AB - The growing prevalence of digital learning in higher education is accompanied by challenges regarding students’ self-regulated learning. While there is a plethora of behavioral interventions that aim at supporting students’ self-regulated learning, they often do not consider the heterogeneity of students in their intervention design. This paper presents a novel feedback intervention that leverages the potential of machine learning and counterfactual explanations for providing personalized feedback to support students’ learning. Ultimately, this approach could automatically adapt to different courses and thereby empower scalable and effective feedback. KW - Learning analytics KW - Explainable artificial intelligence KW - Counterfactual explanations KW - Feedback intervention KW - Experiment KW - Self-regulated learning ER - TY - CPAPER TI - Addressing Learners' Heterogeneity in Higher Education : an Explainable AI-based Feedback Artifact for Digital Learning Environments AU - Haag, Felix AU - Günther, Sebastian AU - Hopf, Konstantin AU - Handschuh, Philipp AU - Klose, Maria AU - Staake, Thorsten Robert PY - 2023 T2 - Proceedings of the 18th Internationale Tagung Wirtschaftsinformatik PB - AISeL CY - AIS electronic library UR - https://fis.uni-bamberg.de/handle/uniba/92292 LA - eng ER -