TY - THES TI - Disengaged Responding in Educational Large-Scale Assessments : New Insights into its Identification, Modeling, and Consequences AU - Welling, Jana PY - 2026 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-116761 UR - https://fis.uni-bamberg.de/handle/uniba/116761 LA - eng AB - Educational large-scale assessments (LSAs) provide information on competencies across cohorts, populations, and test domains. However, when examinees lack test-taking motivation, they can respond to test items without investing their best effort, knowledge, and abilities, a behavior called disengaged responding. Because disengaged responses do not reflect the proficiency of the examinees, these responses can pose a threat to the validity of assessment outcomes. To ensure the interpretability of findings from LSAs, disengaged responding needs to be accurately identified and accounted for in the measurement of competencies. Moreover, it is important to understand in which contexts disengaged responding arises and which consequences it entails. Therefore, this dissertation includes three articles that addressed major, yet unresolved issues in the context of disengaged responding concerning its identification (Article 1), accounting for it in the measurement of competencies (Article 2), and the generalizability of established findings to child samples (Article 3). Most approaches to identifying disengaged responding rely solely on item responses and response times, thereby risking the misclassification of fast engaged or slow disengaged responses. Article 1 aimed to improve the classification accuracy of response-time based identification methods by introducing and evaluating three novel process data indicators of disengaged responding in reading comprehension tasks: text reread, item revisit, and answer change. Findings from an empirical study suggest that the improvement in classification accuracy was marginal to non-existent, thereby confirming response times as an important indicator of disengagement. Although many LSAs provide proficiency estimates as plausible values, no study has yet investigated how disengagement should be accounted for in their estimation. Article 2 addressed this gap by proposing and evaluating different approaches to (not) accounting for disengaged responding in the estimation of plausible values. A simulation study demonstrated that achievement gaps estimated with plausible values can be biased by disengaged responding. While models that accounted for disengagement in the measurement model effectively reduced these biases, models accounting for it solely in the population model did not. An additional empirical study found no difference between the models, supporting recent studies which claim that the impact of disengaged responding on achievement gaps may be negligible in practice. Most empirical findings on disengaged responding are based on adolescent or adult samples, ignoring the fact that many LSAs also include child samples. Article 3 challenged the generalizability of established findings on disengaged responding to child samples by providing theoretical considerations on why the test-taking behavior of children may differ from that of older examinees. Additionally, the findings from an empirical study supported recent research indicating that disengaged responding may be less common among children. Only proficiency could be replicated as predictor of disengaged responding, while gender and socio-economic status could not. Further results suggested that the impact of disengaged responding on achievement gaps may be limited in this age group. Taken together, this dissertation combines theoretical, methodological, and empirical approaches to improve our understanding of disengaged responding and the validity of LSAs. The central findings bear important implications for the identification, modeling, and consequences of disengaged responding. First, they support response-time based measures as strong indicators of disengagement while suggesting that process data may not always provide sufficient information on test-taking engagement to inform new identification methods. Second, they highlight the need to accurately account for disengaged responding also in plausible value estimation. Third, this dissertation suggests that and discusses why the threat (rapid) disengagement poses to the validity of group-based assessment outcomes may be less pronounced than often assumed. Fourth, it challenges the generalizability of established findings to child samples. By laying conceptual and methodological groundwork, this dissertation provides a foundation for future research aimed at developing more robust, valid, and context-sensitive approaches to measuring competencies in educational LSAs. KW - disengaged responding KW - rapid guessing KW - test-taking engagement KW - test-taking behavior KW - large-scale assessments KW - process data ER - TY - JOUR TI - Participation rates, characteristics, and differential effects on reading literacy of extracurricular tutoring in a German large-scale assessment AU - Heyne, Nora AU - Gnambs, Timo AU - Sengewald, Marie-Ann PY - 2026 SP - 1-26 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/115127 LA - eng AB - Because large‑scale studies repeatedly indicated low reading literacy for many students, a need for interventions fostering reading literacy, such as extracurricular tutoring, has often been emphasized. Several reading promoting programs, suitable for extracurricular tutoring, were developed and shown to be efective in recent years. Moreover, these studies and analyses of extracurricular activities and tutoring yielded fndings on learning‑supporting characteristics and efects on students’ achievement of such extracurricular ofers. Nevertheless, little is known to date about the implementation of extracurricular tutoring in practice in Germany, particularly about its participation rates, characteristics, and efects on students` reading literacy. Thus, the present study investigated participation rates of extracurricular tutoring in reading and in German among students in general and among various subgroups between Grades 5 and 7. Furthermore, the study examined general and subject‑specifc characteristics and efects of extracurricular tutoring on reading literacy. The analyses used a sample of students (N = 5113) of the National Educational Panel Study in Germany. In addition to descriptive analyses of characteristics and participation rates of extracurricular tutoring, efect sizes were calculated for comparing participation rates of subgroups of students. Furthermore, multi‑group structural equation models were implemented to investigate average and diferential efects of extracurricular tutoring, while controlling for initial reading literacy and other covariates. The results indicate that mainly students with low reading literacy and therefore a strong need for support participated in extracurricular tutoring, but the general participation rate was low. The descriptive outcomes showed a heterogeneous picture of tutoring ofers and rare implementations of reading‑promoting methods. Moreover, the results revealed no signifcant efects of extracurricular tutoring on students’ reading literacy overall but suggested marginal diferences for students with a low initial reading literacy. For future studies, more detailed assessments of characteristics and methods of extracurricular tutoring are recommended, particularly, in large‑scale investigations on specifc tutoring methods for students with support needs which may lead to improved guidelines regarding promising implementations of evidence‑based reading promoting programs. ER - TY - THES TI - Not Just Pass or Fail : Examining Online Learning Behavior and Rethinking Success in Formal and Non-Formal Online Courses AU - Klose, Maria PY - 2026 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-113083 UR - https://fis.uni-bamberg.de/handle/uniba/113083 LA - eng AB - As online courses become an increasingly important part of the educational landscape and technological advancements continue to reshape how learning is delivered and experienced, research on how learners engage with and succeed in these environments is essential. This dissertation examines online learning behavior and success across formal and non-formal online courses covering three studies, each addressing different dimensions of learner engagement. Study 1 employs a meta-analytical approach to explore how course design characteristics influence the relationship between general online activity and learning outcomes in formal online courses. The findings highlight the complexity of digital learning environments and underscore the need for more fine-grained analyses of how specific digital tools are implemented and used. Study 2 investigates motivational trajectories in non-formal online courses, revealing a remarkable stability in intrinsic motivation and discussing the adequacy of traditional success metrics like course completion. Study 3 draws on this perspective, demonstrating that learners’ enrollment intentions and commitment to the course, rather than course design features, are key predictors of learners’ engagement with self-tests. Together, these studies challenge conventional definitions of learning success and emphasize the importance of aligning course designs with learners’ intentions. The findings suggest that effective online course design should go beyond merely providing digital tools and instead focus on fostering meaningful engagement through guidance, personalized interventions, and incentive structures. This dissertation advances a more nuanced, learner-centered understanding of online learning behavior and success in formal and non-formal online courses. KW - online learning KW - non-formal learning KW - formal learning KW - self-regulated learning KW - motivation ER - TY - CHAP TI - Messen und Bewerten von Lernergebnissen AU - Worbach, Marc AU - Drechsel, Barbara AU - Carstensen, Claus H. PY - 2025 T2 - Psychologie für den Lehrberuf SP - 611-635 PB - Springer CY - Berlin, Germany ET - 2. Auflage SN - 978-3-662-69556-2 DO - 10.1007/978-3-662-69557-9_29 UR - https://fis.uni-bamberg.de/handle/uniba/117108 LA - deu ER - TY - CHAP TI - Zertifikatsarmut gleich Kompetenzarmut? : Das Analysepotential des Nationalen Bildungspanels bei Fragen der Bildungsarmut AU - Blossfeld, Pia N. AU - Carstensen, Claus H. AU - Maurice, Jutta von PY - 2025 T2 - Handbuch Bildungsarmut SP - 1-19 PB - Springer Fachmedien Wiesbaden CY - Wiesbaden SN - 9783658446987 DO - 10.1007/978-3-658-44698-7_11-1 UR - https://fis.uni-bamberg.de/handle/uniba/116794 LA - deu ER - TY - JOUR TI - How the home learning environment contributes to children’s early science knowledge : Associations with parental characteristics and science-related activities AU - Junge, Katharina AU - Schmerse, Daniel AU - Lankes, Eva-Maria AU - Carstensen, Claus H. AU - Steffensky, Mirjam PY - 2025 SP - 294-305 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/109579 LA - eng AB - Parents play a pivotal role in introducing their children to science, but little is known about the nature of an early science-related home learning environment. This study examines different aspects of the home learning environment and their associations with children's science knowledge. Mediation analyses of a sample of 257 five-year-old preschool children and their parents show that (1) parental engagement in science-related learning activities with their children is associated with children's science knowledge, (2) structural family characteristics as well as parental interest in science are associated with the frequency of these activities, and (3) associations of structural family characteristics and parental interest in science with children's knowledge are mediated by science-related activities. The results emphasize the important role of parents in children's early science education. KW - Home learning environment KW - Preschool children KW - Early science education KW - Mediation analysis ER - TY - JOUR TI - Separating PIAAC competencies from general cognitive skills : A dimensionality and explanatory analysis AU - Engelhardt, Lena AU - Goldhammer, Frank AU - Lüdtke, Oliver AU - Köller, Olaf AU - Baumert, Jürgen AU - Carstensen, Claus H. PY - 2025 SP - 1-9 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/110767 LA - eng AB - This study aims to investigate how test scores from PIAAC (Programme for the International Assessment of Adult Competencies) can be interpreted, by comparing the PIAAC competencies literacy and numeracy to reasoning and perceptual speed. Dimensionality analyses supported, that the PIAAC competencies can be separated into a common factor overlapping with reasoning and perceptual speed, and domain-specific factors. For the common and specific factors, relations to other variables were analyzed. The nested factor for PIAAC literacy was as expected unrelated to age, positively related to learning opportunities during one’s lifetime, and positively related to literacy skill use. The nested factor for PIAAC numeracy was also as expected unrelated to age, against expectation unrelated to learning opportunities during one’s lifetime, and as expected positively related to numeracy skill use. Results support the validity of the intended test score interpretation for PIAAC literacy, while results for PIAAC numeracy were less clear. KW - PIAAC literacy KW - PIAAC numeracy KW - General cognitive skills KW - Validity KW - Large-scale assessments ER - TY - CHAP TI - A feedback component that leverages counterfactual explanations for smart learning support AU - Günther, Sebastian A. AU - Haag, Felix AU - Hopf, Konstantin AU - Handschuh, Philipp AU - Klose, Maria AU - Staake, Thorsten PY - 2025 SP - 285-291 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/112236 LA - eng AB - The growing prevalence of digital learning in higher education is accompanied by challenges regarding students’ self-regulated learning. While there is a plethora of behavioral interventions that aim at supporting students’ self-regulated learning, they often do not consider the heterogeneity of students in their intervention design. This paper presents a novel feedback intervention that leverages the potential of machine learning and counterfactual explanations for providing personalized feedback to support students’ learning. Ultimately, this approach could automatically adapt to different courses and thereby empower scalable and effective feedback. KW - Learning analytics KW - Explainable artificial intelligence KW - Counterfactual explanations KW - Feedback intervention KW - Experiment KW - Self-regulated learning ER - TY - GEN TI - Active Inference in String Diagrams : A Categorical Account of Predictive Processing and Free Energy AU - Tull, Sean AU - Kleiner, Johannes AU - Smithe, Toby St Clere PY - 2025 SP - 1-41 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/112054 LA - eng AB - We present a categorical formulation of the cognitive frameworks of Predictive Processing and Active Inference, expressed in terms of string diagrams interpreted in a monoidal category with copying and discarding. This includes diagrammatic accounts of generative models, Bayesian updating, perception, planning, active inference, and free energy. In particular we present a diagrammatic derivation of the formula for active inference via free energy minimisation, and establish a compositionality property for free energy, allowing free energy to be applied at all levels of an agent's generative model. Aside from aiming to provide a helpful graphical language for those familiar with active inference, we conversely hope that this article may provide a concise formulation and introduction to the framework. KW - String Diagrams ER - TY - JOUR TI - Towards a structural turn in consciousness science AU - Kleiner, Johannes PY - 2025 SP - 1-17 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/109957 LA - eng AB - Recent activities in virtually all fields engaged in consciousness studies indicate early signs of a structural turn, where verbal descriptions or simple formalisations of conscious experiences are replaced by structural tools, most notably mathematical spaces. My goal here is to offer three comments that, in my opinion, are essential to avoid misunderstandings in these developments early on. These comments concern metaphysical premises of structural approaches, the viability of structure-preserving mappings, and the question of what a structure of conscious experience is in the first place. I will also explain what, in my opinion, are the great promises of structural methodologies and how they might impact consciousness science at large. KW - Quality space KW - Qualia space KW - Phenomenal space KW - Theory of consciousness KW - Structuralism KW - Structure-preserving mapping KW - Isomorphism ER - TY - GEN TI - Defining Biological Naturalism AU - Kleiner, Johannes PY - 2025 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-109961 UR - https://fis.uni-bamberg.de/handle/uniba/109961 LA - eng AB - Biological naturalism, as explicated by Seth, is indispensable for a balanced and metaphysically neutral science of AI consciousness. However, most of the properties that Seth explores might not be unique to living systems. Therefore, I argue, a biological naturalist research programme in consciousness science requires an explicit definition of Biological Naturalism. I discuss how such a definition might be obtained. KW - Biological Naturalism KW - Computational Functionalism ER - TY - GEN TI - Mathematical Approaches in the Scientific Study of Consciousness AU - Kleiner, Johannes PY - 2025 SP - 1-41 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-109959 UR - https://fis.uni-bamberg.de/handle/uniba/109959 LA - eng AB - Mathematical Approaches in the Scientific Study of Consciousness KW - Mathematical Consciousness Science KW - Consciousness Science ER - TY - GEN TI - On the Logic of Measuring Neural Correlates of Consciousness AU - Kleiner, Johannes PY - 2025 SP - 1-50 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/109960 LA - eng AB - This paper presents a mathematical analysis of the logic of measuring Neural Correlates of Consciousness (NCCs). Starting from the canonical definition of NCCs provided by Crick and Koch (1990) and Chalmers (2000), a series of lemmas and theorems are provided which show how NCCs can be discovered if empirical data about the co-activation of neural states and states of consciousness is available. The result of this analysis is a new method to measure NCCs, which we preliminarily call Co-Activation Analysis (CoAA), that might complement or extend existing methods such as contrastive analysis and decoding. CoAA might be of interest for experiments because it does not require data from near-threshold conditions, is compatible with all major conceptions of states of consciousness (including, e.g., micro-phenomenological notions and global states of consciousness), can be applied to most conceptions of neural or computational states (including, e.g., those provided by Predictive Processing/Active Inference, or those attained in more ecological conditions), and helps alleviate the problem of confounders. Furthermore, we show as a theorem that as far as the logic of measurement is concerned, if applied to data from contrastive analysis studies, CoAA improves upon the result provided by contrastive analysis. The paper is a purely theoretical contribution. It is presented in the hope that the mathematics developed here can support and improve the empirical search for NCCs. KW - Neural Correlates of Consciousness KW - Contrastive Analysis ER - TY - GEN TI - The Newman Problem of Consciousness Science AU - Kleiner, Johannes PY - 2025 SP - 1-17 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/109958 LA - eng AB - The Newman problem is a fundamental problem that threatens to undermine structural assumptions and structural theories throughout philosophy and science. Here, we consider the problem in the context of consciousness science. We introduce and discuss the problem, and explain why it is detrimental not only to structuralist assumptions, but also to theories of consciousness, if left unconsidered. However, we show that if phenomenal spaces, and mathematical structures of conscious experience more generally, are understood in the right way, the Newman problem does not arise. The upshot of our paper is that consciousness science needs to be careful in which definition of structure to consider, but if it is, the Newman problem disappears. KW - Newman Problem KW - Consciousness Science KW - Theories of Consciousness KW - Epistemic Phenomenal Structural Realism KW - Ontic Phenomenal Structural Realism ER - TY - JOUR TI - Causal Fermion Systems as an Effective Collapse Theory AU - Finster, Felix AU - Kleiner, Johannes AU - Paganini, Claudio F. PY - 2025 SP - 1-38 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/109954 LA - eng AB - It is shown that, in the non-relativistic limit, causal fermion systems give rise to an effective collapse theory. The nonlinear and stochastic correction terms to the Schrödinger equation are derived from the causal action principle. The dynamics of the statistical operator is described by a deterministic equation of Kossakowski-Lindblad form. Moreover, the quantum state undergoes a dynamical collapse compatible with the Born rule. The effective model has similarities with the continuous spontaneous localization model, but differs from it by a conservation law for the probability integral as well as a non-locality in time on a microscopic length scale \ell_{\min}. KW - Causal fermion systems KW - effective collapse theory ER - TY - JOUR TI - The case for neurons : a no-go theorem for consciousness on a chip AU - Kleiner, Johannes AU - Ludwig, Tim PY - 2025 SP - 1-11 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/109956 LA - eng AB - We apply the methodology of no-go theorems as developed in physics to the question of artificial consciousness. The result is a no-go theorem which shows that under a general assumption, called dynamical relevance, Artificial Intelligence (AI) systems that run on contemporary computer chips cannot be conscious. Consciousness is dynamically relevant, simply put, if, according to a theory of consciousness, it is relevant for the temporal evolution of a system’s states. The no-go theorem rests on facts about semiconductor development: that AI systems run on central processing units, graphics processing units, tensor processing units, or other processors which have been designed and verified to adhere to computational dynamics that systematically preclude or suppress deviations. Whether our result resolves the question of AI consciousness on contemporary processors depends on the truth of the theorem’s main assumption, dynamical relevance, which this paper does not establish. KW - Artificial Consciousness KW - Synthetic Phenomenology KW - Artificial Sentience KW - Machine Consciousness KW - No-Go Theorem KW - Artificial Intelligence KW - Large Language Model ER - TY - JOUR TI - What is a mathematical structure of conscious experience? AU - Kleiner, Johannes AU - Ludwig, Tim PY - 2025 SP - 1-23 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/109955 LA - eng AB - Several promising approaches have been developed to represent conscious experience in terms of mathematical spaces and structures. What is missing, however, is an explicit definition of what a ‘mathematical structure of conscious experience’ is. Here, we propose such a definition. This definition provides a link between the abstract formal entities of mathematics and the concreta of conscious experience; it complements recent approaches that study quality spaces, qualia spaces, or phenomenal spaces; and it provides a general method to identify and investigate structures of conscious experience. We hope that ultimately this work provides a basis for developing a common formal language to study consciousness KW - Quality spaces KW - qualia spaces KW - phenomenal spaces KW - perceptual spaces KW - Q-spaces KW - structuralism ER - TY - GEN TI - On the Logic of Measuring Neural Correlates of Consciousness AU - Kleiner, Johannes PY - 2025 SP - 1-50 PB - Center for Open Science DO - 10.31234/osf.io/p9ca3_v1 UR - https://fis.uni-bamberg.de/handle/uniba/110033 LA - eng AB - This paper presents a mathematical analysis of the logic of measuring Neural Correlates of Consciousness (NCCs). Starting from the canonical definition of NCCs provided by Crick and Koch (1990) and Chalmers (2000), a series of lemmas and theorems are provided which show how NCCs can be discovered if empirical data about the co-activation of neural states and states of consciousness is available. The result of this analysis is a new method to measure NCCs, which we preliminarily call Co-Activation Analysis (CoAA), that might complement or extend existing methods such as contrastive analysis and decoding. CoAA might be of interest for experiments because it does not require data from near-threshold conditions, is compatible with all major conceptions of states of consciousness (including, e.g., micro-phenomenological notions and global states of consciousness), can be applied to most conceptions of neural or computational states (including, e.g., those provided by Predictive Processing/Active Inference, or those attained in more ecological conditions), and helps alleviate the problem of confounders. Furthermore, we show as a theorem that as far as the logic of measurement is concerned, if applied to data from contrastive analysis studies, CoAA improves upon the result provided by contrastive analysis. The paper is a purely theoretical contribution. It is presented in the hope that the mathematics developed here can support and improve the empirical search for NCCs. KW - Neural Correlates of Consciousness KW - Contrastive Analysis ER - TY - THES TI - Topics in mathematical consciousness science AU - Kleiner, Johannes PY - 2025 SP - iv, 123 PB - Ludwig-Maximilians-Universität CY - München DO - 10.5282/edoc.35420 UR - https://fis.uni-bamberg.de/handle/uniba/110031 LA - eng ER - TY - JOUR TI - Learning Strategies as Moderators Between Motivation and Mathematics Performance in East Asian Students : Latent Class Analysis AU - Carstensen, Claus H. AU - Wu, Yi-Jhen AU - Kiefer, Sarah AU - Chen, Yi-Hsin PY - 2025 SP - 1-16 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/109578 LA - eng AB - This study applied a three-step latent class analysis (LCA) approach to explore latent classes of learning strategy use and their moderation effects on the relationships between motivation and mathematics performance. The data of 15-year-old students from five East Asian educational systems related to Chinese culture in the Programme of International Student Assessment (PISA) in 2012 were analyzed. The findings indicated that Shanghai, Singapore, Taiwan, and Macau showed three latent classes of learning strategies, whereas Hong Kong had two latent classes. Most students in the five educational systems reported to use the control strategy, some students reported the use of combined learning strategies, and few students reported the use of memorization except for students in Shanghai. Furthermore, we found the moderation effects of learning strategy use on mathematics performance depended on the types of motivation and educational systems. This study provides insights into the advantages of a three-step LCA approach in educational research. KW - person-centered approach KW - three-step latent class analysis KW - learning strategy use KW - motivation KW - mathematics performance KW - PISA ER - TY - JOUR TI - Attitudes, experiences, and usage intentions of artificial intelligence : A population study in Germany AU - Gnambs, Timo AU - Stein, Jan-Philipp AU - Zinn, Sabine AU - Griese, Florian AU - Appel, Markus PY - 2025 SP - 1-9 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/108018 LA - eng AB - Artificial intelligence (AI) increasingly affects individuals’ private and professional lives. Importantly, both the acceptance and adoption of new AI technologies in society is heavily impacted by the attitudes that people hold; yet, there is currently limited information on how people perceive and intend to use AI at the national and demographic levels. Therefore, this study examined a random sample of 1,098 German adults to assess their attitudes, experiences, and usage intentions regarding AI in work, healthcare, and education. The findings indicated that respondents generally held favorable attitudes towards AI, with AI applications in healthcare receiving more positive evaluations than AI in the context of work. Moreover, cognitive evaluations of AI were more positive than emotional or behavioral appraisals. Prior experiences with AI were, however, limited, particularly in healthcare and education. Demographic differences were generally small. Taken together, these findings demonstrate that, in Germany, AI is currently widely accepted in different domains, although most people have little first-hand experience with it. These insights can inform policymakers and stakeholders who care about the proliferation of AI in society. KW - Artificial intelligence KW - Attitudes KW - Experience KW - Germany KW - Social survey ER - TY - JOUR TI - Linking of Rasch-Scaled Tests : Consequences of Limited Item Pools and Model Misfit AU - Carstensen, Claus H. AU - Rohm, Theresa AU - Fischer, Luise AU - Gnambs, Timo PY - 2025 SP - 1-10 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/107665 LA - eng AB - In the context of item response theory (IRT), linking the scales of two measurement points is a prerequisite to examine a change in competence over time. In educational large-scale assessments, non-identical test forms sharing a number of anchor-items are frequently scaled and linked using two− or three-parametric item response models. However, if item pools are limited and/or sample sizes are small to medium, the sparser Rasch model is a suitable alternative regarding the precision of parameter estimation. As the Rasch model implies stricter assumptions about the response process, a violation of these assumptions may manifest as model misfit in form of item discrimination parameters empirically deviating from their fixed value of one. The present simulation study investigated the performance of four IRT linking methods— fixed parameter calibration, mean/mean linking, weighted mean/mean linking, and concurrent calibration—applied to Rasch-scaled data with a small item pool. Moreover, the number of anchor items required in the absence/presence of moderate model misfit was investigated in small to medium sample sizes. Effects on the link outcome were operationalized as bias, relative bias, and root mean square error of the estimated sample mean and variance of the latent variable. In the light of this limited context, concurrent calibration had substantial convergence issues, while the other methods resulted in an overall satisfying and similar parameter recovery—even in the presence of moderate model misfit. Our findings suggest that in case of model misfit, the share of anchor items should exceed 20% as is currently proposed in the literature. Future studies should further investigate the effects of anchor item composition regarding unbalanced model misfit. KW - Rasch model KW - item response theory KW - linking methods KW - model misfit KW - anchor-items design KW - limited item pools ER - TY - JOUR TI - The national educational panel study (NEPS) and methodological innovations in longitudinal large-scale assessments AU - Kutscher, Tanja AU - Sengewald, Marie-Ann AU - Gnambs, Timo AU - Carstensen, Claus H. AU - Aßmann, Christian PY - 2024 SP - 1-11 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/114863 LA - eng AB - This editorial introduces a special issue of Large-Scale Assessments in Education (LSAE) that addresses key challenges in analyzing longitudinal data from large-scale studies. These challenges include ensuring fair measurement across time, developing common metrics, and correcting for measurement errors. The special issue highlights recent methodological innovations, particularly for studies like the National Education Panel Study (NEPS), providing approaches for improving the accuracy and robustness of longitudinal educational research. The papers in this issue present advances in methods for estimating trends, incorporating background information, and analyzing longitudinal relationships between constructs. Innovative approaches such as Bayesian modeling for borrowing historical information, continuous-time models for capturing developmental trends, and plausible value estimation provide practical solutions for researchers working with complex longitudinal data. In addition, the issue presents new software tools that facilitate the implementation of these advanced methodologies. Together, these papers contribute to both the theory and practice of educational assessment and provide valuable insights for those working with longitudinal data in national and international panel studies. KW - longitudinal large-scale assessment KW - National Educational Panel Study KW - Bayesian historical borrowing KW - plausible value estimation KW - continuous-time models KW - educational trend analysis ER - TY - JOUR TI - The national educational panel study (NEPS) and methodological innovations in longitudinal large-scale assessments AU - Kutscher, Tanja AU - Sengewald, Marie-Ann AU - Gnambs, Timo AU - Carstensen, Claus H. AU - Aßmann, Christian PY - 2024 JO - Large-scale assessments in education VL - 12 IS - 31 SP - 1-11 PB - SpringerOpen CY - Berlin ; Heidelberg [u.a.] SN - 2196-0739 DO - 10.1186/s40536-024-00221-y UR - https://fis.uni-bamberg.de/handle/uniba/114571 LA - eng AB - This editorial introduces a special issue of Large-Scale Assessments in Education (LSAE) that addresses key challenges in analyzing longitudinal data from large-scale studies. These challenges include ensuring fair measurement across time, developing common metrics, and correcting for measurement errors. The special issue highlights recent methodological innovations, particularly for studies like the National Education Panel Study (NEPS), providing approaches for improving the accuracy and robustness of longitudinal educational research. The papers in this issue present advances in methods for estimating trends, incorporating background information, and analyzing longitudinal relationships between constructs. Innovative approaches such as Bayesian modeling for borrowing historical information, continuous-time models for capturing developmental trends, and plausible value estimation provide practical solutions for researchers working with complex longitudinal data. In addition, the issue presents new software tools that facilitate the implementation of these advanced methodologies. Together, these papers contribute to both the theory and practice of educational assessment and provide valuable insights for those working with longitudinal data in national and international panel studies. KW - longitudinal large-scale assessment KW - National Educational Panel Study KW - Bayesian historical borrowing KW - plausible value estimation KW - continuous-time models KW - educational trend analysis ER - TY - GEN TI - The Newman Problem of Consciousness Science AU - Kleiner, Johannes PY - 2024 SP - 1-17 PB - PhilArchive UR - https://fis.uni-bamberg.de/handle/uniba/110032 LA - eng AB - The Newman problem is a fundamental problem that threatens to undermine structural assumptions and structural theories throughout philosophy and science. Here, we consider the problem in the context of consciousness science. We introduce and discuss the problem, and explain why it is detrimental not only to structuralist assumptions, but also to theories of consciousness, if left unconsidered. However, we show that if phenomenal spaces, and mathematical structures of conscious experience more generally, are understood in the right way, the Newman problem does not arise. The upshot of our paper is that consciousness science needs to be careful in which definition of structure to consider, but if it is, the Newman problem disappears. KW - Newman Problem KW - Consciousness Science KW - Theories of Consciousness KW - Epistemic Phenomenal Structural Realism KW - Ontic Phenomenal Structural Realism ER - TY - JOUR TI - Reliability and Factorial Validity of the Core Self-Evaluations Scale : A Meta-Analytic Investigation of Wording Effects AU - Gnambs, Timo AU - Schroeders, Ulrich PY - 2024 SP - 343-359 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/105510 LA - eng AB - The Core Self-Evaluations Scale (CSES) measures a broad personality trait reflecting individuals’ self-appraisals of their worth, capabilities, and control of their lives. Although the CSES was designed to capture a single trait, factor analytic studies often found more complex measurement structures. These either referred to different content facets or methodological artifacts due to the item wording. The present random-effects meta-analysis summarized correlation matrices from 53 samples including 31,843 respondents. After accounting for acquiescent responding, meta-analytic confirmatory factor analyses revealed a single common factor for all items. The factor was highly reliable (ω = .87) and demonstrated partial metric measurement invariance across English, German, and Spanish language versions as well as cultural tendencies of individualism and flexibility. However, Chinese and Romanian translations exhibited substantially lower factor loadings. These results corroborate the use of the CSES as a unidimensional measure, albeit systematic investigations of measurement invariance are recommended before its use in cross-cultural research. KW - meta-analysis KW - structural equation modeling KW - wording effect KW - self-evaluation KW - cross-cultural psychology ER - TY - GEN TI - Consciousness qua Mortal Computation AU - Kleiner, Johannes PY - 2024 PB - arXiv DO - 10.48550/arxiv.2403.03925 UR - https://fis.uni-bamberg.de/handle/uniba/105586 LA - eng ER - TY - JOUR TI - What is a mathematical structure of conscious experience? AU - Kleiner, Johannes AU - Ludwig, Tim PY - 2024 JO - Synthese : an international journal for epistemology, methodology and philosophy of science VL - 203 IS - 3, 89 SP - 1-23 PB - Springer Science and Business Media LLC CY - Dordrecht [u.a.] SN - 1573-0964 DO - 10.1007/s11229-024-04503-4 UR - https://fis.uni-bamberg.de/handle/uniba/105585 LA - eng AB - Several promising approaches have been developed to represent conscious experience in terms of mathematical spaces and structures. What is missing, however, is an explicit definition of what a ‘mathematical structure of conscious experience’ is. Here, we propose such a definition. This definition provides a link between the abstract formal entities of mathematics and the concreta of conscious experience; it complements recent approaches that study quality spaces, qualia spaces, or phenomenal spaces; and it provides a general method to identify and investigate structures of conscious experience. We hope that ultimately this work provides a basis for developing a common formal language to study consciousness KW - Quality spaces KW - qualia spaces KW - phenomenal spaces KW - perceptual spaces KW - Q-spaces KW - structuralism ER - TY - JOUR TI - Towards a structural turn in consciousness science AU - Kleiner, Johannes PY - 2024 JO - Consciousness and cognition : an international journal VL - 119 IS - 103653 SP - 1-17 PB - Elsevier CY - Amsterdam [u.a.] SN - 1053-8100 DO - 10.1016/j.concog.2024.103653 UR - https://fis.uni-bamberg.de/handle/uniba/105584 LA - eng AB - Recent activities in virtually all fields engaged in consciousness studies indicate early signs of a structural turn, where verbal descriptions or simple formalisations of conscious experiences are replaced by structural tools, most notably mathematical spaces. My goal here is to offer three comments that, in my opinion, are essential to avoid misunderstandings in these developments early on. These comments concern metaphysical premises of structural approaches, the viability of structure-preserving mappings, and the question of what a structure of conscious experience is in the first place. I will also explain what, in my opinion, are the great promises of structural methodologies and how they might impact consciousness science at large. KW - Quality space KW - Qualia space KW - Phenomenal space KW - Theory of consciousness KW - Structuralism KW - Structure-preserving mapping KW - Isomorphism ER - TY - JOUR TI - The case for neurons : a no-go theorem for consciousness on a chip AU - Kleiner, Johannes AU - Ludwig, Tim PY - 2024 JO - Neuroscience of Consciousness VL - 2024 IS - 1, niae037 SP - 1-11 PB - Oxford University Press CY - Oxford SN - 2057-2107 DO - 10.1093/nc/niae037 UR - https://fis.uni-bamberg.de/handle/uniba/105581 LA - eng AB - We apply the methodology of no-go theorems as developed in physics to the question of artificial consciousness. The result is a no-go theorem which shows that under a general assumption, called dynamical relevance, Artificial Intelligence (AI) systems that run on contemporary computer chips cannot be conscious. Consciousness is dynamically relevant, simply put, if, according to a theory of consciousness, it is relevant for the temporal evolution of a system’s states. The no-go theorem rests on facts about semiconductor development: that AI systems run on central processing units, graphics processing units, tensor processing units, or other processors which have been designed and verified to adhere to computational dynamics that systematically preclude or suppress deviations. Whether our result resolves the question of AI consciousness on contemporary processors depends on the truth of the theorem’s main assumption, dynamical relevance, which this paper does not establish. KW - Artificial Consciousness KW - Synthetic Phenomenology KW - Artificial Sentience KW - Machine Consciousness KW - No-Go Theorem KW - Artificial Intelligence KW - Large Language Model ER - TY - JOUR TI - Causal Fermion Systems as an Effective Collapse Theory AU - Finster, Felix AU - Kleiner, Johannes AU - Paganini, Claudio F. PY - 2024 JO - Journal of Physics A : Mathematical and Theoretical VL - 57 IS - 39, 395303 PB - IOP Publishing CY - Bristol SN - 1751-8113 DO - 10.1088/1751-8121/ad7655 UR - https://fis.uni-bamberg.de/handle/uniba/105589 LA - eng AB - It is shown that, in the non-relativistic limit, causal fermion systems give rise to an effective collapse theory. The nonlinear and stochastic correction terms to the Schrödinger equation are derived from the causal action principle. The dynamics of the statistical operator is described by a deterministic equation of Kossakowski-Lindblad form. Moreover, the quantum state undergoes a dynamical collapse compatible with the Born rule. The effective model has similarities with the continuous spontaneous localization model, but differs from it by a conservation law for the probability integral as well as a non-locality in time on a microscopic length scale \ell_{\min}. KW - Causal fermion systems KW - effective collapse theory ER - TY - JOUR TI - Not easy to get off track : Motivational trajectories of learners completing a non-formal online course AU - Klose, Maria AU - Handschuh, Philipp AU - Steger, Diana AU - Artelt, Cordula PY - 2024 SP - 1-13 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/96888 LA - eng AB - Non-formal learning is becoming increasingly important in everyday life. Both the availability of open online learning opportunities and the number of participants in online courses continue to grow. Initially learners report high levels of motivation, but completion rates tend to be low. In the present study, we examined motivational trajectories of learners completing a non-formal online course. To this end, 450 learners of 49 open online courses offered by Bavarian universities completed up to three online questionnaires throughout the course. First, we used latent profile analysis to explore motivational trajectories within five subtypes of situational motivation, which resulted in four different motivational profiles. However, all profiles were characterized by remarkable stability over time, and differences only in the actual levels of the five motivational subtypes. Second, we used bivariate latent change score models to focus on differences of change in intrinsic motivation when analyzing simultaneously with situational interest. In addition, we considered self-regulation and mastery goal orientation as predictors of change in motivation. For intrinsic motivation there was only a small mean change and compensating effect from T1 to T2. We discuss the findings in the light of the fact that there are high dropout rates in non-formal online courses and offer practical advice on how to better address non-completers in future research. KW - Non-formal learning KW - Online learning KW - Situational motivation KW - Motivational trajectories ER - TY - JOUR TI - Identifying Disengaged Responding in Multiple-Choice Items : Extending a Latent Class Item Response Model With Novel Process Data Indicators AU - Welling, Jana AU - Gnambs, Timo AU - Carstensen, Claus H. PY - 2024 SP - 314-339 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/95700 LA - eng AB - Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses. Process data with its rich pool of additional information on the test-taking process could thus be used to improve existing identification approaches. In this study, three process data variables—text reread, item revisit, and answer change—were introduced as potential indicators of response engagement for multiple-choice items in a reading comprehension test. An extended latent class item response model for disengaged responding was developed by including the three new indicators as additional predictors of response engagement. In a sample of 1,932 German university students, the extended model indicated a better model fit than the baseline model, which included item response time as only indicator of response engagement. In the extended model, both item response time and text reread were significant predictors of response engagement. However, graphical analyses revealed no systematic differences in the item and person parameter estimation or item response classification between the models. These results suggest only a marginal improvement of the identification of disengaged responding by the new indicators. Implications of these results for future research on disengaged responding with process data are discussed. KW - disengaged responding KW - rapid guessing KW - process data KW - item response theory KW - computer-based assessments KW - multiple-choice items ER - TY - JOUR TI - Identifying Disengaged Responding in Multiple-Choice Items : Extending a Latent Class Item Response Model With Novel Process Data Indicators AU - Welling, Jana AU - Gnambs, Timo AU - Carstensen, Claus H. PY - 2024 JO - Educational and psychological measurement : EPM VL - 84 IS - 2 SP - 314-339 PB - Sage Periodicals CY - Thousand Oaks, Calif. [u.a.] SN - 0013-1644 DO - 10.1177/00131644231169211 UR - https://fis.uni-bamberg.de/handle/uniba/95699 LA - eng AB - Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses. Process data with its rich pool of additional information on the test-taking process could thus be used to improve existing identification approaches. In this study, three process data variables—text reread, item revisit, and answer change—were introduced as potential indicators of response engagement for multiple-choice items in a reading comprehension test. An extended latent class item response model for disengaged responding was developed by including the three new indicators as additional predictors of response engagement. In a sample of 1,932 German university students, the extended model indicated a better model fit than the baseline model, which included item response time as only indicator of response engagement. In the extended model, both item response time and text reread were significant predictors of response engagement. However, graphical analyses revealed no systematic differences in the item and person parameter estimation or item response classification between the models. These results suggest only a marginal improvement of the identification of disengaged responding by the new indicators. Implications of these results for future research on disengaged responding with process data are discussed. KW - disengaged responding KW - rapid guessing KW - process data KW - item response theory KW - computer-based assessments KW - multiple-choice items ER - TY - JOUR TI - Causal effect analysis in nonrandomized data with latent variables and categorical indicators : The implementation and benefits of EffectLiteR AU - Sengewald, Marie-Ann AU - Mayer, Axel PY - 2024 JO - Psychological methods VL - 29 IS - 2 SP - 287-307 CY - Washington, DC SN - 1939-1463 DO - 10.1037/met0000489 UR - https://fis.uni-bamberg.de/handle/uniba/54792 LA - eng ER - TY - GEN TI - The Closure of the Physical, Consciousness and Scientific Practice AU - Kleiner, Johannes AU - Hartmann, Stephan PY - 2023 SP - 1-15 PB - arXiv DO - 10.48550/arxiv.2110.03518 UR - https://fis.uni-bamberg.de/handle/uniba/109953 LA - eng ER - TY - CHAP TI - A feedback component that leverages counterfactual explanations for smart learning support AU - Günther, Sebastian A. AU - Haag, Felix AU - Hopf, Konstantin AU - Handschuh, Philipp AU - Klose, Maria AU - Staake, Thorsten Robert PY - 2023 T2 - Digitale Kulturen der Lehre entwickeln : Rahmenbedingungen, Konzepte und Werkzeuge SP - 285-291 PB - Springer VS CY - Wiesbaden, Germany SN - 978-3-658-43378-9 DO - 10.1007/978-3-658-43379-6_19 UR - https://fis.uni-bamberg.de/handle/uniba/105946 LA - eng AB - The growing prevalence of digital learning in higher education is accompanied by challenges regarding students’ self-regulated learning. While there is a plethora of behavioral interventions that aim at supporting students’ self-regulated learning, they often do not consider the heterogeneity of students in their intervention design. This paper presents a novel feedback intervention that leverages the potential of machine learning and counterfactual explanations for providing personalized feedback to support students’ learning. Ultimately, this approach could automatically adapt to different courses and thereby empower scalable and effective feedback. KW - Learning analytics KW - Explainable artificial intelligence KW - Counterfactual explanations KW - Feedback intervention KW - Experiment KW - Self-regulated learning ER - TY - GEN TI - Active Inference in String Diagrams : A Categorical Account of Predictive Processing and Free Energy AU - Tull, Sean AU - Kleiner, Johannes AU - Smithe, Toby St Clere PY - 2023 SP - 1-41 PB - arXiv DO - 10.48550/arxiv.2308.00861 UR - https://fis.uni-bamberg.de/handle/uniba/105583 LA - eng AB - We present a categorical formulation of the cognitive frameworks of Predictive Processing and Active Inference, expressed in terms of string diagrams interpreted in a monoidal category with copying and discarding. This includes diagrammatic accounts of generative models, Bayesian updating, perception, planning, active inference, and free energy. In particular we present a diagrammatic derivation of the formula for active inference via free energy minimisation, and establish a compositionality property for free energy, allowing free energy to be applied at all levels of an agent's generative model. Aside from aiming to provide a helpful graphical language for those familiar with active inference, we conversely hope that this article may provide a concise formulation and introduction to the framework. KW - String Diagrams ER - TY - THES TI - Die Abbildung latenter Merkmale im individuellen Entwicklungsverlauf : Vergleich von IRT-Linkmethoden unter Verwendung Rasch-skalierter Kompetenztestdaten AU - Fischer, Luise PY - 2023 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-91014 UR - https://fis.uni-bamberg.de/handle/uniba/91014 LA - other AB - Die vorliegende Forschungsarbeit möchte die Psychologie in ihrem Bestreben unterstützen, das Erleben und Verhalten des Menschen über die gesamte Lebensspanne abzubilden. Sie erweitert den Forschungsstand betreffend die Modellierung kognitiver Entwicklungsverläufe und damit einhergehende Herausforderungen wie z.B. starke Fähigkeitsveränderung zwischen Messzeitpunkten, kurze Testlänge, geringe Anzahl an Ankeritems und moderat eingeschränkte Modellgeltung. Das Verlinken angrenzender Messzeitpunkte erfolgt im Rahmen von Item Response Theory und dem Rasch Modell. Konkret liegen drei Beiträge vor: In zwei Beiträgen (Fischer, Gnambs, Rohm, & Carstensen, 2019, Fischer, Rohm, Carstensen, & Gnambs, 2021) werden zwei Linkdesigns (Ankeritem, Ankergruppe) und vier im Querschnittdesign etablierte IRT-Linkmethoden (Concurrent calibration, Fixed Parameter Calibration, mean/mean linking, weighted mean/mean linking) anhand von empirischen als auch simulierten Daten untersucht und in ihrer Performanz verglichen. Ein dritter Beitrag ist schließlich stärker praxisorientiert: Der korrekte Prozess des Verlinkens wird anschaulich dargestellt und in einer Schritt-für-Schritt Anleitung für weniger methodisch versierte Personen nachvollziehbar beschrieben. Während die vorliegende Forschungsarbeit nur marginale Unterschiede zwischen drei IRT-Linkmethoden (Fixed Parameter Calibration, mean/mean linking, weighted mean/mean linking) gefunden hat, so zeigten sich massive Konvergenzprobleme bei der Concurrent Calibration. Deutlich hervorzuheben sind die jeweils unterschiedlichen Herausforderungen der zwei gegenübergestellten Linkdesigns. So muss bei einem Ankeritem-Design besonderes Augenmerk auf einen möglichen systematischen Stichprobenausfall im Panel sowie auf Modellverletzungen durch abweichende Itemparameter von Ankeritems gelegt werden. Es haben sich keine Anhaltspunkte für Erinnerungseffekte durch die wiederholte Vorgabe von Items ergeben. Bei einem Ankergruppe-Design ist hingegen die Repräsentativität der Ankergruppe sowie – bedingt durch eine geringere Stichprobengröße – der Stichprobenfehler entscheidend für die Reliabilität und Validität des Linkergebnisses. Zusammenfassend verdeutlicht die vorliegende Forschungsarbeit die Bedeutung einer guten Modellpassung von Ankeritems sowie einem guten test targeting, um den systematischen Fehler im Linkergebnis beim Ankeritem-Design gering zu halten. KW - Linking KW - IRT KW - Rasch model KW - longitudinal KW - simulation study ER - TY - BOOK TI - Kulturelle Bildung in ländlichen Räumen : Transfer, Ko-Konstruktion und Interaktion zwischen Wissenschaft und Praxis ED - Kolleck, Nina ED - Fischer, Luise PY - 2023 PB - Verlag Barbara Budrich CY - Leverkusen ET - 1 SN - 978-3-8474-2673-8 UR - https://fis.uni-bamberg.de/handle/uniba/91021 LA - deu ER - TY - JOUR TI - Instructed highlighting of text passages - Indicator of reading or stratetic performance? AU - Heyne, Nora AU - Artelt, Cordula AU - Gnambs, Timo AU - Geher, Karin AU - Schoor, Cornelia PY - 2023 SP - 1-16 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/59964 LA - eng AB - In contrast to highlighting within self-regulated learning, instructed highlighting refers to the selective marking of text passages to answer given questions about texts which emerges in classroom settings or can be used in test administrations. According to literature, it requires reading processes of different complexity and focusing on and selecting of passages of texts, controlling and regulating processes that are operations of learning strategies. Therefore, we expected high correlations of instructed highlighting with reading competence and with using learning strategies. In order to evaluate these hypotheses on the base of precise measures of highlighting behaviour, four parameters were derived from literature, that quantify different quality aspects of instructed highlighting, e.g., the fit with experts' judgements. Based on a sample of German adults (N = 937) who completed achievement tests in instructed highlighting and reading competence as well as a standardized learning strategies questionnaire, the introduced indices allowed for detailed descriptions of instructed highlighting. Furthermore, instructed highlighting correlated substantially with reading competence. Contrary to our expectations, it showed negligible associations with the self-reported use of learning strategies. The results indicate that instructed highlighting represents aspects of focused reading, and, thus, might provide an innovative approach for technology-based assessments of reading competence. KW - Instructed highlighting KW - Learning strategies KW - Technology-based reading assessment KW - Highlighting item format KW - Reading competence ER - TY - JOUR TI - Testing students with special educational needs in large-scale assessments : Psychometric properties of test scores and associations with test taking behavior AU - Carstensen, Claus H. AU - Weinert, Sabine AU - Pohl, Steffi AU - Südkamp, Anna AU - Hardt, Katinka PY - 2023 SP - 1-14 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/58694 LA - eng AB - Assessing competencies of students with special educational needs in learning (SEN-L) poses a challenge for large-scale assessments (LSAs). For students with SEN-L, the available competence tests may fail to yield test scores of high psychometric quality, which are—at the same time—measurement invariant to test scores of general education students. We investigated whether we can identify a subgroup of students with SEN-L, for which measurement invariant competence measures of adequate psychometric quality may be obtained with tests available in LSAs. We furthermore investigated whether differences in test-taking behavior may explain dissatisfying psychometric properties and measurement non-invariance of test scores within LSAs. We relied on person fit indices and mixture distribution models to identify students with SEN-L for whom test scores with satisfactory psychometric properties and measurement invariance may be obtained. We also captured differences in test-taking behavior related to guessing and missing responses. As a result we identified a subgroup of students with SEN-L for whom competence scores of adequate psychometric quality that are measurement invariant to those of general education students were obtained. Concerning test taking behavior, there was a small number of students who unsystematically picked response options. Removing these students from the sample slightly improved item fit. Furthermore, two different patterns of missing responses were identified that explain to some extent problems in the assessments of students with SEN-L. KW - special educational needs KW - competence assessment KW - large-scale KW - item response theory KW - mixture models KW - test-taking behavior KW - guessing KW - missing responses ER - TY - THES TI - Analyzing the context of large-scale educational assessments using multilevel latent variable modeling AU - Rohm, Theresa PY - 2022 PB - Otto-Friedrich-Universität CY - Bamberg DO - 10.20378/irb-55904 UR - https://fis.uni-bamberg.de/handle/uniba/55904 LA - eng AB - Large-scale assessments in education often involve the measurement of latent competence, with the aim to perform comparisons between groups in subsequent analyses. The assessment of latent competence is thereby often performed within the institutionalized context of schools, or with the help of interviewers visiting respondents’ homes. In addition, sample selection for educational assessments might focus on groups as sampling units. For example, German secondary school types are used as primary sampling units in a multi-stage sampling procedure in educational studies. Subsequently, several schools per school type are selected for student competence assessment and in consequence, students are nested within clusters of schools. Hence, hierarchical data structures in large-scale educational assessments are caused by contexts of assessments, the sampling design or the combination of both. Regarding the resulting measures of latent competence, construct-irrelevant variance could be introduced by the context of educational assessments in the form of variance between clusters. This can potentially reduce the quality of measurement and impair a fair and valid interpretation of test scores. Further uncertainty in latent competence assessment arises by using as set of item indicators to measure the latent trait of interest. Besides the overall latent trait, also single items can vary by assessment contexts, indicated by random item effects that denote item variation across clusters. In addition, item differences can occur between groups (i.e., fixed item effects) and, if severe, indicate measurement non-invariance in the form of differential item functioning between groups. Item bias is indicated when item differences between groups favor a particular group. If item bias is found between groups that were used as sampling units (e.g., school type), item bias is associated with the context of competence assessment. Hence, group differences of items are then found on the cluster-level of the hierarchical data structure. For the detection of such sources of construct-irrelevant variance stemming from the assessment context, as well as item bias and item variances associated with the assessment context, multilevel latent variable models are presented and applied to competence and cognitive ability assessments. Competence measurements in the domains mathematic and reading are examined, as well as a measure of the cognitive ability perceptual speed, all assessed within the National Educational Panel Study. In the first study, interviewer and area clusters were investigated in an adult mathematic competence assessment, as hierarchical structures that might introduce construct-irrelevant variance. The examination of cross-classified multilevel item response theory models showed substantial interviewer variance in mathematic competence, while area effects were small. Subsequent analyses revealed some interviewers with undue influence, that were in addition associated with the respondents’ number of missing values in the assessed test and participation rates at the subsequent competence assessment. The second study investigated consequences of item bias, in the form of cluster-level group differences in items by school type, for students reading competence development from fifth to ninth grade of German secondary school. Measurement non-invariance occurred especially between the highest and lowest school type of German secondary schools at all measurement occasions. Nevertheless, the school type comparisons of reading competence development were not sensitive to found measurement non-invariance between school types and a parallel development of reading competence between German secondary school types was presented. In the third study, in addition to cluster-level group differences in item estimates by school type (i.e., fixed item effects), also random item effects across school clusters per school type were investigated for three items measuring perceptual speed for German secondary school students at ninth grade. Fixed- and random-group differential item functioning was investigated in comparison of students from several types of regular schools and students with special educational needs. Random-group differential item functioning was found for two out of the three items, indicating that estimated item difficulties differed across school clusters. Such differences across assessment contexts (i.e., school clusters) might stem from problems of standardized test assessment. Finally, the results of the three studies are discussed with regard to test standards for educational and psychological testing. The results are furthermore compared to empirical evaluations of context effects in other educational large-scale assessments. KW - assessment context, item response theory, multilevel latent variable modeling KW - large-scale educational assessments, National Educational Panel Study ER - TY - JOUR TI - The PIAAC longitudinal study in Germany : rationale and design AU - Rammstedt, Beatrice AU - Martin, Silke AU - Zabal, Anouk AU - Carstensen, Claus H. AU - Schupp, Jürgen PY - 2022 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/55109 LA - eng AB - In Germany, the respondents who had participated in the 2012 survey of the Programme for the International Assessment of Adult Competencies (PIAAC) were re-approached for the panel study PIAAC-L. PIAAC-L aims at investigating the longitudinal effects of skill outcomes over the life course and the development of the key skills assessed in PIAAC. Moreover, additional and alternative background information was collected and analyzed within PIAAC-L. PIAAC-L consists of three follow-up waves to the initial PIAAC 2012 survey. The present paper describes the rationale for PIAAC-L and the benefits of conducting a longitudinal PIAAC follow-up study in Germany. In addition, we outline the general design of PIAAC-L and the specific design of the three waves of data collection. Finally, we address the analytic potential of PIAAC-L data set and its availability to the scientific community. KW - PIAAC KW - PIAAC-L KW - Large-scale assessment KW - Basic skills KW - Longitudinal ER - TY - JOUR TI - On the Structure of Affect : A Meta-Analytic Investigation of the Dimensionality and the Cross-National Applicability of the Positive and Negative Affect Schedule (PANAS) AU - Wedderhoff, Nadine AU - Gnambs, Timo AU - Wedderhoff, Oliver AU - Burgard, Tanja AU - Bošnjak, Michael PY - 2021 JO - Zeitschrift für Psychologie VL - 229 IS - 1 SP - 24-37 PB - Hogrefe CY - Göttingen, Germany ; Newburyport, MA SN - 2190-8370 DO - 10.1027/2151-2604/a000434 UR - https://fis.uni-bamberg.de/handle/uniba/111291 LA - eng ER - TY - JOUR TI - Linking of Rasch-Scaled Tests : Consequences of Limited Item Pools and Model Misfit AU - Carstensen, Claus H. AU - Rohm, Theresa AU - Fischer, Luise AU - Gnambs, Timo PY - 2021 JO - Frontiers in psychology CY - Lausanne SN - 1664-1078 DO - 10.3389/fpsyg.2021.633896 UR - https://fis.uni-bamberg.de/handle/uniba/52546 LA - eng AB - In the context of item response theory (IRT), linking the scales of two measurement points is a prerequisite to examine a change in competence over time. In educational large-scale assessments, non-identical test forms sharing a number of anchor-items are frequently scaled and linked using two− or three-parametric item response models. However, if item pools are limited and/or sample sizes are small to medium, the sparser Rasch model is a suitable alternative regarding the precision of parameter estimation. As the Rasch model implies stricter assumptions about the response process, a violation of these assumptions may manifest as model misfit in form of item discrimination parameters empirically deviating from their fixed value of one. The present simulation study investigated the performance of four IRT linking methods— fixed parameter calibration, mean/mean linking, weighted mean/mean linking, and concurrent calibration—applied to Rasch-scaled data with a small item pool. Moreover, the number of anchor items required in the absence/presence of moderate model misfit was investigated in small to medium sample sizes. Effects on the link outcome were operationalized as bias, relative bias, and root mean square error of the estimated sample mean and variance of the latent variable. In the light of this limited context, concurrent calibration had substantial convergence issues, while the other methods resulted in an overall satisfying and similar parameter recovery—even in the presence of moderate model misfit. Our findings suggest that in case of model misfit, the share of anchor items should exceed 20% as is currently proposed in the literature. Future studies should further investigate the effects of anchor item composition regarding unbalanced model misfit. KW - Rasch model KW - item response theory KW - linking methods KW - model misfit KW - anchor-items design KW - limited item pools ER - TY - JOUR TI - Disentangling Interviewer and Area Effects in Large-Scale Educational Assessments using Cross-Classified Multilevel Item Response Models AU - Rohm, Theresa AU - Carstensen, Claus H. AU - Fischer, Luise AU - Gnambs, Timo PY - 2021 JO - Journal of survey statistics and methodology : JSSAM VL - 9 IS - 4 SP - 722–744 PB - Oxford Univ. Press CY - Oxford SN - 2325-0992 DO - 10.1093/jssam/smaa015 UR - https://fis.uni-bamberg.de/handle/uniba/52545 LA - eng ER - TY - JOUR TI - Learning Strategies as Moderators Between Motivation and Mathematics Performance in East Asian Students : Latent Class Analysis AU - Carstensen, Claus H. AU - Wu, Yi-Jhen AU - Kiefer, Sarah AU - Chen, Yi-Hsin PY - 2021 JO - Sage open VL - 11 IS - 4 SP - 215824402110613 PB - Sage Publ. CY - Thousand Oaks, Calif. SN - 2158-2440 DO - 10.1177/21582440211061382 UR - https://fis.uni-bamberg.de/handle/uniba/52544 LA - eng AB - This study applied a three-step latent class analysis (LCA) approach to explore latent classes of learning strategy use and their moderation effects on the relationships between motivation and mathematics performance. The data of 15-year-old students from five East Asian educational systems related to Chinese culture in the Programme of International Student Assessment (PISA) in 2012 were analyzed. The findings indicated that Shanghai, Singapore, Taiwan, and Macau showed three latent classes of learning strategies, whereas Hong Kong had two latent classes. Most students in the five educational systems reported to use the control strategy, some students reported the use of combined learning strategies, and few students reported the use of memorization except for students in Shanghai. Furthermore, we found the moderation effects of learning strategy use on mathematics performance depended on the types of motivation and educational systems. This study provides insights into the advantages of a three-step LCA approach in educational research. KW - person-centered approach KW - three-step latent class analysis KW - learning strategy use KW - motivation KW - mathematics performance KW - PISA ER - TY - JOUR TI - The achievement gap in reading competence : the effect of measurement non-invariance across school types AU - Rohm, Theresa AU - Carstensen, Claus H. AU - Fischer, Luise AU - Gnambs, Timo PY - 2021 JO - Large-scale assessments in education VL - 9 IS - Published: 28 October 2021 PB - SpringerOpen CY - Berlin ; Heidelberg [u.a.] SN - 2196-0739 DO - 10.1186/s40536-021-00116-2 UR - https://fis.uni-bamberg.de/handle/uniba/52543 LA - eng ER - TY - JOUR TI - Separating PIAAC competencies from general cognitive skills : A dimensionality and explanatory analysis AU - Engelhardt, Lena AU - Goldhammer, Frank AU - Lüdtke, Oliver AU - Köller, Olaf AU - Baumert, Jürgen AU - Carstensen, Claus H. PY - 2021 JO - Studies in Educational Evaluation VL - 71 IS - December 2021, 101069 SP - 1-9 PB - Elsevier Science CY - Amsterdam [u.a.] SN - 0191-491X DO - 10.1016/j.stueduc.2021.101069 UR - https://fis.uni-bamberg.de/handle/uniba/52542 LA - eng AB - This study aims to investigate how test scores from PIAAC (Programme for the International Assessment of Adult Competencies) can be interpreted, by comparing the PIAAC competencies literacy and numeracy to reasoning and perceptual speed. Dimensionality analyses supported, that the PIAAC competencies can be separated into a common factor overlapping with reasoning and perceptual speed, and domain-specific factors. For the common and specific factors, relations to other variables were analyzed. The nested factor for PIAAC literacy was as expected unrelated to age, positively related to learning opportunities during one’s lifetime, and positively related to literacy skill use. The nested factor for PIAAC numeracy was also as expected unrelated to age, against expectation unrelated to learning opportunities during one’s lifetime, and as expected positively related to numeracy skill use. Results support the validity of the intended test score interpretation for PIAAC literacy, while results for PIAAC numeracy were less clear. KW - PIAAC literacy KW - PIAAC numeracy KW - General cognitive skills KW - Validity KW - Large-scale assessments ER - TY - JOUR TI - How the home learning environment contributes to children’s early science knowledge : Associations with parental characteristics and science-related activities AU - Junge, Katharina AU - Schmerse, Daniel AU - Lankes, Eva-Maria AU - Carstensen, Claus H. AU - Steffensky, Mirjam PY - 2021 JO - Early Childhood Research Quarterly VL - 56 IS - 3rd Quarter 2021 SP - 294-305 PB - Elsevier Science CY - Amsterdam [u.a.] SN - 0885-2006 DO - 10.1016/j.ecresq.2021.04.004 UR - https://fis.uni-bamberg.de/handle/uniba/52547 LA - eng AB - Parents play a pivotal role in introducing their children to science, but little is known about the nature of an early science-related home learning environment. This study examines different aspects of the home learning environment and their associations with children's science knowledge. Mediation analyses of a sample of 257 five-year-old preschool children and their parents show that (1) parental engagement in science-related learning activities with their children is associated with children's science knowledge, (2) structural family characteristics as well as parental interest in science are associated with the frequency of these activities, and (3) associations of structural family characteristics and parental interest in science with children's knowledge are mediated by science-related activities. The results emphasize the important role of parents in children's early science education. KW - Home learning environment KW - Preschool children KW - Early science education KW - Mediation analysis ER - TY - JOUR TI - Modeling and Measuring Pre-Service Teachers’ Assessment Literacy Regarding Experimentation Competences in Biology AU - Joachim, Cora AU - Hammann, Marcus AU - Carstensen, Claus H. AU - Bögeholz, Susanne PY - 2021 SP - 1-27 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/49825 LA - eng AB - Assessment literacy is a crucial aspect of teachers’ professional knowledge and relevant to fostering students’ learning. Concerning experimentation, teachers have to be able to assess student achievement when students form hypotheses, design experiments, and analyze data. Therefore, teachers need to be familiar with criteria for experimentation as well as student conceptions of experimentation. The present study modeled and measured 495 German pre-service teachers’ knowledge of what to assess regarding experimentation competences in biology. We applied an open-answer format for the measurement instrument. For modeling we used item response theory (IRT). We argue that knowledge of what to assess regarding experimentation competences is a one-dimensional construct and we provide evidence for the validity of the measurement. Furthermore, we describe qualitative findings of pre-service teachers’ knowledge of what to assess, in particular difficulties concerning the assessment of student conceptions as well as the use of scientific terms in the assessments. We discuss the findings in terms of implications for science teacher education and further research perspectives. KW - assessment literacy; teacher education; experimentation; competence; biology ER - TY - JOUR TI - Quantitative Modelling and Perspective Taking : Two Competencies of Decision Making for Sustainable Development AU - Böhm, Marko AU - Barkmann, Jan AU - Eggert, Sabina AU - Carstensen, Claus H. AU - Bögeholz, Susanne PY - 2021 SP - 1-31 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/49764 LA - eng AB - Land use change, natural resource use and climate change are challenging Sustainable Development issues (SDGs 13–15). Fostering the competencies to deal with such issues is one core task for current educational endeavors. Among these competencies, decision-making competencies are central. In detail, we investigate how learners evaluate alternative decision-making options to improve existing competence models. We exemplify our competence modelling approach using the designation of a Marine Protected Area. The cross-sectional sample consists of secondary school students and student teachers (N = 760). Partial Credit modelling shows that quantitative modelling of decision-making options is a different competence dimension than perspective taking if contextualized for Sustainable Development. In quantitative modelling, mathematical modelling is used to evaluate and reflect on decision-making options. Perspective taking covers the ability to consider different normative perspectives on Sustainable Development issues. Both dimensions show plausible (latent) correlations with related constructs within the nomological net, i.e., with qualitative arguing, economic literacy, mathematical competencies, reading competencies and analytical problem solving. Furthermore, person-abilities increase with level of education for both dimensions. The identified competence dimensions quantitative modelling and perspective taking were successfully modelled and shown to be distinct; the resulting measuring instrument is reliable and valid. KW - sustainable development KW - socioscientific issues KW - reasoning; decision making KW - economic evaluation KW - perspective taking KW - modelling; competence KW - measure ER - TY - RPRT TI - Estimating Plausible Values with NEPS Data : An Example Using Reading Competence in Starting Cohort 6 AU - Scharl, Anna AU - Carstensen, Claus H. AU - Gnambs, Timo PY - 2020 PB - LIfBi Leibniz Institute for Educational Trajectories CY - Bamberg T3 - NEPS Working Papers/Survey Papers DO - 10.5157/NEPS:SP71:1.0 UR - https://fis.uni-bamberg.de/handle/uniba/54498 LA - eng ER - TY - JOUR TI - Quantitative Modelling and Perspective Taking: Two Competencies of Decision Making for Sustainable Development AU - Böhm, Marko AU - Barkmann, Jan AU - Eggert, Sabina AU - Carstensen, Claus H. AU - Bögeholz, Susanne PY - 2020 JO - Sustainability VL - 12 IS - 17 SP - 1-31 PB - MDPI CY - Basel SN - 2071-1050 DO - 10.3390/su12176980 UR - https://fis.uni-bamberg.de/handle/uniba/54127 LA - eng AB - Land use change, natural resource use and climate change are challenging Sustainable Development issues (SDGs 13–15). Fostering the competencies to deal with such issues is one core task for current educational endeavors. Among these competencies, decision-making competencies are central. In detail, we investigate how learners evaluate alternative decision-making options to improve existing competence models. We exemplify our competence modelling approach using the designation of a Marine Protected Area. The cross-sectional sample consists of secondary school students and student teachers (N = 760). Partial Credit modelling shows that quantitative modelling of decision-making options is a different competence dimension than perspective taking if contextualized for Sustainable Development. In quantitative modelling, mathematical modelling is used to evaluate and reflect on decision-making options. Perspective taking covers the ability to consider different normative perspectives on Sustainable Development issues. Both dimensions show plausible (latent) correlations with related constructs within the nomological net, i.e., with qualitative arguing, economic literacy, mathematical competencies, reading competencies and analytical problem solving. Furthermore, person-abilities increase with level of education for both dimensions. The identified competence dimensions quantitative modelling and perspective taking were successfully modelled and shown to be distinct; the resulting measuring instrument is reliable and valid. KW - Sustainable Development; socioscientific issues; reasoning; decision making; economic evaluation; perspective taking; modelling; competence; measure ER - TY - JOUR TI - Modeling and Measuring Pre-Service Teachers’ Assessment Literacy Regarding Experimentation Competences in Biology AU - Joachim, Cora AU - Hammann, Marcus AU - Carstensen, Claus H. AU - Bögeholz, Susanne PY - 2020 JO - Education Sciences VL - 10 IS - 5 SP - 1-27 PB - MDPI CY - Basel SN - 2227-7102 DO - 10.3390/educsci10050140 UR - https://fis.uni-bamberg.de/handle/uniba/54115 LA - eng AB - Assessment literacy is a crucial aspect of teachers’ professional knowledge and relevant to fostering students’ learning. Concerning experimentation, teachers have to be able to assess student achievement when students form hypotheses, design experiments, and analyze data. Therefore, teachers need to be familiar with criteria for experimentation as well as student conceptions of experimentation. The present study modeled and measured 495 German pre-service teachers’ knowledge of what to assess regarding experimentation competences in biology. We applied an open-answer format for the measurement instrument. For modeling we used item response theory (IRT). We argue that knowledge of what to assess regarding experimentation competences is a one-dimensional construct and we provide evidence for the validity of the measurement. Furthermore, we describe qualitative findings of pre-service teachers’ knowledge of what to assess, in particular difficulties concerning the assessment of student conceptions as well as the use of scientific terms in the assessments. We discuss the findings in terms of implications for science teacher education and further research perspectives. KW - assessment literacy; teacher education; experimentation; competence; biology ER - TY - CHAP TI - Machbarkeitsstudien an Förderschulen mit dem Schwerpunkt Lernen im Rahmen des Nationalen Bildungspanels (2010 bis 2013) : Ergebnisse und Resümee AU - Nusser, Lena AU - Weinert, Sabine AU - Artelt, Cordula AU - Carstensen, Claus H. PY - 2020 T2 - Schüler*innen mit sonderpädagogischem Förderbedarf in Schulleistungserhebungen : Einblicke und Entwicklungen SP - 147-175 PB - Springer Fachmedien CY - Wiesbaden SN - 978-3-658-27608-9 DO - 10.1007/978-3-658-27608-9 UR - https://fis.uni-bamberg.de/handle/uniba/47855 LA - deu ER - TY - JOUR TI - Instructed highlighting of text passages - Indicator of reading or stratetic performance? AU - Heyne, Nora AU - Artelt, Cordula AU - Gnambs, Timo AU - Geher, Karin AU - Schoor, Cornelia PY - 2020 JO - Lingua : international review of general linguistics VL - 236 IS - March, 102803 SP - 1-16 PB - Elsevier CY - Amsterdam [u.a.] SN - 0024-3841 DO - 10.1016/j.lingua.2020.102803 UR - https://fis.uni-bamberg.de/handle/uniba/47602 LA - eng AB - In contrast to highlighting within self-regulated learning, instructed highlighting refers to the selective marking of text passages to answer given questions about texts which emerges in classroom settings or can be used in test administrations. According to literature, it requires reading processes of different complexity and focusing on and selecting of passages of texts, controlling and regulating processes that are operations of learning strategies. Therefore, we expected high correlations of instructed highlighting with reading competence and with using learning strategies. In order to evaluate these hypotheses on the base of precise measures of highlighting behaviour, four parameters were derived from literature, that quantify different quality aspects of instructed highlighting, e.g., the fit with experts' judgements. Based on a sample of German adults (N = 937) who completed achievement tests in instructed highlighting and reading competence as well as a standardized learning strategies questionnaire, the introduced indices allowed for detailed descriptions of instructed highlighting. Furthermore, instructed highlighting correlated substantially with reading competence. Contrary to our expectations, it showed negligible associations with the self-reported use of learning strategies. The results indicate that instructed highlighting represents aspects of focused reading, and, thus, might provide an innovative approach for technology-based assessments of reading competence. KW - Instructed highlighting KW - Learning strategies KW - Technology-based reading assessment KW - Highlighting item format KW - Reading competence ER - TY - JOUR TI - Compensation and Amplification of Attenuation Bias in Causal Effect Estimates AU - Sengewald, Marie-Ann AU - Pohl, Steffi PY - 2019 JO - Psychometrika VL - 84 IS - 2 SP - 589-610 PB - Psychometric Society CY - College Park, Md. SN - 1860-0980 DO - 10.1007/s11336-019-09665-6 UR - https://fis.uni-bamberg.de/handle/uniba/115919 LA - eng ER - TY - CHAP TI - Zertifikatsarmut gleich Kompetenzarmut ? AU - Blossfeld, Pia Nicoletta AU - Carstensen, Claus H. AU - Maurice, Jutta von PY - 2019 T2 - Handbuch Bildungsarmut SP - 467-489 PB - Springer Fachmedien CY - Wiesbaden SN - 978-3-658-19573-1 DO - 10.1007/978-3-658-19573-1_18 UR - https://fis.uni-bamberg.de/handle/uniba/54502 LA - deu ER - TY - JOUR TI - Longitudinal linking of Rasch-model-scaled competence tests in large-scale assessments : A comparison and evaluation of different linking methods and anchoring designs based on two tests on mathematical competence administered in grades 5 and 7 AU - Fischer, Luise AU - Gnambs, Timo AU - Rohm, Theresa AU - Carstensen, Claus H. PY - 2019 JO - Psychological Test and Assessment Modeling VL - 61 IS - 1 SP - 37-64 PB - Pabst CY - Lengerich ; Berlin SN - 2190-0507 UR - https://fis.uni-bamberg.de/handle/uniba/54501 LA - eng ER - TY - JOUR TI - A new perspective on memorization practices among East Asian students based on PISA 2012 AU - Wu, Yi-Jhen AU - Carstensen, Claus H. AU - Lee, Jihyun PY - 2019 JO - Educational Psychology VL - 40 IS - 5 SP - 643-662 PB - Taylor & Francis CY - London [u.a.] SN - 1469-5820 DO - 10.1080/01443410.2019.1648766 UR - https://fis.uni-bamberg.de/handle/uniba/54499 LA - eng ER - TY - CHAP TI - Messen und Bewerten von Lernergebnissen AU - Drechsel, Barbara AU - Worbach, Marc AU - Carstensen, Claus H. PY - 2019 T2 - Psychologie für den Lehrberuf SP - 493-516 PB - Springer CY - Berlin SN - 978-3-662-55753-2 DO - 10.1007/978-3-662-55754-9_25 UR - https://fis.uni-bamberg.de/handle/uniba/45731 LA - deu ER - TY - CHAP TI - Development of competencies across the life course AU - Weinert, Sabine AU - Artelt, Cordula AU - Prenzel, Manfred AU - Senkbeil, Martin AU - Ehmke, Timo AU - Carstensen, Claus H. AU - Lockl, Kathrin PY - 2019 T2 - Education as a lifelong process: The German National Educational Panel Study (NEPS) SP - 57-82 PB - Springer CY - Wiesbaden SN - 978-3-658-23161-3 DO - 10.1007/978-3-658-23162-0 UR - https://fis.uni-bamberg.de/handle/uniba/45570 LA - eng ER - TY - JOUR TI - When does measurement error in covariates impact causal effect estimates? : Analytic derivations of different scenarios and an empirical illustration AU - Sengewald, Marie-Ann AU - Steiner, Peter M. AU - Pohl, Steffi PY - 2018 JO - British Journal of Mathematical and Statistical Psychology VL - 72 IS - 2 SP - 244-270 PB - Wiley CY - Hoboken, NJ [u.a.] SN - 2044-8317 DO - 10.1111/bmsp.12146 UR - https://fis.uni-bamberg.de/handle/uniba/115921 LA - eng ER - TY - JOUR TI - In memoriam Jürgen Rost (1952–2017) AU - Davier, Matthias von AU - Carstensen, Claus H. AU - Langeheine, Rolf AU - Eid, Michael PY - 2018 JO - Psychometrika : a journal of quantitative psychology VL - 83 IS - 3 SP - 782-784 PB - Springer CY - New York SN - 1860-0980 DO - 10.1007/s11336-018-9618-9 UR - https://fis.uni-bamberg.de/handle/uniba/54503 LA - deu ER - TY - JOUR TI - Positionspapier zur Rolle der Psychologischen Methodenlehre in Forschung und Lehre AU - Meiser, Thorsten AU - Eid, Michael AU - Carstensen, Claus H. AU - Erdfelder, Edgar AU - Gollwitzer, Mario AU - Pohl, Steffi AU - Steyer, Rolf AU - Strobl, Carolin PY - 2018 JO - Psychologische Rundschau VL - 69 IS - 4 SP - 325-331 PB - Hogrefe CY - Göttingen ; Bern [u.a.] SN - 2190-6238 DO - 10.1026/0033-3042/a000417 UR - https://fis.uni-bamberg.de/handle/uniba/54494 LA - deu ER - TY - JOUR TI - Jugend forscht AU - Paul, Jürgen AU - Carstensen, Claus H. AU - Groß, Jorge PY - 2018 JO - MNU Journal IS - 4 SP - 227-233 PB - Verlag Klaus Seeberger CY - Neuss SN - 0025-5866 UR - https://fis.uni-bamberg.de/handle/uniba/51092 LA - deu ER - TY - JOUR TI - Multidimensional Modeling of Traits and Response Styles AU - Wetzel, Eunike AU - Carstensen, Claus H. PY - 2017 JO - European journal of psychological assessment : EJPA VL - 33 IS - 5 SP - 352-364 PB - Hogrefe & Huber CY - Göttingen SN - 2151-2426 DO - 10.1027/1015-5759/a000291 UR - https://fis.uni-bamberg.de/handle/uniba/54506 LA - eng ER - TY - JOUR TI - The PIAAC longitudinal study in Germany : rationale and design AU - Rammstedt, Beatrice AU - Martin, Silke AU - Zabal, Anouk AU - Carstensen, Claus H. AU - Schupp, Jürgen PY - 2017 JO - Large-scale Assessments in Education VL - 5 IS - 4 PB - SpringerOpen CY - Berlin ; Heidelberg [u.a.] SN - 2196-0739 DO - 10.1186/s40536-017-0040-z UR - https://fis.uni-bamberg.de/handle/uniba/54505 LA - eng AB - In Germany, the respondents who had participated in the 2012 survey of the Programme for the International Assessment of Adult Competencies (PIAAC) were re-approached for the panel study PIAAC-L. PIAAC-L aims at investigating the longitudinal effects of skill outcomes over the life course and the development of the key skills assessed in PIAAC. Moreover, additional and alternative background information was collected and analyzed within PIAAC-L. PIAAC-L consists of three follow-up waves to the initial PIAAC 2012 survey. The present paper describes the rationale for PIAAC-L and the benefits of conducting a longitudinal PIAAC follow-up study in Germany. In addition, we outline the general design of PIAAC-L and the specific design of the three waves of data collection. Finally, we address the analytic potential of PIAAC-L data set and its availability to the scientific community. KW - PIAAC KW - PIAAC-L KW - Large-scale assessment KW - Basic skills KW - Longitudinal ER - TY - JOUR TI - Dealing With Item Nonresponse in Large-Scale Cognitive Assessments : The Impact of Missing Data Methods on Estimated Explanatory Relationships AU - Köhler, Carmen AU - Pohl, Steffi AU - Carstensen, Claus H. PY - 2017 JO - Journal of Educational Measurement VL - 54 IS - 4 SP - 397-419 PB - Wiley- Blackwell CY - Oxford [u.a.] SN - 0022-0655 DO - 10.1111/jedm.12154 UR - https://fis.uni-bamberg.de/handle/uniba/54504 LA - eng ER - TY - JOUR TI - Clarifying the concept of validity: From measurement to everyday language AU - Buntins, Matthias AU - Buntins, Katja AU - Eggert, Frank PY - 2017 JO - Theory & psychology VL - 27 IS - 5 SP - 703-710 PB - Sage CY - London SN - 0959-3543 DO - 10.1177/0959354317702256 UR - https://fis.uni-bamberg.de/handle/uniba/46443 LA - eng AB - Test validity is widely understood as the degree to which a test measures what it should measure (cf. Cattell, 1946). We argue that this conceptualization does not refer to a psychometric problem but to the correspondence between scientific language and everyday language. Following Steven’s (1946), test results give an operational definition of attributes, qualifying any test as valid by definition. Following the representational theory of measurement (Krantz, Luce, Suppes & Tversky, 1971), an attribute is defined by an empirical relational structure and a corresponding measurement model. Since measurement depends on the specified empirical structure, if a test measures anything, it must be valid. However, the question of validity can be asked in a meaningful way, if one interprets test results in the context of everyday language. We conclude that validity can be understood as the degree to which the variable measured by a test corresponds to concepts of everyday language. KW - Concept formation; Everyday language; Measurement theory; Psychometrics; Validity ER - TY - JOUR TI - Analysis of person-situation interactions in educational settings via cross-classified multilevel longitudinal modelling: illustrated with the example of students’ stress experience AU - Kärner, Tobias AU - Sembill, Detlef AU - Aßmann, Christian AU - Friederichs, Edgar AU - Carstensen, Claus H. PY - 2017 JO - Frontline Learning Research : an official journal of EARLI VL - 5 IS - 1 SP - 16-42 CY - Turku SN - 2295-3159 DO - 10.14786/flr.v5i1.137 UR - https://fis.uni-bamberg.de/handle/uniba/41761 LA - eng ER - TY - CHAP TI - Granger meets Rasch : investigating Granger causation with multidimensional longitudinal item response models AU - Koller, Ingrid AU - Carstensen, Claus H. AU - Wiedermann, Wolfgang AU - von Eye, Alexander PY - 2016 T2 - Statistics and Causality : Methods for Applied Empirical Research SP - 231-248 PB - John Wiley & Sons CY - New York, NY T3 - Wiley Series in Probability and Statistics SN - 978-1-118-94704-3 UR - https://fis.uni-bamberg.de/handle/uniba/40844 LA - eng ER - TY - CHAP TI - Estimation of Plausible Values Considering Partially Missing Background Information : A Data Augmented MCMC Approach AU - Gaasch, Christoph AU - Pohl, Steffi AU - Carstensen, Claus PY - 2016 T2 - Methodological issues of longitudinal surveys : The example of the National Educational Panel Study SP - 503-521 PB - Springer Fachmedien Wiesbaden CY - Wiesbaden SN - 978-3-658-11994-2 UR - https://fis.uni-bamberg.de/handle/uniba/40513 LA - eng ER - TY - CHAP TI - Scoring of Complex Multiple Choice Items in NEPS Competence Tests AU - Haberkorn, Kerstin AU - Pohl, Steffi AU - Carstensen, Claus AU - Wiegand, Elena PY - 2016 T2 - Methodological issues of longitudinal surveys : The example of the National Educational Panel Study SP - 523-540 PB - Springer Fachmedien Wiesbaden CY - Wiesbaden SN - 978-3-658-11994-2 UR - https://fis.uni-bamberg.de/handle/uniba/40501 LA - eng ER - TY - CHAP TI - Metacognitive knowledge in young children : Development of a new test procedure for first graders AU - Lockl, Kathrin AU - Händel, Marion AU - Haberkorn, Kerstin AU - Weinert, Sabine PY - 2016 T2 - Methodological issues of longitudinal surveys : The example of the National Educational Panel Study SP - 465-484 PB - Springer Fachmedien Wiesbaden CY - Wiesbaden SN - 978-3-658-11994-2 UR - https://fis.uni-bamberg.de/handle/uniba/40470 LA - eng ER - TY - JOUR TI - Testing students with special educational needs in large-scale assessments : Psychometric properties of test scores and associations with test taking behavior AU - Carstensen, Claus H. AU - Weinert, Sabine AU - Pohl, Steffi AU - Südkamp, Anna AU - Hardt, Katinka PY - 2016 JO - Frontiers in Psychology VL - 9 IS - 23 February 2016 PB - Frontiers Research Foundation CY - Lausanne SN - 1664-1078 DO - 10.3389/fpsyg.2016.00154 UR - https://fis.uni-bamberg.de/handle/uniba/40435 LA - eng AB - Assessing competencies of students with special educational needs in learning (SEN-L) poses a challenge for large-scale assessments (LSAs). For students with SEN-L, the available competence tests may fail to yield test scores of high psychometric quality, which are—at the same time—measurement invariant to test scores of general education students. We investigated whether we can identify a subgroup of students with SEN-L, for which measurement invariant competence measures of adequate psychometric quality may be obtained with tests available in LSAs. We furthermore investigated whether differences in test-taking behavior may explain dissatisfying psychometric properties and measurement non-invariance of test scores within LSAs. We relied on person fit indices and mixture distribution models to identify students with SEN-L for whom test scores with satisfactory psychometric properties and measurement invariance may be obtained. We also captured differences in test-taking behavior related to guessing and missing responses. As a result we identified a subgroup of students with SEN-L for whom competence scores of adequate psychometric quality that are measurement invariant to those of general education students were obtained. Concerning test taking behavior, there was a small number of students who unsystematically picked response options. Removing these students from the sample slightly improved item fit. Furthermore, two different patterns of missing responses were identified that explain to some extent problems in the assessments of students with SEN-L. KW - special educational needs KW - competence assessment KW - large-scale KW - item response theory KW - mixture models KW - test-taking behavior KW - guessing KW - missing responses ER - TY - JOUR TI - Psychological tests from a (fuzzy-)logical point of view AU - Borgstede, Matthias AU - Buntins, Katja AU - Eggert, Frank PY - 2016 JO - Quality & quantity : international journal of methodology VL - 50 IS - 6 SP - 2395-2416 PB - Springer CY - Dordrecht SN - 0033-5177 DO - 10.1007/s11135-015-0268-z UR - https://fis.uni-bamberg.de/handle/uniba/40382 LA - eng AB - Psychometric theory relies on two basic assumptions: (a) psychological constructs refer to latent (unobservable) variables and (b) psychological tests serve as a way to measure these constructs. This view is complemented by an alternative interpretation of psychological constructs, which neither relies on latent variables nor on the concept of measurement. Using the formal apparatus of many-valued logic, psychological constructs are re-interpreted as linguistic concepts (rather than latent variables), which can be inferred by means of logical calculus (as opposed to measurement). Thus, test scores do not refer to the values of latent variables, but to the degree to which the necessary and sufficient conditions for the ascription of a construct are fulfilled. Following this rationale, a formal theory of psychological tests is developed, which models the process of testing as logical inference. Applying the derived procedures, a person’s testing behaviour yields the degree to which a construct describes her adequately. KW - Psychometrics KW - Psychological constructs KW - Psychological tests KW - Latent variables KW - Many-valued logic ER - TY - CHAP TI - Validity of survey data of students with special educational needs : Results from the National Educational Panel Study AU - Heydrich, Jana AU - Carstensen, Claus H. AU - Artelt, Cordula AU - Weinert, Sabine AU - Nusser, Lena PY - 2016 T2 - Methodological Issues of Longitudinal Surveys : The Example of the National Educational Panel Study SP - 251-266 PB - Springer Fachmedien Wiesbaden GmbH CY - Wiesbaden ET - 1 SN - 978-3-658-11994-2 UR - https://fis.uni-bamberg.de/handle/uniba/40342 LA - eng ER - TY - THES TI - Modeling Competence Data in Large-Scale Educational Assessments AU - Haberkorn, Kerstin PY - 2016 PB - opus CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/40176 LA - eng AB - Over the last decades, large-scale assessments focusing on skills and knowledge of individuals have expanded significantly in order to obtain information about conditions for and consequences of competence acquisition. To provide valid and accurate scores of the subjects under investigation, it is necessary to thoroughly check the psychometric properties of the competence instruments that are administered and to choose appropriate scaling models for the competence data. In this thesis, various challenges in modeling competence data were addressed that arose from different recently developed competence tests in large-scale assessments. The different tests posed specific demands on the scaling of the data such as dealing with multidimensionality, incorporating different response formats, or linking competence scores. By investigating these challenges associated with each of the competence tests, the aim of the thesis was to draw implications for the specification of the scaling models for the competence data. First, a new metacognitive knowledge test for early elementary school children was investigated. As earlier findings on metacognitive knowledge in secondary school pointed to empirically distinguishable components of metacognitive knowledge, especially the dimensionality of the newly developed test was studied. Therefore, uni- and multidimensional models were applied to the competence data and their model fit was compared. By applying multidimensional latent-change models, the homogeneity of change was observed as further indicator for dimensionality. Overall, the new test instrument exhibited good psychometric properties including fairness of the items for various subgroups. In accordance with previous studies in other age groups the results indicated a multidimensional structure of the newly developed test instrument. In the discussion, theoretical as well as empirical arguments were compiled that should be considered for the choice of a uni- or a multidimensional model for the metacognitive knowledge data. The next objective in the thesis was to study a series of reading competence tests intended to measure the same latent trait across a large age span. The different reading competence tests, developed in a longitudinal large-scale study, were based on the same conceptual framework and were administered from fifth grade to adulthood. We specifically investigated whether the test scores were comparable across such a large age span enabling to interpret change across time. The analyses on the reading competence tests showed that the coherence of measurement could not fully be assured across the wide age range. The application of strict linking models allowing for the interpretation of developmental progress seemed to be justified within secondary school, but not between secondary school and adulthood. The last purpose in the thesis was to find out how to adequately incorporate different response formats in a scaling model. Therefore, multiple choice (MC) and complex multiple choice (CMC) items were regarded as they are most frequently used in large-scale assessments. Specifically, we explored whether the two response formats form distinct empirical dimensions and which a priori scoring schemes for the two response formats appropriately model the competence data. The results demonstrated that the response formats built a unidimensional measure across domains, studies, and age cohorts justifying to use a unidimensional scale score. A differentiated scoring of the CMC items yielded a better discrimination between persons and was, thus, preferred. The a priori weighting scheme of giving each subtask of a CMC item half the weight of a MC item described the empirical competence data well. ER - TY - CHAP TI - Measuring Competencies across the Lifespan : Challenges of Linking Test scores AU - Pohl, Steffi AU - Haberkorn, Kerstin AU - Carstensen, Claus H. PY - 2015 T2 - Dependent Data in Social Sciences Research : Forms, Issues, and Methods of Analysis SP - 281-308 PB - Springer International Publishing CY - Cham T3 - Springer Proceedings in Mathematics & Statistics SN - 978-3-319-20584-7 UR - https://fis.uni-bamberg.de/handle/uniba/40825 LA - eng ER - TY - JOUR TI - Bayesian estimation in IRT models with missing values in background variables AU - Aßmann, Christian AU - Gaasch, Christoph AU - Pohl, Steffi AU - Carstensen, Claus H. PY - 2015 JO - Psychological test and assessment modeling : formerly Psychologische Beiträge VL - 57 IS - 4 SP - 595-618 PB - Pabst CY - Lengerich ; Berlin ; Bremen ; Miami, Fla. ; Riga ; Viernheim ; Wien ; Zagreb SN - 2190-0507 UR - https://fis.uni-bamberg.de/handle/uniba/40070 LA - eng AB - Large scale assessment studies typically aim at investigating the relationship between persons competencies and explaining variables. Individual competencies are often estimated by explicitly including explaining background variables into corresponding Item Response Theory models. Since missing values in background variables inevitably occur, strategies to handle the uncertainty related to missing values in parameter estimation are required. We propose to adapt a Bayesian estimation strategy based on Markov Chain Monte Carlo techniques. Sampling from the posterior distribution of parameters is thereby enriched by sampling from the full conditional distribution of the missing values. We consider non-parametric as well as parametric approximations for the full conditional distributions of missing values, thus allowing for a flexible incorporation of metric as well as categorical background variables. We evaluate the validity of our approach with respect to statistical accuracy by a simulation study controlling the missing values generating mechanism. We show that the proposed Bayesian strategy allows for effective comparison of nested model specifications via gauging highest posterior density intervals of all involved model parameters. An illustration of the suggested approach uses data from the National Educational Panel Study on mathematical competencies of fifth grade students. KW - missing values KW - background variables KW - classification and regression trees KW - item response theory ER - TY - JOUR TI - Befragung von Schülerinnen und Schülern mit sonderpädagogischem Förderbedarf Lernen: Ergebnisse zur Messinvarianz AU - Nusser, Lena AU - Carstensen, Claus H. AU - Artelt, Cordula PY - 2015 JO - Empirische Sonderpädagogik VL - 7 IS - 2 SP - 99-116 PB - Pabst Science Publ. CY - Lengerich ; Berlin ; Bremen [u.a.] SN - 1869-4845 UR - https://fis.uni-bamberg.de/handle/uniba/39729 LA - deu AB - Dieser Artikel betrachtet die messinvariante Erfassung bildungsrelevanter Konstrukte mit Hilfe schriftlicher Befragungen bei Schülerinnen und Schülern an Förderschulen und Hauptschulen in der 5. Jahrgangsstufe. Um optimale Administrationsbedingungen für Schülerinnen und Schüler mit sonderpädagogischem Förderbedarf Lernen zu erforschen, wurde ein experimentelles Design implementiert. Inwieweit angepasste Erhebungsinstrumente und unterschiedliche Beschulungsformen sowie anzunehmende Kompetenzunterschiede der Befragten eine messäquivalente Erfassung der Lesemotivation und des akademischen Selbstkonzeptes ermöglichen, wird durch Mehrgruppenvergleiche konfirmatorischer Faktorenanalysen untersucht. Die Ergebnisse deuten darauf hin, dass vergleichende Analysen zwischen Schülergruppen an Förderschulen und Hauptschulen für bestimmte Konstrukte und Faktoren sinnvoll interpretierbar sind. KW - Messinvarianz, Mehrgruppenvergleich, sonderpädagogischer Förderbedarf, Lesemotivation, akademisches Selbstkonzept KW - measurement invariance, multi group comparison, special educational needs, reading motivation, academic self-concept ER - TY - JOUR TI - Taking the Missing Propensity Into Account When Estimating Competence Scores : Evaluation of Item Response Theory Models for Nonignorable Omissions AU - Köhler, Carmen AU - Pohl, Steffi AU - Carstensen, Claus H. PY - 2015 JO - Educational and psychological measurement: EPM VL - 75 IS - 5 SP - 850-875 PB - Sage Periodicals CY - Thousand Oaks, Calif. [u.a.] DO - 10.1177/0013164414561785 UR - https://fis.uni-bamberg.de/handle/uniba/21907 LA - eng ER - TY - RPRT TI - Estimation of plausible values using background variables with missing values : A data augmented MCMC approach AU - Aßmann, Christian AU - Carstensen, Claus H. AU - Gaasch, Christoph AU - Pohl, Steffi PY - 2014 PB - NEPS CY - Bamberg T3 - NEPS Working Papers/Survey Papers UR - https://fis.uni-bamberg.de/handle/uniba/48704 LA - eng ER - TY - JOUR TI - Reversed thresholds in partial credit models : A reason for collapsing categories? AU - Wetzel, Eunike AU - Carstensen, Claus H. PY - 2014 JO - Assessment VL - 21 IS - 6 SP - 765-774 PB - Sage CY - London [u.a.] SN - 1552-3489 DO - 10.1177/1073191114530775 UR - https://fis.uni-bamberg.de/handle/uniba/21956 LA - eng ER - TY - JOUR TI - Metacognitive knowledge in children at early elementary school AU - Haberkorn, Kerstin AU - Lockl, Kathrin AU - Pohl, Steffi AU - Ebert, Susanne AU - Weinert, Sabine PY - 2014 JO - Metacognition & Learning PB - Springer CY - Berlin ; Heidelberg [u.a.] SN - 1556-1623 DO - 10.1007/s11409-014-9115-1 UR - https://fis.uni-bamberg.de/handle/uniba/20829 LA - eng ER - TY - JOUR TI - Lernen ein Leben lang AU - Carstensen, Claus AU - Weinert, Sabine PY - 2014 JO - Uni.vers Forschung : das Magazin der Otto-Friedrich-Universität Bamberg IS - Mai, Denken · Fühlen · Handeln SP - 34-37 CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/6276 LA - deu ER - TY - RPRT TI - Estimation of plausible values using background variables with missing values : A data augmented MCMC approach AU - Aßmann, Christian AU - Gaasch, Christoph AU - Pohl, Steffi AU - Carstensen, Claus H. PY - 2014 CY - Bamberg T3 - NEPS Working Papers/Survey Papers UR - https://fis.uni-bamberg.de/handle/uniba/2398 LA - eng ER - TY - JOUR TI - Special Issue: Assessing competencies across the lifespan within the German National Educational Panel Study (NEPS) AU - Artelt, Cordula AU - Carstensen, Claus AU - Weinert, Sabine PY - 2013 JO - Journal for educational research online : JERO VL - 5 IS - 2 PB - Waxmann CY - Münster SN - 1866-6671 UR - https://fis.uni-bamberg.de/handle/uniba/6453 LA - eng AB - The eight articles of this Special Issue describe the assessment of competencies within the German National Education Panel Study (NEPS) for major educational-stage-comprehensive assessment domains of the NEPS. The Editorial outlines the overall framework for the selection and conceptualization of the assessment of competencies against the background of existing models and approaches in national and international large-scale assessments and panel studies. The functional-integrative perspective on competencies is introduced and briefly described with reference to the competence domains integrated into the NEPS assessments. Moreover, the assessment design implemented within the fi rst five years is presented within the NEPS. KW - Models of competencies KW - NEPS framework KW - Literacy KW - Large-scale assessment KW - Kompetenzmodell ER - TY - JOUR TI - Do Individual Response Styles Matter? Assessing Differential Item Functioning for Men and Women in the NEO-PI-R AU - Wetzel, Eunike AU - Böhnke, Jan R. AU - Carstensen, Claus H. AU - Ziegler, Matthias AU - Ostendorf, Fritz PY - 2013 JO - Journal of individual differences VL - 34 IS - 2 SP - 69-81 PB - Hogrefe & Huber CY - Göttingen SN - 1614-0001 UR - https://fis.uni-bamberg.de/handle/uniba/2363 LA - eng ER - TY - JOUR TI - Linking PISA 2000 and PISA 2009: Implications of instrument design on measurement invariance AU - Carstensen, Claus H. AU - Wetzel, Eunike PY - 2013 JO - Psychological test and assessment modeling VL - 55 IS - 2 SP - 181-206 PB - Pabst CY - Lengerich [u.a.] SN - 2190-0493 UR - https://fis.uni-bamberg.de/handle/uniba/2362 LA - eng ER - TY - JOUR TI - Scaling of competence tests in the National Educational Panel Study – Many questions, some answers, and further challenges AU - Pohl, Steffi AU - Carstensen, Claus H. PY - 2013 JO - Journal for educational research online : JERO = Journal für Bildungsforschung online VL - 5 IS - 2 SP - 189-216 PB - Waxmann CY - Münster SN - 1866-6671 UR - https://fis.uni-bamberg.de/handle/uniba/2358 LA - eng ER - TY - JOUR TI - Including students with special educational needs into large-scale assessments of competencies : Challenges and approaches with the German National Educational Panel Study (NEPS) AU - Heydrich, Jana AU - Weinert, Sabine AU - Nusser, Lena AU - Artelt, Cordula AU - Carstensen, Claus PY - 2013 JO - Journal for educational research online : JERO VL - 5 IS - 2 SP - 217-240 PB - Waxmann CY - Münster SN - 1866-6671 UR - https://fis.uni-bamberg.de/handle/uniba/2216 LA - eng ER - TY - JOUR TI - Assessing competencies across the lifespan within the German National Educational Panel Study (NEPS) : Editorial AU - Artelt, Cordula AU - Weinert, Sabine AU - Carstensen, Claus H. PY - 2013 JO - Journal for educational research online : JERO VL - 5 IS - 2 SP - 5-14 PB - Waxmann CY - Münster SN - 1866-6671 UR - https://fis.uni-bamberg.de/handle/uniba/2205 LA - eng ER - TY - JOUR TI - Fitting the Mixed Rasch Model to a Reading Comprehension Test: Identifying Reader Types AU - Carstensen, Claus H. AU - Baghaei, Purya PY - 2013 JO - Practical assessment, research and evaluation : PARE ; a peer-reviewed electronic journal VL - 18 IS - 5 CY - College Park, Md. SN - 1531-7714 UR - https://fis.uni-bamberg.de/handle/uniba/1985 LA - eng ER - TY - THES TI - Investigating response styles and item homogeneity using item response models AU - Wetzel, Eunike PY - 2013 PB - opus CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/1852 LA - eng AB - Measurement invariance is a pre-requisite for drawing accurate and valid inferences concerning individuals’ trait levels from questionnaire data. However, several factors exist that can influence a person’s item responses in addition to his or her latent trait level. The research in this dissertation was aimed at investigating three of these factors: 1) individual differences in response styles, 2) the measurement invariance of items between subgroups of respondents, and 3) the measurement invariance of items across assessment periods. Mixed Rasch analyses of data from the German NEO-PI-R showed that respondents differed systematically in their response scale use: some preferred extreme categories while others preferred moderate categories. Multidimensional item response models showed that response styles (especially extreme response style) explained variance in item responses that was incremental to the variance explained by the traits. Thus, individual differences in response styles had an influence on item responses. The measurement invariance of items between subgroups of respondents was investigated with respect to differential item functioning for gender in the German NEO-PI-R. Several NEO-PI-R facets especially on neuroticism, agreeableness, and conscientiousness contained items that were not measurement invariant for men and women. The measurement invariance of items across assessment periods was investigated for link items from the reading and science domains in the Programme for International Student Assessment (PISA). Measurement invariance was violated for both item sets. Some items showed large differences in item difficulty between assessments which may in part be attributed to changes in item wording and position effects. In sum, it was shown that individual differences in response styles, the lack of measurement invariance of items between subgroups of respondents, and the lack of measurement invariance of items across assessment periods can impair the measurement of the intended traits and in consequence render trait inferences and comparisons between individuals or groups invalid. Thus, measures should be taken to reduce the impact of factors that interfere with measurement invariance. These measures can be aimed at test construction where, for example, the item or response format can be adjusted to elicit response styles to a lesser degree and items can be selected that have invariance properties across subgroups of participants and across assessment periods. KW - response styles KW - item response models KW - measurement invariance ER - TY - CHAP TI - Linking PISA Competencies over Three Cycles – Results from Germany AU - Carstensen, Claus H. PY - 2013 T2 - Research on PISA : research outcomes of the PISA Research Conference 2009 SP - 199-213 PB - Springer CY - Dordrecht [u.a.] SN - 978-94-007-4457-8 DO - 10.1007/978-94-007-4458-5_12 UR - https://fis.uni-bamberg.de/handle/uniba/1765 LA - eng ER - TY - JOUR TI - Consistency of extreme response style and non-extreme response style across traits AU - Wetzel, Eunike AU - Carstensen, Claus H. AU - Böhnke, Jan R. PY - 2012 JO - Journal of Research in Personality VL - 47 IS - (2013), 2 SP - 178-189 PB - Elsevier CY - Amsterdam [u.a.] SN - 0092-6566 DO - 10.1016/j.jrp.2012.10.010 UR - https://fis.uni-bamberg.de/handle/uniba/21911 LA - eng ER - TY - GEN TI - NEPS Technical Report - Scaling the Data of the Competence Tests AU - Pohl, Steffi AU - Carstensen, Claus H. PY - 2012 PB - NEPS CY - Bamberg T3 - NEPS Working Papers/Survey Papers UR - https://fis.uni-bamberg.de/handle/uniba/1751 LA - eng ER - TY - JOUR TI - Alltagssituationen und Experimente: Was sind geeignete naturwissenschaftliche Lerngelegenheiten für Kindergartenkinder? AU - Steffensky, Mirjam AU - Lankes, Eva-Maria AU - Carstensen, Claus H. AU - Nölke, Christina PY - 2012 JO - Zeitschrift für Erziehungswissenschaft : ZfE VL - 15 IS - 1 SP - 37-54 PB - Springer VS CY - Wiesbaden SN - 1434-663X DO - 10.1007/s11618-012-0262-3 UR - https://fis.uni-bamberg.de/handle/uniba/1315 LA - deu ER - TY - CHAP TI - Modellierung von längsschnittlichen Daten am Beispiel einer quasi-experimentellen Studie zur Erfassung von naturwissenschaftlichen Kompetenzen im Kindergartenalter AU - Carstensen, Claus H. AU - Lankes, Eva-Maria AU - Steffensky, Mirjam PY - 2012 T2 - Item-Response-Modelle in der sozialwissenschaftlichen Forschung SP - 109-126 PB - Regener CY - Berlin SN - 978-3-936014-29-7 UR - https://fis.uni-bamberg.de/handle/uniba/1288 LA - deu ER - TY - CHAP TI - Was bedeutet naturwissenschaftliche Kompetenz bei Fünfjährigen und wie kann man sie erfassen? AU - Steffensky, Mirjam AU - Lankes, Eva-Maria AU - Carstensen, Claus H. PY - 2012 T2 - Mixed Methods in der empirischen Bildungsforschung : AEPF Jena, 2010 SP - 107-119 PB - Waxmann CY - Münster [u.a.] SN - 978-3-8309-2485-2 UR - https://fis.uni-bamberg.de/handle/uniba/1290 LA - deu ER - TY - JOUR TI - Measuring Learning and Change in a Longitudinal Large-Scale Assessment with a General Latent Variable Model AU - von Davier, Matthias AU - Xu, Xueli AU - Carstensen, Claus H. PY - 2011 JO - Psychometrika : a journal of quantitative psychology VL - 76 IS - 2 SP - 318-336 PB - Springer Science + Business Media CY - New York, NY SN - 0033-3123 UR - https://fis.uni-bamberg.de/handle/uniba/40841 LA - eng ER - TY - JOUR TI - Ein Modell zur Erfassung naturwissenschaftlicher Kompetenz im Kindergarten AU - Carstensen, Claus H. AU - Lankes, Eva-Maria AU - Steffensky, Mirjam PY - 2011 JO - Zeitschrift für Erziehungswissenschaft : ZfE VL - 14 IS - 4 SP - 651-669 SN - 1434-663X UR - https://fis.uni-bamberg.de/handle/uniba/5007 LA - deu ER - TY - JOUR TI - Das didaktische Potential von Materialien zum Experimentieren mit Kindern im Vorschulalter AU - Lankes, E. M. AU - Steffensky, M. AU - Carstensen, Claus H. PY - 2011 JO - Zeitschrift für Grundschulforschung : ZfG ; Bildung im Elementar- und Primarbereich VL - 4 IS - 1 SP - 86 - 99 SN - 1865-3553 UR - https://fis.uni-bamberg.de/handle/uniba/4961 LA - deu ER - TY - JOUR TI - Measuring Growth in a Longitudinal Large-Scale Assessment with a General Latent Variable Model AU - von Davier, Matthias AU - Xu, Xueli AU - Carstensen, Claus H. PY - 2011 JO - Psychometrika VL - 76 IS - 2 SP - 318-336 SN - 0033-3123 UR - https://fis.uni-bamberg.de/handle/uniba/4960 LA - eng ER - TY - JOUR TI - The Role of Content and Context in PISA Interest Scales: A study of the embedded interest items in the PISA 2006 science assessment AU - Drechsel, Barbara AU - Carstensen, Claus H. AU - Prenzel, Manfred PY - 2011 JO - International journal of science education : IJSE VL - 33 IS - 1 = Special Issue: Students' Interest in Science across the World: Findings from the PISA study SP - 73 - 95 SN - 2154-8455 DO - 10.1080/09500693.2010.518646 UR - https://fis.uni-bamberg.de/handle/uniba/4964 LA - eng ER - TY - CHAP TI - Development of competencies across the life span AU - Weinert, Sabine AU - Artelt, Cordula AU - Prenzel, Manfred AU - Senkbeil, Martin AU - Ehmke, Timo AU - Carstensen, Claus H. PY - 2011 T2 - Education as a lifelong process : the German National Educational Panel Study (NEPS) SP - 67 - 86 CY - Wiesbaden SN - 9783531177854 UR - https://fis.uni-bamberg.de/handle/uniba/4377 LA - eng ER - TY - JOUR TI - Effects of grade retention on achievement and self- concept in science and mathematics AU - Ehmke, Timo AU - Drechsel, Barbara AU - Carstensen, Claus H. PY - 2010 JO - Studies in Educational Evaluation : SEE VL - 36 IS - 1-2, , March-June SP - 27 - 35 SN - 0191-491X UR - https://fis.uni-bamberg.de/handle/uniba/4099 LA - eng ER - TY - CHAP TI - Item-Response-Modelle für kategoriale Daten = Item- Response Models for Categorical Data AU - Carstensen, Claus H. PY - 2010 T2 - Handbuch Statistik, Methoden und Evaluation SP - 660-666 CY - Göttingen u.a. SN - 978-3-8017-1848-0 UR - https://fis.uni-bamberg.de/handle/uniba/3440 LA - deu ER - TY - CHAP TI - Kann man große Klassen erfolgreich unterrichten? AU - Lankes, Eva-Maria AU - Carstensen, Claus H. PY - 2010 T2 - IGLU 2006 - die Grundschule auf dem Prüfstand : vertiefende Analysen zu Rahmenbedingungen schulischen Lernens SP - 121 - 142 PB - Waxmann CY - Münster u.a. SN - 978-3-8309-2340-4 UR - https://fis.uni-bamberg.de/handle/uniba/3428 LA - deu ER - TY - RPRT TI - Assessment Drives Learning: The Effect of Central Exit Exams on Curricular Knowledge and Mathematical Literacy AU - Jürges, Hendrik AU - Schneider, Kerstin AU - Senkbeil, Martin AU - Carstensen, Claus H. PY - 2009 PB - CESifo CY - München T3 - CESifo Working Paper UR - https://fis.uni-bamberg.de/handle/uniba/19497 LA - eng ER - TY - JOUR TI - Diagnostic Classification Models and Multidimensional Adaptive Testing : A Commentary on Rupp and Templin AU - Carstensen, Claus H. AU - Frey, Andreas PY - 2009 JO - Measurement: Interdisciplinary Research & Perspective VL - 7 IS - 1 SP - 58 - 61 SN - 1536-6359 UR - https://fis.uni-bamberg.de/handle/uniba/19498 LA - eng ER - TY - JOUR TI - Performance and levels of contextualization in a selection of OECD countries in PISA 2006 AU - Nentwig, Peter AU - Roennebeck, Silke AU - Schoeps, Katrin AU - Rumann, Stefan AU - Carstensen, Claus H. PY - 2009 JO - Journal of research in science teaching : JRST : the official journal of the National Association for Research in Science Teaching VL - 46 IS - 8 = Special Issue: Scientific Literacy and Contexts in PISA Science SP - 897 - 908 SN - 0022-4308 UR - https://fis.uni-bamberg.de/handle/uniba/19499 LA - deu ER - TY - RPRT TI - Using the General Diagnostic Model to Measure Learning and Change in a longitudinal Large-Scale Assessment AU - Carstensen, Claus H. AU - Davier, Matthias von AU - Xu, Xueli PY - 2009 PB - Educational Testing Service CY - Princeton, NJ T3 - ETS research report DO - 10.1002/j.2333-8504.2009.tb02185.x UR - https://fis.uni-bamberg.de/handle/uniba/19514 LA - deu ER - TY - JOUR TI - Grade repetition in PISA-I-Plus: What do students who repeat a class learn in mathematics? AU - Ehmke, Timo AU - Drechsel, Barbara AU - Carstensen, Claus H. PY - 2008 JO - Zeitschrift für Erziehungswissenschaft VL - 11 IS - 3 SP - 368-387 PB - Springer CY - Berlin ; Heidelberg SN - 1862-5215 UR - https://fis.uni-bamberg.de/handle/uniba/40826 LA - eng ER - TY - CHAP TI - Trendanalysen in PISA: Wie haben sich die Kompetenzen in Deutschland zwischen PISA 2000 und PISA 2006 entwickelt? AU - Carstensen, Claus H. AU - Prenzel, Manfred AU - Baumert, Jürgen PY - 2008 T2 - Vertiefende Analysen zu PISA 2006 SP - 11-34 CY - Wiesbaden ET - 1 SN - 978-3-531-15929-4 UR - https://fis.uni-bamberg.de/handle/uniba/19546 LA - deu ER - TY - CHAP TI - Linking Competencies in Horizontal, Vertical and Longitudinal Settings and Measuring Growth AU - Von Davier, A. A. AU - Carstensen, Claus H. AU - von Davier, Matthias PY - 2008 T2 - Assessment of competencies in educational contexts SP - 121 - 150 CY - Cambridge, Mass. u.a. SN - 978-0-88937-297-9 UR - https://fis.uni-bamberg.de/handle/uniba/19542 LA - eng ER - TY - CHAP TI - Der Blick in die Länder AU - Prenzel, Manfred AU - Schütte, Kerstin AU - Rönnebeck, Silke AU - Senkbeil, Martin AU - Schöps, Katrin AU - Carstensen, Claus H. PY - 2008 T2 - PISA 2006 in Deutschland : die Kompetenzen der Jugendlichen im dritten Ländervergleich SP - 149 - 263 PB - Waxmann CY - Münster u.a. SN - 978-3-8309-2099-1 UR - https://fis.uni-bamberg.de/handle/uniba/19501 LA - deu ER - TY - CHAP TI - Explanatory Item Response Models: A brief Introduction AU - Wilson, M. AU - DeBoeck, P. AU - Carstensen, Claus H. PY - 2008 T2 - Assessment of competencies in educational contexts SP - 91 - 120 CY - Cambridge, Mass. u.a. SN - 978-0-88937-297-9 UR - https://fis.uni-bamberg.de/handle/uniba/19506 LA - eng ER - TY - JOUR TI - Klassenwiederholen in PISA-I-Plus: Was lernen Sitzenbleiber in Mathematik dazu? AU - Ehmke, Timo AU - Drechsel, Barbara AU - Carstensen, Claus H. PY - 2008 JO - Zeitschrift für Erziehungswissenschaft : ZfE VL - 11 IS - 3, Oktober SP - 368 - 387 SN - 1434-663X UR - https://fis.uni-bamberg.de/handle/uniba/19507 LA - deu ER - TY - CHAP TI - Methodische Grundlagen des Ländervergleichs AU - Frey, Andreas AU - Carstensen, Claus H. AU - Walter, Oliver AU - Rönnebeck, Silke AU - Gomolka, Jens PY - 2008 T2 - PISA 2006 in Deutschland : die Kompetenzen der Jugendlichen im dritten Ländervergleich SP - 375 - 397 PB - Waxmann CY - Münster u.a. SN - 978-3-8309-2099-1 UR - https://fis.uni-bamberg.de/handle/uniba/19504 LA - deu ER - TY - CHAP TI - PISA 2006 - eine Einführung in den Ländervergleich AU - Prenzel, Manfred AU - Rönnebeck, Silke AU - Carstensen, Claus H. PY - 2008 T2 - PISA 2006 in Deutschland : die Kompetenzen der Jugendlichen im dritten Ländervergleich SP - 31 - 63 PB - Waxmann CY - Münster u.a. SN - 978-3-8309-2099-1 UR - https://fis.uni-bamberg.de/handle/uniba/19502 LA - deu ER - TY - CHAP TI - Der Leseunterricht aus der Sicht der Lehrkräfte AU - Lankes, Eva-Maria AU - Carstensen, Claus H. PY - 2007 T2 - IGLU 2006 : Lesekompetenzen von Grundschulkindern in Deutschland im internationalen Vergleich SP - 161 - 194 PB - Waxmann CY - Münster u.a. SN - 9783830919193 UR - https://fis.uni-bamberg.de/handle/uniba/19553 LA - deu ER - TY - CHAP TI - Mathematische Kompetenz AU - Frey, A. AU - Asseburg, R. AU - Carstensen, Claus H. AU - Ehmke, T. AU - Blum, W. PY - 2007 T2 - PISA 2006 : die Ergebnisse der dritten internationalen Vergleichsstudie SP - 249 - 276 CY - Münster u.a. SN - 978-3-8309-1900-1 UR - https://fis.uni-bamberg.de/handle/uniba/19550 LA - deu ER - TY - CHAP TI - Multidimensional Three-Mode Rasch Models AU - Carstensen, Claus H. AU - Rost, Jürgen PY - 2007 T2 - Multivariate and mixture distribution Rasch models : extensions and applications SP - 157 - 176 CY - Berlin ET - 1. ed. SN - 978-0-387-49839-3 UR - https://fis.uni-bamberg.de/handle/uniba/19539 LA - eng ER - TY - CHAP TI - Application of Multivariate Rasch Models in International Large Scale Survey Assessments AU - Adams, R. J. AU - Wu, Margaret AU - Carstensen, Claus H. PY - 2007 T2 - Multivariate and mixture distribution Rasch models : extensions and applications SP - 271 - 280 CY - Berlin ET - 1. ed. SN - 978-0-387-49839-3 DO - 10.1007/978-0-387-49839-3 UR - https://fis.uni-bamberg.de/handle/uniba/19492 LA - deu ER - TY - CHAP TI - Assessment to improve learning in mathematics : The BEAR Assessment system AU - Wilson, M. AU - Carstensen, Claus H. PY - 2007 T2 - Assessing mathematical proficiency SP - 311 - 332 CY - Cambridge u.a. SN - 9780511755378 UR - https://fis.uni-bamberg.de/handle/uniba/19510 LA - eng ER - TY - CHAP TI - Die Naturwissenschaftliche Kompetenz bei Schülerinnen und Schülern in Deutschland ; 3.1. Naturwissenschaftliche Kompetenz im internationalen Vergleich AU - Senkbeil, M. AU - Prenzel, Manfred AU - Schöps, K. AU - Rönnebeck, S. AU - Walter, O. AU - Carstensen, Claus H. AU - Hammann, M. PY - 2007 T2 - PISA 2006 : die Ergebnisse der dritten internationalen Vergleichsstudie SP - 63 - 106 CY - Münster u.a. SN - 978-3-8309-1900-1 UR - https://fis.uni-bamberg.de/handle/uniba/19509 LA - deu ER - TY - CHAP TI - Introduction: Extending the Rasch Model AU - von Davier, Matthias AU - Carstensen, Claus H. AU - Rost, Jürgen PY - 2007 T2 - Multivariate and mixture distribution Rasch models : extensions and applications SP - 1 - 14 CY - Berlin ET - 1. ed. SN - 978-0-387-49839-3 UR - https://fis.uni-bamberg.de/handle/uniba/19493 LA - eng ER - TY - BOOK TI - Multivariate and mixture distribution Rasch models : extensions and applications AU - Carstensen, Claus H. AU - Davier, Matthias von PY - 2007 PB - Springer CY - New York u.a. T3 - Statistics for social science and behavorial sciences UR - https://fis.uni-bamberg.de/handle/uniba/19494 LA - eng ER - TY - CHAP TI - PISA 2006 - eine Einführung in die Studie AU - Prenzel, Manfred AU - Drechsel, Barbara AU - Rönnebeck, S. AU - Frey, A. AU - Carstensen, Claus H. AU - Schütte, K. PY - 2007 T2 - PISA 2006 : die Ergebnisse der dritten internationalen Vergleichsstudie SP - 31 - 60 CY - Münster u.a. SN - 978-3-8309-1900-1 UR - https://fis.uni-bamberg.de/handle/uniba/19511 LA - deu ER - TY - CHAP TI - Technische Grundlagen des dritten internationalen Vergleichs AU - Carstensen, Claus H. AU - Frey, Andreas AU - Walter, O. AU - Knoll, S. PY - 2007 T2 - PISA 2006 : die Ergebnisse der dritten internationalen Vergleichsstudie SP - 367 - 390 CY - Münster u.a. SN - 978-3-8309-1900-1 UR - https://fis.uni-bamberg.de/handle/uniba/19505 LA - deu ER - TY - CHAP TI - Einführung in den Ländervergleich PISA 2003 AU - Prenzel, Manfred AU - Drechsel, Barbara AU - Carstensen, Claus H. PY - 2005 T2 - PISA 2003 : der zweite Vergleich der Länder in Deutschland - was wissen und können Jugendliche? SP - 13 - 50 PB - Waxmann CY - Münster ; München u.a. SN - 978-3-8309-1560-7 UR - https://fis.uni-bamberg.de/handle/uniba/20499 LA - deu ER - TY - JOUR TI - Stichwort: PISA-E : die deutschen Länder im internationalen Vergleich AU - Carstensen, Claus H. AU - Drechsel, Barbara PY - 2005 JO - Zeitschrift für Erziehungswissenschaft : ZfE VL - 8 IS - 4 SP - 487 - 501 SN - 1434-663X UR - https://fis.uni-bamberg.de/handle/uniba/20486 LA - deu ER - TY - CHAP TI - PISA 2003 - Eine Einführung AU - Prenzel, Manfred AU - Drechsel, Barbara AU - Carstensen, Claus H. AU - Ramm, Gesa PY - 2004 T2 - PISA 2003 : der Bildungsstand der Jugendlichen in Deutschland - Ergebnisse des zweiten internationalen Vergleichs SP - 13 - 46 CY - Münster ; München u.a. SN - 978-3-8309-1455-6 UR - https://fis.uni-bamberg.de/handle/uniba/20503 LA - deu ER - TY - JOUR TI - Untersuchungsgegenstand, Fragestellung und technische Grundlagen der Studie AU - Baumert, Jürgen AU - Artelt, Cordula AU - Carstensen, Claus H. AU - Sibberns, Heiko AU - Stanat, Petra PY - 2002 JO - PISA 2000 : die Länder der Bundesrepublik Deutschland im Vergleich SP - 11-38 PB - Leske + Budrich CY - Opladen UR - https://fis.uni-bamberg.de/handle/uniba/21916 LA - deu ER -