Zum Inhalt springen

Nur-Lesen-Fassung: Das Forschungsinformationssystem (FIS) ist aus Sicherheitsgründen vorübergehend durch diese Nur-Lesen-Fassung ersetzt. Alle öffentlichen Inhalte und Volltexte sind weiterhin abrufbar; Anmeldung, Bearbeitung, Einreichung und Statistiken stehen nicht zur Verfügung. Bei Fragen: fis@uni-bamberg.de

Start › Publikationen › Identifying Disengaged Responding in Multiple-Choice Items : Extending a Latent Class Item Response Model With Novel Process Data Indicators

Publikation

Identifying Disengaged Responding in Multiple-Choice Items : Extending a Latent Class Item Response Model With Novel Process Data Indicators

Welling, Jana; Gnambs, Timo; Carstensen, Claus H. (2024): Identifying Disengaged Responding in Multiple-Choice Items : Extending a Latent Class Item Response Model With Novel Process Data Indicators, in: Bamberg: Otto-Friedrich-Universität, S. 314–339.

Details

Fakultät/Lehrstuhl
Autorin(nen)/Autor(en)
Gnambs, Timo
Verlagsangabe
Otto-Friedrich-Universität : Bamberg
Erscheinungsjahr
2024
Quelle/Weitere Ausgabe
Educational and psychological measurement : EPM, 84 (2024), 2, S. 314-339. - ISSN: 0013-1644, 1552-3888
Jahr der Erstpublikation
2024
Sprache(n)
Englisch
Lizenz
URN
Abstract

Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses. Process data with its rich pool of additional information on the test-taking process could thus be used to improve existing identification approaches. In this study, three process data variables—text reread, item revisit, and answer change—were introduced as potential indicators of response engagement for multiple-choice items in a reading comprehension test. An extended latent class item response model for disengaged responding was developed by including the three new indicators as additional predictors of response engagement. In a sample of 1,932 German university students, the extended model indicated a better model fit than the baseline model, which included item response time as only indicator of response engagement. In the extended model, both item response time and text reread were significant predictors of response engagement. However, graphical analyses revealed no systematic differences in the item and person parameter estimation or item response classification between the models. These results suggest only a marginal improvement of the identification of disengaged responding by the new indicators. Implications of these results for future research on disengaged responding with process data are discussed.

Freie Schlagwort(e)
disengaged responding
rapid guessing
process data
item response theory
computer-based assessments
multiple-choice items
DDC-Klassifikation
150 Psychologie
RVK-Klassifikation
CS 1500
Dokumenttyp
Artikel in einer Zeitschrift / Postprint
URI
Datum der Freischaltung
11.06.2024

Permalink: https://fis.uni-bamberg.de/handle/uniba/95700 · Daten als JSON · Zitieren: BibTeX · RIS

Datenstand: 15.11.2026

Eingeschränkter Lesezugriff: Anmeldung, Bearbeitung und Einreichung sind vorübergehend deaktiviert.