Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Comparing Different Approaches of (Not) Accounting for Rapid Guessing in Plausible Values Estimation

Publication

Comparing Different Approaches of (Not) Accounting for Rapid Guessing in Plausible Values Estimation

Welling, Jana; Zink, Eva; Gnambs, Timo (2026): Comparing Different Approaches of (Not) Accounting for Rapid Guessing in Plausible Values Estimation, in: Bamberg: Otto-Friedrich-Universität, S. 792–821.

Details

Faculty/Chair
Faculty/Professorship
Author
Gnambs, Timo
Publisher Information
Otto-Friedrich-Universität : Bamberg
Year of publication
2026
Source/Other editions
Educational and psychological measurement : EPM, Thousand Oaks, Calif. [u.a.]: Sage Periodicals, 2026, Jg. 86, Nr. 4, S. 792–821, ISSN: 1552-3888, 0013-1644
Year of first publication
2026
Language
English
Licence
URN
Abstract

Educational large-scale assessments provide information on ability differences between groups, informing policies and shaping educational decisions. However, some of these differences might partly reflect variations in test-taking motivation rather than in actual abilities. Existing approaches for mitigating the distorting effects of rapid guessing focus mainly on point estimates of abilities, although research questions often refer to latent variables. The present study seeks to (a) determine the bias introduced by rapid guessing in group comparisons based on plausible value estimates and (b) introduce and evaluate different approaches of handling rapid guessing in the estimation of plausible values. In a simulation study, four models were compared: (1) a baseline model did not account for rapid guessing, (2) a person-level model incorporated rapid guessing as a respondent characteristic in the background model, (3) a response-level model filtered responses with item response times lower than a predetermined threshold, and (4) a combined model merged the person- and response-level approaches. Results show that the response-level and combined model performed best while accounting for rapid guessing on the person level did not suffice. An empirical example using data from a German large-scale assessment (N = 478) demonstrates the applicability of all approaches in practice. Recommendations for future research are given to improve ability estimation.

Keywords
rapid guessing
plausible values
large-scale assessments
test-taking engagement
engagement gap
ability comparisons
DDC Classification
150 Psychology
RVK Classification
CS 4000
Type
Article
URI
Activation date
2026-07-31

Permalink: https://fis.uni-bamberg.de/handle/uniba/116524 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.