Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Comparing Different Approaches of (Not) Accounting for Rapid Guessing in Plausible Values Estimation

Publication

Comparing Different Approaches of (Not) Accounting for Rapid Guessing in Plausible Values Estimation

Welling, Jana; Zink, Eva; Gnambs, Timo (2026): Comparing Different Approaches of (Not) Accounting for Rapid Guessing in Plausible Values Estimation, in: Educational and psychological measurement : EPM, Thousand Oaks, Calif. [u.a.]: Sage Periodicals, Jg. 86, Nr. 4, S. 792–821, doi: 10.1177/00131644251395590.

Details

Faculty/Chair
Faculty/Professorship
Author
Gnambs, Timo
Title of the Journal
Educational and psychological measurement : EPM
ISSN
1552-3888
0013-1644
Publisher Information
Sage Periodicals : Thousand Oaks, Calif. [u.a.]
Year of publication
2026
Volume
86
Issue
4
Language
English
DOI
Abstract

Educational large-scale assessments provide information on ability differences between groups, informing policies and shaping educational decisions. However, some of these differences might partly reflect variations in test-taking motivation rather than in actual abilities. Existing approaches for mitigating the distorting effects of rapid guessing focus mainly on point estimates of abilities, although research questions often refer to latent variables. The present study seeks to (a) determine the bias introduced by rapid guessing in group comparisons based on plausible value estimates and (b) introduce and evaluate different approaches of handling rapid guessing in the estimation of plausible values. In a simulation study, four models were compared: (1) a baseline model did not account for rapid guessing, (2) a person-level model incorporated rapid guessing as a respondent characteristic in the background model, (3) a response-level model filtered responses with item response times lower than a predetermined threshold, and (4) a combined model merged the person- and response-level approaches. Results show that the response-level and combined model performed best while accounting for rapid guessing on the person level did not suffice. An empirical example using data from a German large-scale assessment (N = 478) demonstrates the applicability of all approaches in practice. Recommendations for future research are given to improve ability estimation.

Keywords
rapid guessing
plausible values
large-scale assessments
test-taking engagement
engagement gap
ability comparisons
DDC Classification
150 Psychology
RVK Classification
CS 4000
Type
Article
URI
Activation date
2026-07-31

Permalink: https://fis.uni-bamberg.de/handle/uniba/116522 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-15

Restricted read-only access: login, editing and submission are temporarily disabled.