Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Validating process variables of sourcing in an assessment of multiple document comprehension

Publication

Validating process variables of sourcing in an assessment of multiple document comprehension

Hahnel, Carolin; Kröhne, Ulf; Goldhammer, Frank; u. a. (2025): Validating process variables of sourcing in an assessment of multiple document comprehension, in: Bamberg: Otto-Friedrich-Universität, S. 524–537.

Details

Faculty/Chair
Faculty/Professorship
Author
Hahnel, Carolin
Kröhne, Ulf
Goldhammer, Frank
Mahlow, Nina
Publisher Information
Otto-Friedrich-Universität : Bamberg
Year of publication
2025
Source/Other editions
British journal of educational psychology, Oxford: Wiley-Blackwell, 2019 Jg. 89, Nr. 3, S. 524–537, ISSN: 0007-0998, 2044-8279
Year of first publication
2019
Language
English
Licence
URN
Abstract

Background: With digital technologies, competence assessments can provide process data, such as mouse clicks with corresponding timestamps, as additional information about the skills and strategies of test takers. However, in order to use variables generated from process data sensibly for educational purposes, their interpretation needs to be validated with regard to their intended meaning.

Aims: This study seeks to demonstrate how process data from an assessment of multiple document comprehension can be used to represent sourcing, which summarizes activities for the consideration of the origin and intention of documents. The investigated process variables were created according to theoretical assumptions about sourcing, and systematically tested for differences between persons, units (i.e., documents and items), and properties of the test administration.

Sample: The sample included 310 German university students (79.4% female), enrolled in several bachelor's or master's programmes of the social sciences and humanities.

Methods: Regarding the hierarchical data structure, the hypotheses were analysed with generalized linear mixed models (GLMM).

Results: The results mostly revealed expected differences between individuals and units. However, unexpected effects of the administered order of units and documents were detected.

Conclusions: The study demonstrates the theory-informed construction of process variables from log-files and an approach for empirical validation of their interpretation. The results suggest that students apply sourcing for different reasons, but also stress the need of further validation studies and refinements in the operationalization of the indicators investigated.

Keywords
validation
process variables
log-files
multiple document comprehension
sourcing
DDC Classification
150 Psychology
RVK Classification
CP 2000
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
yes
Type
Article
URI
Activation date
2025-12-01

Permalink: https://fis.uni-bamberg.de/handle/uniba/110552 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.