Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Multilevel Design Parameters to Plan Cluster-Randomized Intervention Studies on Student Achievement in Elementary and Secondary School

Publication

Multilevel Design Parameters to Plan Cluster-Randomized Intervention Studies on Student Achievement in Elementary and Secondary School

Stallasch, Sophie E.; Lüdtke, Oliver; Artelt, Cordula; u. a. (2021): Multilevel Design Parameters to Plan Cluster-Randomized Intervention Studies on Student Achievement in Elementary and Secondary School, in: Journal of research on educational effectiveness, Abingdon: Routledge, Taylor & Francis, Jg. 14, Nr. 1, S. 172–206, doi: 10.1080/19345747.2020.1823539.

Details

Faculty/Chair
Faculty/Professorship
Author
Stallasch, Sophie E.
Lüdtke, Oliver
Brunner, Martin
Title of the Journal
Journal of research on educational effectiveness
ISSN
1934-5747
Corporate Body
Society for Research on Educational Effectiveness (SREE)
Publisher Information
Routledge, Taylor & Francis : Abingdon
Year of publication
2021
Volume
14
Issue
1
Language
English
DOI
Abstract

To plan cluster-randomized trials with sufficient statistical power todetect intervention effects on student achievement, researchers needmultilevel design parameters, including measures of between-class-room and between-school differences and the amounts of varianceexplained by covariates at the student, classroom, and school level.Previous research has mostly been conducted in the United States,focused on two-level designs, and limited to core achievementdomains (i.e., mathematics, science, reading). Using representativedata of students attending grades 1–12 from three German longitu-dinal large-scale assessments (3,963 ≤ N ≤ 14,640), we used three-and two-level latent (covariate) models to provide design parametersand corresponding standard errors for a broad array of domain-spe-cific (e.g., mathematics, science, verbal skills) and domain-general(e.g., basic cognitive functions) achievement outcomes. Three covari-ate sets were applied comprising (a) pretest scores, (b) sociodemo-graphic characteristics, and (c) their combination. Design parametersvaried considerably as a function of the hierarchical level, achieve-ment outcome, and grade level. Our findings demonstrate the needto strive for an optimal fit between design parameters and targetresearch context. We illustrate the application of design parametersin power analyses.

GND Keywords
Schulleistungsmessung
Keywords
Intraclass correlation
explained variance
large-scale assessment
multilevellatent (covariate) model
power analysis
DDC Classification
370 Education
RVK Classification
DO 1251
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
yes
Type
Article
URI
Activation date
2021-12-21

Permalink: https://fis.uni-bamberg.de/handle/uniba/52516 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.