Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Ordinal response scales : Psychometric grounding for design and analysis

Publication

Ordinal response scales : Psychometric grounding for design and analysis

Sönning, Lukas (2025): Ordinal response scales : Psychometric grounding for design and analysis, in: Bamberg: Otto-Friedrich-Universität, S. 1–18.

Details

Faculty/Chair
Faculty/Professorship
Author
Publisher Information
Otto-Friedrich-Universität : Bamberg
Year of publication
2025
Source/Other editions
Research methods in applied linguistics : RMAL, Amsterdam: Elsevier ScienceDirect, 2024, Jg. 3, Nr. 3, 100156, S. 1–18, ISSN: 2772-7661
Year of first publication
2024
Language
English
Licence
URN
Abstract

Ordinal response scales are commonly used in applied linguistics. To summarize the distribution of ratings or judgments provided by informants, these are usually converted into numbers and then averaged or analyzed with ordinary regression models. This approach has been criticized in the literature; one caveat (among others) is the assumption that distances between categories are known. The present paper illustrates how empirical insights into the perception of response labels may inform the design and analysis stage of a study. We start with a review of how ordinal scales are used in linguistic research. Our survey offers insights into typical scale layouts and analysis strategies, and it allows us to identify three commonly used rating dimensions (agreement, intensity, and frequency). We take stock of the experimental literature on the perception of relevant scale point labels and then demonstrate how psychometric insights may direct scale design and data analysis. This includes a careful consideration of measurement-theoretic and statistical issues surrounding the numeric-conversion approach to ordinal data. We focus on the consequences of these drawbacks for the interpretation of empirical findings, which will enable researchers to make informed decisions and avoid drawing false conclusions from their data. We present a case study on yous(e) in two varieties of English, which shows that reliance on psychometric scale values can alter statistical conclusions, while also giving due consideration to the key limitations of the numeric-conversion approach to ordinal data analysis.

GND Keywords
Angewandte Linguistik
Datenauswertung
Keywords
Ordinal data
Rating scales
Acceptability judgments
Likert scale
Judgment task
Measurement
Psychological scaling
DDC Classification
400 Language & linguistics
RVK Classification
ES 900
Type
Article
URI
Activation date
2025-03-26
Project(s)

Permalink: https://fis.uni-bamberg.de/handle/uniba/107123 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.