Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Evaluation of keyness metrics : Performance and reliability

Publication

Evaluation of keyness metrics : Performance and reliability

Sönning, Lukas (2023): Evaluation of keyness metrics : Performance and reliability, in: Corpus Linguistics and Linguistic Theory, Berlin: de Gruyter, Jg. 20, Nr. 2, S. 263–288, doi: 10.1515/cllt-2022-0116.

Details

Faculty/Chair
Faculty/Professorship
Author
Title of the Journal
Corpus Linguistics and Linguistic Theory
ISSN
1613-7035
1613-7027
Publisher Information
de Gruyter : Berlin
Year of publication
2023
Volume
20
Issue
2
Language
English
DOI
Abstract

The methodological debates surrounding keyword analysis have given rise to a wide range of keyness metrics. The present paper delineates four dimensions of keyness, which distinguish between frequency-and dispersion-related perspectives. Existing measures are then organized according to these dimensions and evaluated with regard to their performance on a specific keyword analysis task: The identification of key verbs in academic writing. To this end, the rankings produced by 32 different metrics are evaluated against an established academic word list. Further, the reliability of measures is assessed, to determine whether they produce stable rankings across repeated studies on the same pair of text varieties. We observe notable differences among metrics with regard to these criteria. Our findings provide further support for the superiority of the Wilcoxon rank sum test and textdispersion–based measures, and allow us to identify, within each dimension of keyness, metrics that may be given preference in applied work.

GND Keywords
Korpus, Linguistik
Sprachstatistik
Keywords
keyness
keyword analysis
frequency
dispersion
methodology
DDC Classification
420 English
400 Language & linguistics
RVK Classification
HF 450
ES 900
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
no
Type
Article
URI
Activation date
2023-05-24
Research Data

Permalink: https://fis.uni-bamberg.de/handle/uniba/59524 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-15

Restricted read-only access: login, editing and submission are temporarily disabled.