Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

Publication

Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

Hofmann, Jan; Troiano, Enrica; Klinger, Roman (2025): Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations, in: Bamberg: Otto-Friedrich-Universität, S. 160–170.

Details

Faculty/Chair
Faculty/Professorship
Author
Hofmann, Jan
Troiano, Enrica
Publisher Information
Otto-Friedrich-Universität : Bamberg
Year of publication
2025
Source/Other editions
Orphée De Clercq, Alexandra Balahur, João Sedoc, u. a. (Hrsg.), Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, Association for Computational Linguistics, 2021, S. 160–170
Year of first publication
2021
Language
English
Licence
URN
Abstract

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language processing. Yet, in psychology it has been proven powerful: Smith and Ellsworth (1985) showed that the appraisal dimensions attention, certainty, anticipated effort, pleasantness, responsibility/control and situational control discriminate between (at least) 15 emotion classes. We study different annotation strategies for these dimensions, based on the event-focused enISEAR corpus (Troiano et al., 2019). We analyze two manual annotation settings: (1) showing the text to annotate while masking the experienced emotion label; (2) revealing the emotion associated with the text. Setting 2 enables the annotators to develop a more realistic intuition of the described event, while Setting 1 is a more standard annotation procedure, purely relying on text. We evaluate these strategies in two ways: by measuring inter-annotator agreement and by fine- tuning RoBERTa to predict appraisal variables. Our results show that knowledge of the emotion increases annotators’ reliability. Further, we evaluate a purely automatic rule-based labeling strategy (inferring appraisal from annotated emotion classes). Training on automatically assigned labels leads to a competitive performance of our classifier, even when tested on manual annotations. This is an indicator that it might be possible to automatically create appraisal corpora for every domain for which emotion corpora already exist.

GND Keywords
Computerlinguistik
Emotion
Korpus <Linguistik>
Keywords
Corpus Creation Strategies
DDC Classification
004 Computer science
RVK Classification
ST 306
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
yes
Type
Conferenceobject
URI
Activation date
2025-05-30
Project(s)

Permalink: https://fis.uni-bamberg.de/handle/uniba/108339 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.