Zum Inhalt springen

Nur-Lesen-Fassung: Das Forschungsinformationssystem (FIS) ist aus Sicherheitsgründen vorübergehend durch diese Nur-Lesen-Fassung ersetzt. Alle öffentlichen Inhalte und Volltexte sind weiterhin abrufbar; Anmeldung, Bearbeitung, Einreichung und Statistiken stehen nicht zur Verfügung. Bei Fragen: fis@uni-bamberg.de

Start › Publikationen › Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

Publikation

Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

Hofmann, Jan; Troiano, Enrica; Klinger, Roman (2025): Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations, in: Bamberg: Otto-Friedrich-Universität, S. 160–170.

Details

Fakultät/Lehrstuhl
Autorin(nen)/Autor(en)
Hofmann, Jan
Troiano, Enrica
Verlagsangabe
Otto-Friedrich-Universität : Bamberg
Erscheinungsjahr
2025
Quelle/Weitere Ausgabe
Orphée De Clercq, Alexandra Balahur, João Sedoc, u. a. (Hrsg.), Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, Association for Computational Linguistics, 2021, S. 160–170
Jahr der Erstpublikation
2021
Sprache(n)
Englisch
Lizenz
URN
Abstract

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language processing. Yet, in psychology it has been proven powerful: Smith and Ellsworth (1985) showed that the appraisal dimensions attention, certainty, anticipated effort, pleasantness, responsibility/control and situational control discriminate between (at least) 15 emotion classes. We study different annotation strategies for these dimensions, based on the event-focused enISEAR corpus (Troiano et al., 2019). We analyze two manual annotation settings: (1) showing the text to annotate while masking the experienced emotion label; (2) revealing the emotion associated with the text. Setting 2 enables the annotators to develop a more realistic intuition of the described event, while Setting 1 is a more standard annotation procedure, purely relying on text. We evaluate these strategies in two ways: by measuring inter-annotator agreement and by fine- tuning RoBERTa to predict appraisal variables. Our results show that knowledge of the emotion increases annotators’ reliability. Further, we evaluate a purely automatic rule-based labeling strategy (inferring appraisal from annotated emotion classes). Training on automatically assigned labels leads to a competitive performance of our classifier, even when tested on manual annotations. This is an indicator that it might be possible to automatically create appraisal corpora for every domain for which emotion corpora already exist.

GND-Schlagwort(e)
Computerlinguistik
Emotion
Korpus <Linguistik>
Freie Schlagwort(e)
Corpus Creation Strategies
DDC-Klassifikation
004 Computer science
RVK-Klassifikation
ST 306
Peer Reviewed
ja
Internationale Verbreitung
ja
Open-Access-Zeitschrift
ja
Dokumenttyp
Konferenzveröffentlichung
URI
Datum der Freischaltung
30.05.2025
Projekt(e)

Permalink: https://fis.uni-bamberg.de/handle/uniba/108339 · Daten als JSON · Zitieren: BibTeX · RIS

Datenstand: 15.11.2026

Eingeschränkter Lesezugriff: Anmeldung, Bearbeitung und Einreichung sind vorübergehend deaktiviert.