Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

Publication

Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

Hofmann, Jan; Troiano, Enrica; Klinger, Roman (2021): Emotion-Aware, Emotion-Agnostic, or Automatic : Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations, in: Orphée De Clercq, Alexandra Balahur, João Sedoc, u. a. (Hrsg.), Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, Association for Computational Linguistics, S. 160–170.

Details

Author
Hofmann, Jan
Troiano, Enrica
Title of the compilation
Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis
Editors
De Clercq, Orphée
Balahur, Alexandra
Sedoc, João
Barriere, Valentin
Tafreshi, Shabnam
Buechel, Sven
Hoste, Veronique
Conference
Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis
Publisher Information
Association for Computational Linguistics
Year of publication
2021
Language
English
URL
Abstract

Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language processing. Yet, in psychology it has been proven powerful: Smith and Ellsworth (1985) showed that the appraisal dimensions attention, certainty, anticipated effort, pleasantness, responsibility/control and situational control discriminate between (at least) 15 emotion classes. We study different annotation strategies for these dimensions, based on the event-focused enISEAR corpus (Troiano et al., 2019). We analyze two manual annotation settings: (1) showing the text to annotate while masking the experienced emotion label; (2) revealing the emotion associated with the text. Setting 2 enables the annotators to develop a more realistic intuition of the described event, while Setting 1 is a more standard annotation procedure, purely relying on text. We evaluate these strategies in two ways: by measuring inter-annotator agreement and by fine- tuning RoBERTa to predict appraisal variables. Our results show that knowledge of the emotion increases annotators’ reliability. Further, we evaluate a purely automatic rule-based labeling strategy (inferring appraisal from annotated emotion classes). Training on automatically assigned labels leads to a competitive performance of our classifier, even when tested on manual annotations. This is an indicator that it might be possible to automatically create appraisal corpora for every domain for which emotion corpora already exist.

GND Keywords
Computerlinguistik
Emotion
Korpus <Linguistik>
Keywords
Corpus Creation Strategies
DDC Classification
004 Computer science
RVK Classification
ST 306
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
yes
Type
Conferenceobject
URI
Activation date
2024-03-14
Project(s)

Permalink: https://fis.uni-bamberg.de/handle/uniba/93904 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.