Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corpora

Publication

Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corpora

Plaza-del-Arco, Flor Miriam; Martín-Valdivia, María-Teresa; Klinger, Roman (2024): Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corpora, in: Bamberg: Otto-Friedrich-Universität, S. 6805–6817.

Details

Faculty/Chair
Faculty/Professorship
Author
Plaza-del-Arco, Flor Miriam
Martín-Valdivia, María-Teresa
Publisher Information
Otto-Friedrich-Universität : Bamberg
Year of publication
2024
Source/Other editions
Proceedings of the 29th International Conference on Computational Linguistics / Nicoletta Calzolari, Chu-Ren Huang, Hansaem Kim, James Pustejovsky, Leo Wanner, Key-Sun Choi, Pum-Mo Ryu, Hsin-Hsi Chen, Lucia Donatelli, Heng Ji, Sadao Kurohashi, Patrizia Paggio, Nianwen Xue, Seokhwan Kim, Younggyun Hahm, Zhong He, Tony Kyungil Lee, Enrico Santus, Francis Bond, Seung-Hoon Na (Hg.). - Gyeongju : International Committee on Computational Linguistics, 2022, S. 6805–6817.
Year of first publication
2022
Language
English
Licence
URN
Abstract

Within textual emotion classification, the set of relevant labels depends on the domain and application scenario and might not be known at the time of model development. This conflicts with the classical paradigm of supervised learning in which the labels need to be predefined. A solution to obtain a model with a flexible set of labels is to use the paradigm of zero-shot learning as a natural language inference task, which in addition adds the advantage of not needing any labeled training data. This raises the question how to prompt a natural language inference model for zero-shot learning emotion classification. Options for prompt formulations include the emotion name anger alone or the statement “This text expresses anger”. With this paper, we analyze how sensitive a natural language inference-based zero-shot-learning classifier is to such changes to the prompt under consideration of the corpus: How carefully does the prompt need to be selected? We perform experiments on an established set of emotion datasets presenting different language registers according to different sources (tweets, events, blogs) with three natural language inference models and show that indeed the choice of a particular prompt formulation needs to fit to the corpus. We show that this challenge can be tackled with combinations of multiple prompts. Such ensemble is more robust across corpora than individual prompts and shows nearly the same performance as the individual best prompt for a particular corpus.

GND Keywords
Computerlinguistik
Maschinelle Sprachverarbeitung
Inferenz <Künstliche Intelligenz>
Gefühl
Keywords
Natural Language Inference Prompts
DDC Classification
004 Computer science
RVK Classification
ST 306
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
yes
Type
Conferenceobject
URI
Activation date
2024-08-19
Project(s)

Permalink: https://fis.uni-bamberg.de/handle/uniba/96460 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-15

Restricted read-only access: login, editing and submission are temporarily disabled.