Interaktive Prompt-Optimierung mit dem Menschen in der Schleife für die Entwicklung und Intervention von Modellen zum Verständnis natürlicher Sprache
Laufend
Information
Projektdaten
- Titel
- Interaktive Prompt-Optimierung mit dem Menschen in der Schleife für die Entwicklung und Intervention von Modellen zum Verständnis natürlicher Sprache
- Projektleitung
- Einrichtung
- Beginn
- 01.07.2024
- Kategorie
- Grundlagenforschung
Projektbeschreibung
- Akronym
- INPROMPT
- Beschreibung
The paradigm of few-shot or zero-shot learning for the creation of models in algorithmic natural language understanding assumes that little or no annotated text is available for the problem to be solved. Methods in this subject area therefore meet the challenge of relaxing the high data requirements that the optimization of deep neural networks entails. A typical approach is to use pre-trained neural language models and use a prompt to generate a word that describes an instance of text. For example, you can do sentiment polarity classification by entering a text instance such as “The person is very satisfied with the product.” associated with a prompt and check whether the sentence “The product is good” or “The product is bad” results in a higher probability.
Creating such prompts has the advantage that it does not necessarily require technical expertise, but creating good prompts is still not trivial. Existing research has approached the problem from two perspectives: (1) adapting existing language models using (few) annotated data points and manually generated prompt sets, and (2) using data-driven automatic prompt generation.
We combine these two research directions in our project and start with the typical situation in which a language comprehension task is formulated vaguely, a more precise specification is still missing, and no annotated (but certainly non-annotated) texts are available. Our goal is to develop and analyze systems that automatically guide domain experts without technical training in machine learning to create well-functioning prompts.
To do this, we use optimization methods that change prompts iteratively and estimate their quality with the help of a target function. This estimation is based on automatic predictions on text instances, based on the readability of the prompt, and based on the conclusiveness of an explanation of the decision-making. In our project, the objective function based on these factors is not automatically evaluated, but replaced by a “human in the loop”. However, in order to study the problem of iterative optimization of prompts on a larger scale, we also simulate human decisions using automatic approximations of the human objective function.
We expect that our project will significantly improve the transparency of prompt-based models and contribute to the democratization of the use of machine learning algorithms.
- Stichwörter
- large language modelspromptsoptimizationhuman in the loopnatural language processing
Förderung
| Forschungsförderer | Förderkennzeichen | URL |
|---|---|---|
| DFG Sachbeihilfe Normalverfügung | 521755488 | https://gepris.dfg.de/gepris/projekt/521755488 |
Publikationen
- Medical Summarization in Practice : Design, Deployment, and Analysis of a Clinical Summarization System for a German Hospital – Rauf, Moiz; Papay, Sean · 2026 · Konferenzveröffentlichung
- Medical Summarization in Practice : Design, Deployment, and Analysis of a Clinical Summarization System for a German Hospital – Rauf, Moiz; Papay, Sean · 2026 · Konferenzveröffentlichung
- PARL: Prompt-based Agents for Reinforcement Learning – Menchaca Resendiz, Yarik; Klinger, Roman · 2026 · Konferenzveröffentlichung
- Which Demographics do LLMs Default to During Annotation? – Schäfer, Johannes; Combs, Aidan; Bagdon, Christopher Doyle u. a. · 2026 · Konferenzveröffentlichung
- Regular-pattern-sensitive CRFs for Distant Label Interactions – Papay, Sean; Klinger, Roman; Padó, Sebastian · 2026 · Konferenzveröffentlichung
- iPrOp : Interactive Prompt Optimization for Large Language Models with a Human in the Loop – Li, Jiahui; Klinger, Roman · 2026 · Konferenzveröffentlichung
- Supporting Plain Language Summarization of Psychological Meta-Analyses with Large Language Models – Menchaca Resendiz, Yarik; Kerwer, Martin; Chasiotis, Anita u. a. · 2026 · Konferenzveröffentlichung
- Are Humans as Brittle as Large Language Models? – Li, Jiahui; Papay, Sean; Klinger, Roman · 2026 · Konferenzveröffentlichung
- Supporting Plain Language Summarization of Psychological Meta-Analyses with Large Language Models – Menchaca Resendiz, Yarik; Kerwer, Martin; Chasiotis, Anita u. a. · 2025 · Konferenzveröffentlichung
- Are Humans as Brittle as Large Language Models? – Li, Jiahui; Papay, Sean; Klinger, Roman · 2025 · Konferenzveröffentlichung
- Which Demographics do LLMs Default to During Annotation? – Schäfer, Johannes; Combs, Aidan; Bagdon, Christopher Doyle u. a. · 2025 · Konferenzveröffentlichung
- Regular-pattern-sensitive CRFs for Distant Label Interactions – Papay, Sean; Klinger, Roman; Padó, Sebastian · 2025 · Konferenzveröffentlichung
- iPrOp : Interactive Prompt Optimization for Large Language Models with a Human in the Loop – Li, Jiahui; Klinger, Roman · 2025 · Konferenzveröffentlichung
- MOPO: Multi-Objective Prompt Optimization for Affective Text Generation – Menchaca Resendiz, Yarik; Klinger, Roman · 2025 · Konferenzveröffentlichung
- Affective Natural Language Generation of Event Descriptions through Fine-grained Appraisal Conditions – Menchaca Resendiz, Yarik; Klinger, Roman · 2024 · Konferenzveröffentlichung
- Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corpora – Plaza-del-Arco, Flor Miriam; Martín-Valdivia, María-Teresa; Klinger, Roman · 2024 · Konferenzveröffentlichung
- Embarrassingly Simple Performance Prediction for Abductive Natural Language Inference – Kadiķis, Emīls; Srivastav, Vaibhav; Klinger, Roman · 2024 · Konferenzveröffentlichung
- Emotion-Conditioned Text Generation through Automatic Prompt Optimization – Menchaca Resendiz, Yarik; Klinger, Roman · 2024 · Konferenzveröffentlichung
- English Prompts are Better for NLI-based Zero-Shot Emotion Classification than Target-Language Prompts – Bareiss, Patrick; Klinger, Roman; Barnes, Jeremy · 2024 · Konferenzveröffentlichung
- Affective Natural Language Generation of Event Descriptions through Fine-grained Appraisal Conditions – Menchaca Resendiz, Yarik; Klinger, Roman · 2023 · Konferenzveröffentlichung
- Emotion-Conditioned Text Generation through Automatic Prompt Optimization – Menchaca Resendiz, Yarik; Klinger, Roman · 2023 · Konferenzveröffentlichung
- Embarrassingly Simple Performance Prediction for Abductive Natural Language Inference – Kadiķis, Emīls; Srivastav, Vaibhav; Klinger, Roman · 2022 · Konferenzveröffentlichung
- Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corpora – Plaza-del-Arco, Flor Miriam; Martín-Valdivia, María-Teresa; Klinger, Roman · 2022 · Konferenzveröffentlichung