Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › Dissecting Span Identification Tasks with Performance Prediction

Publication

Dissecting Span Identification Tasks with Performance Prediction

Papay, Sean; Klinger, Roman; Padó, Sebastian (2025): Dissecting Span Identification Tasks with Performance Prediction, in: Bamberg: Otto-Friedrich-Universität, S. 4881–4895.

Details

Faculty/Chair
Faculty/Professorship
Author
Padó, Sebastian
Publisher Information
Otto-Friedrich-Universität : Bamberg
Year of publication
2025
Source/Other editions
Bonnie Webber, Trevor Cohn, Yulan He, u. a. (Hrsg.), Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Association for Computational Linguistics, 2020, S. 4881–4895
Year of first publication
2020
Language
English
Licence
URN
Abstract

Span identification (in short, span ID) tasks such as chunking, NER, or code-switching detection, ask models to identify and classify relevant spans in a text. Despite being a staple of NLP, and sharing a common structure, there is little insight on how these tasks’ properties influence their difficulty, and thus little guidance on what model families work well on span ID tasks, and why. We analyze span ID tasks via performance prediction, estimating how well neural architectures do on different tasks. Our contributions are: (a) we identify key properties of span ID tasks that can inform performance prediction; (b) we carry out a large-scale experiment on English data, building a model to predict performance for unseen span ID tasks that can support architecture choices; (c), we investigate the parameters of the meta model, yielding new insights on how model and task properties interact to affect span ID performance. We find, e.g., that span frequency is especially important for LSTMs, and that CRFs help when spans are infrequent and boundaries non-distinctive.

Keywords
Span Identification Tasks
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
yes
Type
Conferenceobject
URI
Activation date
2025-11-10

Permalink: https://fis.uni-bamberg.de/handle/uniba/108319 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.