Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › CoVERT : A Corpus of Fact-checked Biomedical COVID-19 Tweets

Publication

CoVERT : A Corpus of Fact-checked Biomedical COVID-19 Tweets

Mohr, Isabelle; Wührl, Amelie; Klinger, Roman (2022): CoVERT : A Corpus of Fact-checked Biomedical COVID-19 Tweets, in: Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, u. a. (Hrsg.), Proceedings of the Thirteenth Language Resources and Evaluation Conference, Marseille: European Language Resources Association, S. 244–257.

Details

Faculty/Chair
Faculty/Professorship
Author
Mohr, Isabelle
Wührl, Amelie
Title of the compilation
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Editors
Calzolari, Nicoletta; Béchet, Frédéric; Blache, Philippe; Choukri, Khalid; Cieri, Christopher; Declerck, Thierry; Goggi, Sara; Isahara, Hitoshi; Maegaard, Bente; Mariani, Joseph; Mazo, Hélène; Odijk, Jan; Piperidis, Stelios
Conference
Thirteenth Language Resources and Evaluation Conference (LREC), Juni 2022, Marseille
Publisher Information
European Language Resources Association : Marseille
Year of publication
2022
Language
English
URL
Abstract

During the first two years of the COVID-19 pandemic, large volumes of biomedical information concerning this new disease have been published on social media. Some of this information can pose a real danger, particularly when false information is shared, for instance recommendations how to treat diseases without professional medical advice. Therefore, automatic fact-checking resources and systems developed specifically for medical domain are crucial. While existing fact-checking resources cover COVID-19 related information in news or quantify the amount of misinformation in tweets, there is no dataset providing fact-checked COVID-19 related Twitter posts with detailed annotations for biomedical entities, relations and relevant evidence. We contribute CoVERT, a fact-checked corpus of tweets with a focus on the domain of biomedicine and COVID-19 related (mis)information. The corpus consists of 300 tweets, each annotated with named entities and relations. We employ a novel crowdsourcing methodology to annotate all tweets with fact-checking labels and supporting evidence, which crowdworkers search for online. This methodology results in substantial inter-annotator agreement. Furthermore, we use the retrieved evidence extracts as part of a fact-checking pipeline, finding that the real-world evidence is more useful than the knowledge directly available in pretrained language models.

GND Keywords
Computerlinguistik
Korpus <Linguistik>
COVID-19
Keywords
CoVERT
DDC Classification
004 Computer science
RVK Classification
ST 306
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
yes
Type
Conferenceobject
URI
Activation date
2024-03-07
Project(s)

Permalink: https://fis.uni-bamberg.de/handle/uniba/93885 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-15

Restricted read-only access: login, editing and submission are temporarily disabled.