Skip to content

Read-only version: For security reasons, the Research Information System (FIS) has been temporarily replaced by this read-only version. All public content and full texts remain available; login, editing, submission and statistics are not available. Questions: fis@uni-bamberg.de

Home › Publications › IMS_medicALY at #SMM4H 2024 : Detecting Impacts of Outdoor Spaces on Social Anxiety with Data Augmented Ensembling

Publication

IMS_medicALY at #SMM4H 2024 : Detecting Impacts of Outdoor Spaces on Social Anxiety with Data Augmented Ensembling

Wührl, Amelie; Greschner, Lynn; Menchaca Resendiz, Yarik; u. a. (2024): IMS_medicALY at #SMM4H 2024 : Detecting Impacts of Outdoor Spaces on Social Anxiety with Data Augmented Ensembling, in: Dongfang Xu, Graciela Gonzalez-Hernandez, Dongfang Xu, u. a. (Hrsg.), Proceedings of The 9th Social Media Mining for Health Research and Applications (SMM4H 2024) Workshop and Shared Tasks, Bangkok, Thailand: Association for Computational Linguistics, S. 83–87.

Details

Faculty/Chair
Faculty/Professorship
Author
Wührl, Amelie
Menchaca Resendiz, Yarik
Title of the compilation
Proceedings of The 9th Social Media Mining for Health Research and Applications (SMM4H 2024) Workshop and Shared Tasks
Editors
Xu, Dongfang
Gonzalez-Hernandez, Graciela
Conference
9th Social Media Mining for Health Research and Applications (SMM4H 2024) Workshop, Bangkok, Thailand
Publisher Information
Association for Computational Linguistics : Bangkok, Thailand
Year of publication
2024
Language
English
URL
Abstract

Many individuals affected by Social Anxiety Disorder turn to social media platforms to share their experiences and seek advice. This includes discussing the potential benefits of engaging with outdoor environments. As part of #SMM4H 2024, Shared Task 3 focuses on classifying the effects of outdoor spaces on social anxiety symptoms in Reddit posts. In our contribution to the task, we explore the effectiveness of domain-specific models (trained on social media data – SocBERT) against general domain models (trained on diverse datasets – BERT, RoBERTa, GPT-3.5) in predicting the sentiment related to outdoor spaces. Further, we assess the benefits of augmenting sparse human-labeled data with synthetic training instances and evaluate the complementary strengths of domain-specific and general classifiers using an ensemble model. Our results show that (1) fine-tuning small, domain-specific models generally outperforms large general language models in most cases. Only one large language model (GPT-4) exhibits performance comparable to the fine-tuned models (52% F1). Further, we find that (2) synthetic data does improve the performance of fine-tuned models in some cases, and (3) models do not appear to complement each other in our ensemble setup.

Keywords
Data Augmented Ensembling
Peer Reviewed
yes
International Distribution
yes
Open Access Journal
yes
Type
Conferenceobject
URI
Activation date
2024-09-20

Permalink: https://fis.uni-bamberg.de/handle/uniba/98196 · Data as JSON · Cite: BibTeX · RIS

Data as of: 2026-11-16

Restricted read-only access: login, editing and submission are temporarily disabled.