Zum Inhalt springen

Nur-Lesen-Fassung: Das Forschungsinformationssystem (FIS) ist aus Sicherheitsgründen vorübergehend durch diese Nur-Lesen-Fassung ersetzt. Alle öffentlichen Inhalte und Volltexte sind weiterhin abrufbar; Anmeldung, Bearbeitung, Einreichung und Statistiken stehen nicht zur Verfügung. Bei Fragen: fis@uni-bamberg.de

Start › Publikationen › Rethinking model prototyping through the MedMNIST+ dataset collection

Publikation

Rethinking model prototyping through the MedMNIST+ dataset collection

Doerrich, Sebastian; Di Salvo, Francesco; Brockmann, Julius; u. a. (2025): Rethinking model prototyping through the MedMNIST+ dataset collection, in: Scientific reports, London: Springer Nature, Jg. 15, Nr. 1, 7669, S. 1–15, doi: 10.1038/s41598-025-92156-9.

Details

Fakultät/Lehrstuhl
Autorin(nen)/Autor(en)
Brockmann, Julius
Von
Doerrich, Sebastian; ...
Titel der Zeitschrift
Scientific reports
ISSN
2045-2322
Verlagsangabe
Springer Nature : London
Erscheinungsjahr
2025
Jahrgang
15
Heft
1, 7669
Sprache(n)
Englisch
DOI
Abstract

The integration of deep learning based systems in clinical practice is often impeded by challenges rooted in limited and heterogeneous medical datasets. In addition, the field has increasingly prioritized marginal performance gains on a few, narrowly scoped benchmarks over clinical applicability, slowing down meaningful algorithmic progress. This trend often results in excessive fine-tuning of existing methods on selected datasets rather than fostering clinically relevant innovations. In response, this work introduces a comprehensive benchmark for the MedMNIST+ dataset collection, designed to diversify the evaluation landscape across several imaging modalities, anatomical regions, classification tasks and sample sizes. We systematically reassess commonly used Convolutional Neural Networks (CNNs) and Vision Transformer (ViT) architectures across distinct medical datasets, training methodologies, and input resolutions to validate and refine existing assumptions about model effectiveness and development. Our findings suggest that computationally efficient training schemes and modern foundation models offer viable alternatives to costly end-to-end training. Additionally, we observe that higher image resolutions do not consistently improve performance beyond a certain threshold. This highlights the potential benefits of using lower resolutions, particularly in prototyping stages, to reduce computational demands without sacrificing accuracy. Notably, our analysis reaffirms the competitiveness of CNNs compared to ViTs, emphasizing the importance of comprehending the intrinsic capabilities of different architectures. Finally, by establishing a standardized evaluation framework, we aim to enhance transparency, reproducibility, and comparability within the MedMNIST+ dataset collection as well as future research. Code is available at github.com/sdoerrich97/rethinking-model-prototyping-MedMNISTPlus.

GND-Schlagwort(e)
Deep Learning
Medizin
Bild
Datensatz
Benchmarking
Prototyping
Empfehlung
Klassifikation
Freie Schlagwort(e)
Benchmarking
Prototyping recommendations
Medical image classification
Standardized evaluation framework
Foundation models
DDC-Klassifikation
004 Computer science
RVK-Klassifikation
ST 330
Peer Reviewed
ja
Internationale Verbreitung
ja
Open-Access-Zeitschrift
ja
Dokumenttyp
Artikel in einer Zeitschrift / Postprint
URI
Datum der Freischaltung
17.03.2025
Projekt(e)

Permalink: https://fis.uni-bamberg.de/handle/uniba/107047 · Daten als JSON · Zitieren: BibTeX · RIS

Datenstand: 15.11.2026

Eingeschränkter Lesezugriff: Anmeldung, Bearbeitung und Einreichung sind vorübergehend deaktiviert.