Zum Inhalt springen

Nur-Lesen-Fassung: Das Forschungsinformationssystem (FIS) ist aus Sicherheitsgründen vorübergehend durch diese Nur-Lesen-Fassung ersetzt. Alle öffentlichen Inhalte und Volltexte sind weiterhin abrufbar; Anmeldung, Bearbeitung, Einreichung und Statistiken stehen nicht zur Verfügung. Bei Fragen: fis@uni-bamberg.de

Start › Publikationen › Filter Methods for Feature Selection in Supervised Machine Learning Applications : Review and Benchmark

Publikation

Filter Methods for Feature Selection in Supervised Machine Learning Applications : Review and Benchmark

Hopf, Konstantin; Reifenrath, Sascha (2024): Filter Methods for Feature Selection in Supervised Machine Learning Applications : Review and Benchmark, in: Bamberg: Otto-Friedrich-Universität, S. 1–38.

Details

Fakultät/Lehrstuhl
Autorin(nen)/Autor(en)
Hopf, Konstantin
Reifenrath, Sascha
Verlagsangabe
Otto-Friedrich-Universität : Bamberg
Erscheinungsjahr
2024
Quelle/Weitere Ausgabe
Hopf, Konstantin; Reifenrath, Sascha (2021): Filter Methods for Feature Selection in Supervised Machine Learning Applications : Review and Benchmark. arXiv. DOI: 10.48550/arxiv.2111.12140.
Jahr der Erstpublikation
2021
Sprache(n)
Englisch
Lizenz
URN
Abstract

The amount of data for machine learning (ML) applications is constantly growing. Not only the number of observations, especially the number of measured variables (features) increases with ongoing digitization. Selecting the most appropriate features for predictive modeling is an important lever for the success of ML applications in business and research. Feature selection methods (FSM) that are independent of a certain ML algorithm — so-called filter methods — have been numerously suggested, but little guidance for researchers and quantitative modelers exists to choose appropriate approaches for typical ML problems. This review synthesizes the substantial literature on feature selection benchmarking and evaluates the performance of 58 methods in the widely used R environment. For concrete guidance, we consider four typical dataset scenarios that are challenging for ML models (noisy, redundant, imbalanced data and cases with more features than observations). Drawing on the experience of earlier benchmarks, which have considered much fewer FSMs, we compare the performance of the methods according to four criteria (predictive performance, number of relevant features selected, stability of the feature sets and runtime). We found methods relying on the random forest approach, the double input symmetrical relevance filter (DISR) and the joint impurity filter (JIM) were well-performing candidate methods for the given dataset scenarios.

GND-Schlagwort(e)
Maschinelles Lernen
Merkmal
Benchmark
Forschungsmethode
Datenanalyse
Freie Schlagwort(e)
Businss Analytics
Big Data Analytics
Feature Selection
Filter Methods
Machine Learning
Benchmark
DDC-Klassifikation
004 Computer science
330 Wirtschaft
RVK-Klassifikation
ST 530
Dokumenttyp
preprint
URI
Datum der Freischaltung
01.08.2024
Projekt(e)

Permalink: https://fis.uni-bamberg.de/handle/uniba/95292 · Daten als JSON · Zitieren: BibTeX · RIS

Datenstand: 15.11.2026

Eingeschränkter Lesezugriff: Anmeldung, Bearbeitung und Einreichung sind vorübergehend deaktiviert.