TY - JOUR TI - Seeing the wood for the trees : Predictive margins for random forests AU - Sönning, Lukas AU - Grafmiller, Jason PY - 2023 JO - Corpus Linguistics and Linguistic Theory VL - 20 IS - 1 SP - 153-181 PB - de Gruyter CY - Berlin SN - 1613-7035 DO - 10.1515/cllt-2022-0083 UR - https://fis.uni-bamberg.de/handle/uniba/59523 LA - eng AB - Classification trees and random forests offer a number of attractive features to corpus data analysts. However, the way in which these models are typically reported – a decision tree and/or set of variable importance scores – offers insufficient information if interest centers on the (form of) relationship between (multiple) predictors and the outcome. This paper develops predictive margins as an interpretative approach to ensemble techniques such as random forests. These are model summaries in the form of adjusted predictions, which provide a clearer picture of patterns in the data and allow us to query a model on potential non-linear associations and interactions among predictor variables. The present paper outlines the general strategy for forming predictive margins and addresses methodological issues from an explicitly (corpus) linguistic perspective. For illustration, we use data on the English genitive alternation and provide an R package and code for their implementation. KW - average predictive comparisons KW - classification trees KW - interpretable machine learning KW - predictive modeling KW - random forests ER -