TY - JOUR TI - Validating an Index of Selection Bias for Proportions in Non‐Probability Samples AU - Hammon, Angelina AU - Zinn, Sabine PY - 2025 SP - 499-516 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/111357 LA - eng AB - Fast online surveys without sampling frames are becoming increasingly important in survey research. Their recruitment methods result in non-probability samples. As the mechanism of data generation is always unknown in such samples, the problem of non-ignorability arises making vgeneralisation of calculated statistics to the population of interest highly questionable. Sensitivity analyses provide a valuable tool to deal with non-ignorability. They capture the impact of different sample selection mechanisms on target statistics. In 2019, Andridge and colleagues proposed an index to quantify potential (non-ignorable) selection bias in proportions that combines the effects of different selection mechanisms. In this paper, we validate this index with an artificial non-probability sample generated from a large empirical data set and additionally applied it to proportions estimated from data on current political attitudes arising from a real non-probability sample selected via River sampling. We find a number of conditions that must be met for the index to perform meaningfully. When these requirements are fulfilled, the index shows an overall good performance in both of our applications in detecting and correcting present selection bias in estimated proportions. Thus, it provides a powerful measure for evaluating the robustness of results obtained from non-probability samples. KW - non-ignorable sample selection KW - pattern-mixture modelling KW - selection not at random KW - sensitivity analysis ER - TY - JOUR TI - Validating an Index of Selection Bias for Proportions in Non‐Probability Samples AU - Hammon, Angelina AU - Zinn, Sabine PY - 2025 JO - International statistical review : a journal of the International Statistical Institute and its associations VL - 93 IS - 3 SP - 499-516 PB - Wiley-Blackwell CY - Oxford ; Malden, Mass. SN - 0020-8779 DO - 10.1111/insr.12590 UR - https://fis.uni-bamberg.de/handle/uniba/107715 LA - eng AB - Fast online surveys without sampling frames are becoming increasingly important in survey research. Their recruitment methods result in non-probability samples. As the mechanism of data generation is always unknown in such samples, the problem of non-ignorability arises making vgeneralisation of calculated statistics to the population of interest highly questionable. Sensitivity analyses provide a valuable tool to deal with non-ignorability. They capture the impact of different sample selection mechanisms on target statistics. In 2019, Andridge and colleagues proposed an index to quantify potential (non-ignorable) selection bias in proportions that combines the effects of different selection mechanisms. In this paper, we validate this index with an artificial non-probability sample generated from a large empirical data set and additionally applied it to proportions estimated from data on current political attitudes arising from a real non-probability sample selected via River sampling. We find a number of conditions that must be met for the index to perform meaningfully. When these requirements are fulfilled, the index shows an overall good performance in both of our applications in detecting and correcting present selection bias in estimated proportions. Thus, it provides a powerful measure for evaluating the robustness of results obtained from non-probability samples. KW - non-ignorable sample selection KW - pattern-mixture modelling KW - selection not at random KW - sensitivity analysis ER - TY - JOUR TI - Multiple imputation of ordinal missing not at random data AU - Hammon, Angelina PY - 2024 SP - 671-692 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/93529 LA - eng AB - We introduce a selection model-based imputation approach to be used within the Fully Conditional Specification (FCS) framework for the Multiple Imputation (MI) of incomplete ordinal variables that are supposed to be Missing Not at Random (MNAR). Thereby, we generalise previous work on this topic which involved binary single-level and multilevel data to ordinal variables. We apply an ordered probit model with sample selection as base of our imputation algorithm. The applied model involves two equations that are modelled jointly where the first one describes the missing-data mechanism and the second one specifies the variable to be imputed. In addition, we develop a version for hierarchical data by incorporating random intercept terms in both equations. To fit this multilevel imputation model we use quadrature techniques. Two simulation studies validate the overall good performance of our single-level and multilevel imputation methods. In addition, we show its applicability to empirical data by applying it to a common research topic in educational science using data of the National Educational Panel Study (NEPS) and conducting a short sensitivity analysis. Our approach is designed to be used within the R software package mice which makes it easy to access and apply. KW - Fully conditional specification KW - Missingness not at random KW - Multilevel data KW - Multiple imputation KW - Selection model KW - Ordinal data ER - TY - JOUR TI - Multiple imputation of ordinal missing not at random data AU - Hammon, Angelina PY - 2023 JO - Advances in statistical analysis : AStA VL - 107 IS - 4 SP - 671-692 PB - Springer CY - Berlin ; Heidelberg SN - 1863-818X DO - 10.1007/s10182-022-00461-9 UR - https://fis.uni-bamberg.de/handle/uniba/56927 LA - eng AB - We introduce a selection model-based imputation approach to be used within the Fully Conditional Specification (FCS) framework for the Multiple Imputation (MI) of incomplete ordinal variables that are supposed to be Missing Not at Random (MNAR). Thereby, we generalise previous work on this topic which involved binary single-level and multilevel data to ordinal variables. We apply an ordered probit model with sample selection as base of our imputation algorithm. The applied model involves two equations that are modelled jointly where the first one describes the missing-data mechanism and the second one specifies the variable to be imputed. In addition, we develop a version for hierarchical data by incorporating random intercept terms in both equations. To fit this multilevel imputation model we use quadrature techniques. Two simulation studies validate the overall good performance of our single-level and multilevel imputation methods. In addition, we show its applicability to empirical data by applying it to a common research topic in educational science using data of the National Educational Panel Study (NEPS) and conducting a short sensitivity analysis. Our approach is designed to be used within the R software package mice which makes it easy to access and apply. KW - Fully conditional specification KW - Missingness not at random KW - Multilevel data KW - Multiple imputation KW - Selection model KW - Ordinal data ER - TY - JOUR TI - Multiple imputation of binary multilevel missing not at random data AU - Hammon, Angelina AU - Zinn, Sabine PY - 2021 SP - 547-564 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/49823 LA - eng AB - We introduce a selection model-based multilevel imputation approach to be used within the fully conditional specification framework for multiple imputation. Concretely, we apply a censored bivariate probit model to describe binary variables assumed to be missing not at random. The first equation of the model defines the regression model for the missing data mechanism. The second equation specifies the regression model of the variable to be imputed. The non-random selection of the binary data is mapped by correlations between the error terms of the two regression models. Hierarchical data structures are modelled by random intercepts in both equations. To fit the novel imputation model we use maximum likelihood and adaptive Gauss–Hermite quadrature. A comprehensive simulation study shows the overall performance of the approach.We test its usefulness for empirical research by applying it to a common problem in social scientific research: the emergence of educational aspirations. Our software is designed to be used in the R package mice. KW - Fully conditional specification; Missingness not at random; Multilevel data; Multiple imputation; Selection model ER - TY - JOUR TI - Multiple imputation of binary multilevel missing not at random data AU - Hammon, Angelina AU - Zinn, Sabine PY - 2020 JO - Journal of the Royal Statistical Society: Series C (Applied Statistics) VL - 69 IS - 3 SP - 547-564 PB - Wiley-Blackwell CY - Oxford SN - 1467-9876 DO - 10.1111/rssc.12401 UR - https://fis.uni-bamberg.de/handle/uniba/54235 LA - eng AB - We introduce a selection model-based multilevel imputation approach to be used within the fully conditional specification framework for multiple imputation. Concretely, we apply a censored bivariate probit model to describe binary variables assumed to be missing not at random. The first equation of the model defines the regression model for the missing data mechanism. The second equation specifies the regression model of the variable to be imputed. The non-random selection of the binary data is mapped by correlations between the error terms of the two regression models. Hierarchical data structures are modelled by random intercepts in both equations. To fit the novel imputation model we use maximum likelihood and adaptive Gauss–Hermite quadrature. A comprehensive simulation study shows the overall performance of the approach.We test its usefulness for empirical research by applying it to a common problem in social scientific research: the emergence of educational aspirations. Our software is designed to be used in the R package mice. KW - Fully conditional specification; Missingness not at random; Multilevel data; Multiple imputation; Selection model ER -