TY - JOUR TI - The reliability of replications : a study in computational reproductions AU - Breznau, Nate AU - Rinke, Eike Mark AU - Wuttke, Alexander AU - Adem, Muna AU - Adriaans, Jule AU - Akdeniz, Esra AU - Alvarez-Benjumea, Amalia AU - Andersen, Henrik K. AU - Auer, Daniel AU - Azevedo, Flavio AU - Bahnsen, Oke AU - Bai, Ling AU - Balzer, Dave AU - Bauer, Paul C. AU - Bauer, Gerritt AU - Baumann, Markus AU - Baute, Sharon AU - Benoit, Verena AU - Bernauer, Julian AU - Berning, Carl AU - Berthold, Anna AU - Bethke, Felix S. AU - Biegert, Thomas AU - Blinzler, Katharina AU - Blumenberg, Johannes N. AU - Bobzien, Licia AU - Bohman, Andrea AU - Bol, Thijs AU - Bostic, Amie AU - Brzozowska, Zuzanna AU - Burgdorf, Katharina AU - Burger, Kaspar AU - Castillo, Juan-Carlos AU - Chan, Nathan AU - Christmann, Pablo AU - Connelly, Roxanne AU - Czymara, Christian S. AU - Damian, Elena AU - de Rooij, Eline A. AU - Ecker, Alejandro AU - Edelmann, Achim AU - Eder, Christina AU - Eger, Maureen A. AU - Ellerbrock, Simon AU - Forke, Anna AU - Forster, Andrea AU - Freire, Danilo AU - Gaasendam, Chris AU - Gavras, Konstantin AU - Gayle, Vernon AU - Gessler, Theresa AU - Gnambs, Timo AU - Godefroidt, Amélie AU - Grömping, Max AU - Groß, Martin AU - Gruber, Stefan AU - Gummer, Tobias AU - Hadjar, Andreas AU - Halbherr, Verena AU - Heisig, Jan Paul AU - Hellmeier, Sebastian AU - Heyne, Stefanie AU - Hirsch, Magdalena AU - Hjerm, Mikael AU - Hochman, Oshrat AU - Höffler, Jan H. AU - Hövermann, Andreas AU - Hunger, Sophia AU - Hunkler, Christian AU - Huth-Stöckl, Nora AU - Ignácz, Zsófia S. AU - Israel, Sabine AU - Jacobs, Laura AU - Jacobsen, Jannes AU - Jaeger, Bastian AU - Jungkunz, Sebastian AU - Jungmann, Nils AU - Kanjana, Jennifer AU - Kauff, Mathias AU - Khan, Salman AU - Khatua, Sayak AU - Kleinert, Manuel AU - Klinger, Julia AU - Kolb, Jan-Philipp AU - Kołczyńska, Marta AU - Kuk, John AU - Kunißen, Katharina AU - Kurti Sinatra, Dafina AU - Langenkamp, Alexander AU - Lee, Robin C. AU - Lersch, Philipp M. AU - Liu, David AU - Löbel, Lea-Maria AU - Lutscher, Philipp AU - Mader, Matthias AU - Madia, Joan E. AU - Malancu, Natalia AU - Maldonado, Luis AU - Marahrens, Helge AU - Martin, Nicole AU - Martinez, Paul AU - Mayerl, Jochen AU - Mayorga, Oscar J. AU - McDonnell, Robert AU - McManus, Patricia AU - McWagner, Kyle AU - Meeusen, Cecil AU - Meierrieks, Daniel AU - Mellon, Jonathan AU - Merhout, Friedolin AU - Merk, Samuel AU - Meyer, Daniel AU - Micheli, Leticia AU - Mijs, Jonathan AU - Moya, Cristóbal AU - Neunhoeffer, Marcel AU - Nüst, Daniel AU - Nygård, Olav AU - Ochsenfeld, Fabian AU - Otte, Gunnar AU - Pechenkina, Anna AU - Pickup, Mark AU - Prosser, Christopher AU - Raes, Louis AU - Ralston, Kevin AU - Ramos, Miguel AU - Reichert, Frank AU - Roets, Arne AU - Rogers, Jonathan AU - Ropers, Guido AU - Samuel, Robin AU - Sand, Gregor AU - Sanhueza Petrarca, Constanz AU - Schater, Ariela AU - Schaeffer, Merlin AU - Schieferdecker, David AU - Schlueter, Elmar AU - Schmidt, Katja AU - Schmidt, Regine AU - Schmidt-Catran, Alexander AU - Schmiedeberg, Claudia AU - Schneider, Jürgen AU - Schoonvelde, Martijn AU - Schulte-Cloos, Julia AU - Schumann, Sandy AU - Schunck, Reinhard AU - Seuring, Julian AU - Silber, Henning AU - Sleegers, Willem AU - Sonntag, Nico AU - Staudt, Alexander AU - Steiber, Nadia AU - Steiner, Nils D. AU - Sternberg, Sebastian AU - Stiers, Dieter AU - Stojmenovska, Dragana AU - Storz, Nora AU - Striessnig, Erich AU - Stroppe, Anne-Kathrin AU - Suchow, Jordan W. AU - Teltemann, Janna AU - Tibajev, Andrey AU - Tung, Brian AU - Vagni, Giacomo AU - Van Assche, Jasper AU - van der Linden, Meta AU - van der Noll, Jolanda AU - Van Hootegem, Arno AU - Vogtenhuber, Stefan AU - Voicu, Bogdan AU - Wagemanns, Fieke AU - Wehl, Nadja AU - Werner, Hannah AU - Wiernik, Brenton M. AU - Winter, Fabian AU - Wolf, Christof AU - Wu, Cary AU - Yamada, Yuki AU - Zakula, Björn AU - Zhang, Nan AU - Ziller, Conrad AU - Zins, Stefan AU - Żółtak, Tomasz AU - Nguyen, Hung H. V. PY - 2025 JO - Royal Society Open Science VL - 12 IS - 3 SP - 1-23 PB - Royal Soc. Publ. CY - London SN - 2054-5703 DO - 10.1098/rsos.241038 UR - https://fis.uni-bamberg.de/handle/uniba/117749 LA - eng ER - TY - THES TI - Einstellungen zur Akkulturation von Eingewanderten : Einstellungsunterschiede von Jugendlichen mit und ohne Migrationshintergrund AU - Berthold, Anna PY - 2025 PB - Springer VS CY - Wiesbaden SN - 978-3-658-46609-1 UR - https://fis.uni-bamberg.de/handle/uniba/108126 LA - deu ER - TY - JOUR TI - Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty AU - Breznau, Nate AU - Rinke, Eike Mark AU - Wuttke, Alexander AU - Nguyen, Hung H. V. AU - Adem, Muna AU - Adriaans, Jule AU - Alvarez-Benjumea, Amalia AU - Andersen, Henrik K. AU - Forster, Andrea AU - Schieferdecker, David AU - Benoit, Verena AU - Berthold, Anna AU - Gnambs, Timo AU - Jungkunz, Sebastian AU - Schmidt, Regine AU - Seuring, Julian PY - 2023 SP - 1-8 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/91668 LA - eng AB - This study explores how researchers’ analytical choices affect the reliability of scientific findings. Most discussions of reliability problems in science focus on systematic biases. We broaden the lens to emphasize the idiosyncrasy of conscious and unconscious decisions that researchers make during data analysis. We coordinated 161 researchers in 73 research teams and observed their research decisions as they used the same data to independently test the same prominent social science hypothesis: that greater immigration reduces support for social policies among the public. In this typical case of social science research, research teams reported both widely diverging numerical findings and substantive conclusions despite identical start conditions. Researchers’ expertise, prior beliefs, and expectations barely predict the wide variation in research outcomes. More than 95% of the total variance in numerical results remains unexplained even after qualitative coding of all identifiable decisions in each team’s workflow. This reveals a universe of uncertainty that remains hidden when considering a single study in isolation. The idiosyncratic nature of how researchers’ results and conclusions varied is a previously underappreciated explanation for why many scientific hypotheses remain contested. These results call for greater epistemic humility and clarity in reporting scientific findings. KW - metascience KW - many analysts KW - researcher degrees of freedom KW - analytical flexibility KW - immigration and policy preferences ER - TY - JOUR TI - Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty AU - Breznau, Nate AU - Rinke, Eike Mark AU - Wuttke, Alexander AU - Nguyen, Hung H. V. AU - Adem, Muna AU - Adriaans, Jule AU - Alvarez-Benjumea, Amalia AU - Andersen, Henrik K. AU - Forster, Andrea AU - Schieferdecker, David AU - Benoit, Verena AU - Berthold, Anna AU - Gnambs, Timo AU - Jungkunz, Sebastian AU - Schmidt, Regine AU - Seuring, Julian PY - 2022 JO - Proceedings of the National Academy of Sciences of the United States of America VL - 119 IS - 44, e2203150119 SP - 1-8 PB - National Acad. of Sciences CY - Washington, DC SN - 0027-8424 DO - 10.1073/pnas.2203150119 UR - https://fis.uni-bamberg.de/handle/uniba/91660 LA - eng AB - This study explores how researchers’ analytical choices affect the reliability of scientific findings. Most discussions of reliability problems in science focus on systematic biases. We broaden the lens to emphasize the idiosyncrasy of conscious and unconscious decisions that researchers make during data analysis. We coordinated 161 researchers in 73 research teams and observed their research decisions as they used the same data to independently test the same prominent social science hypothesis: that greater immigration reduces support for social policies among the public. In this typical case of social science research, research teams reported both widely diverging numerical findings and substantive conclusions despite identical start conditions. Researchers’ expertise, prior beliefs, and expectations barely predict the wide variation in research outcomes. More than 95% of the total variance in numerical results remains unexplained even after qualitative coding of all identifiable decisions in each team’s workflow. This reveals a universe of uncertainty that remains hidden when considering a single study in isolation. The idiosyncratic nature of how researchers’ results and conclusions varied is a previously underappreciated explanation for why many scientific hypotheses remain contested. These results call for greater epistemic humility and clarity in reporting scientific findings. KW - metascience KW - many analysts KW - researcher degrees of freedom KW - analytical flexibility KW - immigration and policy preferences ER -