Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology

Gould, Elliot; Fraser, Hannah S; Parker, Timothy H; Nakagawa, Shinichi; Griffith, Simon C; Vesk, Peter A; Fidler, Fiona; Hamilton, Daniel G; Abbey-Lee, Robin N; Abbott, Jessica K; Aguirre, Luis A; Alcaraz, Carles; Aloni, Irith; Altschul, Drew; Arekar, Kunal; Atkins, Jeff W; Atkinson, Joe; Baker, Christopher M; Barrett, Meghan; Bell, Kristian; Bello, Suleiman Kehinde; Beltrán, Iván; Berauer, Bernd J; Bertram, Michael Grant; Billman, Peter D; Blake, Charlie K; Blake, Shannon; Bliard, Louis; Bonisoli-Alquati, Andrea; Bonnet, Timothée; Bordes, Camille Nina Marion; Bose, Aneesh PH; Botterill-James, Thomas; Boyd, Melissa Anna; Boyle, Sarah A; Bradfer-Lawrence, Tom; Bradham, Jennifer; Brand, Jack A; Brengdahl, Martin I; Bulla, Martin; Bussière, Luc; Camerlenghi, Ettore; Campbell, Sara E; Campos, Leonardo LF; Caravaggi, Anthony; Cardoso, Pedro; Carroll, Charles JW; Catanach, Therese A; Chen, Xuan; Chik, Heung Ying Janet; Choy, Emily Sarah; Christie, Alec Philip; Chuang, Angela; Chunco, Amanda J; Clark, Bethany L; Contina, Andrea; Covernton, Garth A; Cox, Murray P; Cressman, Kimberly A; Crotti, Marco; Crouch, Connor Davidson; D’Amelio, Pietro B; de Sousa, Alexandra Allison; Döbert, Timm Fabian; Dobler, Ralph; Dobson, Adam J; Doherty, Tim S; Drobniak, Szymon Marian; Duffy, Alexandra Grace; Duncan, Alison B; Dunn, Robert P; Dunning, Jamie; Dutta, Trishna; Eberhart-Hertel, Luke; Elmore, Jared Alan; Elsherif, Mahmoud Medhat; English, Holly M; Ensminger, David C; Ernst, Ulrich Rainer; Ferguson, Stephen M; Fernandez-Juricic, Esteban; Ferreira-Arruda, Thalita; Fieberg, John; Finch, Elizabeth A; Fiorenza, Evan A; Fisher, David N; Fontaine, Amélie; Forstmeier, Wolfgang; Fourcade, Yoan; Frank, Graham S; Freund, Cathryn A; Fuentes-Lillo, Eduardo; Gandy, Sara L; Gannon, Dustin G; García-Cervigón, Ana I; Garretson, Alexis C; Ge, Xuezhen; Geary, William L; Géron, Charly; Gilles, Marc; Girndt, Antje; Gliksman, Daniel; Goldspiel, Harrison B; Gomes, Dylan GE; Good, Megan Kate; Goslee, Sarah C; Gosnell, J Stephen; Grames, Eliza M; Gratton, Paolo; Grebe, Nicholas M; Greenler, Skye M; Griffioen, Maaike; Griffith, Daniel M; Griffith, Frances J; Grossman, Jake J; Güncan, Ali; Haesen, Stef; Hagan, James G; Hager, Heather A; Harris, Jonathan Philo; Harrison, Natasha Dean; Hasnain, Sarah Syedia; Havird, Justin Chase; Heaton, Andrew J; Herrera-Chaustre, María Laura; Howard, Tanner J; Hsu, Bin-Yan; Iannarilli, Fabiola; Iranzo, Esperanza C; Iverson, Erik NK; Jimoh, Saheed Olaide; Johnson, Douglas H; Johnsson, Martin; Jorna, Jesse; Jucker, Tommaso; Jung, Martin; Kačergytė, Ineta; Kaltz, Oliver; Ke, Alison; Kelly, Clint D; Keogan, Katharine; Keppeler, Friedrich Wolfgang; Killion, Alexander K; Kim, Dongmin; Kochan, David P; Korsten, Peter; Kothari, Shan; Kuppler, Jonas; Kusch, Jillian M; Lagisz, Malgorzata; Lalla, Kristen Marianne; Larkin, Daniel J; Larson, Courtney L; Lauck, Katherine S; Lauterbur, M Elise; Law, Alan; Léandri-Breton, Don-Jean; Lembrechts, Jonas J; L’Herpiniere, Kiara; Lievens, Eva JP; de Lima, Daniela Oliveira; Lindsay, Shane; Luquet, Martin; MacLeod, Ross; Macphie, Kirsty H; Magellan, Kit; Mair, Magdalena M; Malm, Lisa E; Mammola, Stefano; Mandeville, Caitlin P; Manhart, Michael; Manrique-Garzon, Laura Milena; Mäntylä, Elina; Marchand, Philippe; Marshall, Benjamin Michael; Martin, Charles A; Martin, Dominic Andreas; Martin, Jake Mitchell; Martinig, April Robin; McCallum, Erin S; McCauley, Mark; McNew, Sabrina M; Meiners, Scott J; Merkling, Thomas; Michelangeli, Marcus; Moiron, Maria; Moreira, Bruno; Mortensen, Jennifer; Mos, Benjamin; Muraina, Taofeek Olatunbosun; Murphy, Penelope Wrenn; Nelli, Luca; Niemelä, Petri; Nightingale, Josh; Nilsonne, Gustav; Nolazco, Sergio; Nooten, Sabine S; Novotny, Jessie Lanterman; Olin, Agnes Birgitta; Organ, Chris L; Ostevik, Kate L; Palacio, Facundo Xavier; Paquet, Matthieu; Parker, Darren James; Pascall, David J; Pasquarella, Valerie J; Paterson, John Harold; Payo-Payo, Ana; Pedersen, Karen Marie; Perez, Grégoire; Perry, Kayla I; Pottier, Patrice; Proulx, Michael J; Proulx, Raphaël; Pruett, Jessica L; Ramananjato, Veronarindra; Randimbiarison, Finaritra Tolotra; Razafindratsima, Onja H; Rennison, Diana J; Riva, Federico; Riyahi, Sepand; Roast, Michael James; Rocha, Felipe Pereira; Roche, Dominique G; Román-Palacios, Cristian; Rosenberg, Michael S; Ross, Jessica; Rowland, Freya E; Rugemalila, Deusdedith; Russell, Avery L; Ruuskanen, Suvi; Saccone, Patrick; Sadeh, Asaf; Salazar, Stephen M; Sales, Kris; Salmón, Pablo; Sánchez-Tójar, Alfredo; Santos, Leticia Pereira; Santostefano, Francesca; Schilling, Hayden T; Schmidt, Marcus; Schmoll, Tim; Schneider, Adam C; Schrock, Allie E; Schroeder, Julia; Schtickzelle, Nicolas; Schultz, Nick L; Scott, Drew A; Scroggie, Michael Peter; Shapiro, Julie Teresa; Sharma, Nitika; Shearer, Caroline L; Simón, Diego; Sitvarin, Michael I; Skupien, Fabrício Luiz; Slinn, Heather Lea; Smith, Grania Polly; Smith, Jeremy A; Sollmann, Rahel; Whitney, Kaitlin Stack; Still, Shannon Michael; Stuber, Erica F; Sutton, Guy F; Swallow, Ben; Taff, Conor Claverie; Takola, Elina; Tanentzap, Andrew J; Tarjuelo, Rocío; Telford, Richard J; Thawley, Christopher J; Thierry, Hugo; Thomson, Jacqueline; Tidau, Svenja; Tompkins, Emily M; Tortorelli, Claire Marie; Trlica, Andrew; Turnell, Biz R; Urban, Lara; Van de Vondel, Stijn; van der Wal, Jessica Eva Megan; Van Eeckhoven, Jens; van Oordt, Francis; Vanderwel, K Michelle; Vanderwel, Mark C; Vanderwolf, Karen J; Vélez, Juliana; Vergara-Florez, Diana Carolina; Verrelli, Brian C; Vieira, Marcus Vinícius; Villamil, Nora; Vitali, Valerio; Vollering, Julien; Walker, Jeffrey; Walker, Xanthe J; Walter, Jonathan A; Waryszak, Pawel; Weaver, Ryan J; Wedegärtner, Ronja EM; Weller, Daniel L; Whelan, Shannon; White, Rachel Louise; Wolfson, David William; Wood, Andrew; Yanco, Scott W; Yen, Jian DL; Youngflesh, Casey; Zilio, Giacomo; Zimmer, Cédric; Zimmerman, Gregory Mark; Zitomer, Rachel A

Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology

https://hdl.handle.net/10779/DRO/DU:28414703

journal contribution

posted on 2025-02-13, 23:26 authored by Elliot Gould, Hannah S Fraser, Timothy H Parker, Shinichi Nakagawa, Simon C Griffith, Peter A Vesk, Fiona Fidler, Daniel G Hamilton, Robin N Abbey-Lee, Jessica K Abbott, Luis A Aguirre, Carles Alcaraz, Irith Aloni, Drew Altschul, Kunal Arekar, Jeff W Atkins, Joe Atkinson, Christopher M Baker, Meghan Barrett, Kristian Bell, Suleiman Kehinde Bello, Iván Beltrán, Bernd J Berauer, Michael Grant Bertram, Peter D Billman, Charlie K Blake, Shannon Blake, Louis Bliard, Andrea Bonisoli-Alquati, Timothée Bonnet, Camille Nina Marion Bordes, Aneesh PH Bose, Thomas Botterill-James, Melissa Anna Boyd, Sarah A Boyle, Tom Bradfer-Lawrence, Jennifer Bradham, Jack A Brand, Martin I Brengdahl, Martin Bulla, Luc Bussière, Ettore Camerlenghi, Sara E Campbell, Leonardo LF Campos, Anthony Caravaggi, Pedro Cardoso, Charles JW Carroll, Therese A Catanach, Xuan Chen, Heung Ying Janet Chik, Emily Sarah Choy, Alec Philip Christie, Angela Chuang, Amanda J Chunco, Bethany L Clark, Andrea Contina, Garth A Covernton, Murray P Cox, Kimberly A Cressman, Marco Crotti, Connor Davidson Crouch, Pietro B D’Amelio, Alexandra Allison de Sousa, Timm Fabian Döbert, Ralph Dobler, Adam J Dobson, Tim S Doherty, Szymon Marian Drobniak, Alexandra Grace Duffy, Alison B Duncan, Robert P Dunn, Jamie Dunning, Trishna Dutta, Luke Eberhart-Hertel, Jared Alan Elmore, Mahmoud Medhat Elsherif, Holly M English, David C Ensminger, Ulrich Rainer Ernst, Stephen M Ferguson, Esteban Fernandez-Juricic, Thalita Ferreira-Arruda, John Fieberg, Elizabeth A Finch, Evan A Fiorenza, David N Fisher, Amélie Fontaine, Wolfgang Forstmeier, Yoan Fourcade, Graham S Frank, Cathryn A Freund, Eduardo Fuentes-Lillo, Sara L Gandy, Dustin G Gannon, Ana I García-Cervigón, Alexis C Garretson, Xuezhen Ge, William L Geary, Charly Géron, Marc Gilles, Antje Girndt, Daniel Gliksman, Harrison B Goldspiel, Dylan GE Gomes, Megan Kate Good, Sarah C Goslee, J Stephen Gosnell, Eliza M Grames, Paolo Gratton, Nicholas M Grebe, Skye M Greenler, Maaike Griffioen, Daniel M Griffith, Frances J Griffith, Jake J Grossman, Ali Güncan, Stef Haesen, James G Hagan, Heather A Hager, Jonathan Philo Harris, Natasha Dean Harrison, Sarah Syedia Hasnain, Justin Chase Havird, Andrew J Heaton, María Laura Herrera-Chaustre, Tanner J Howard, Bin-Yan Hsu, Fabiola Iannarilli, Esperanza C Iranzo, Erik NK Iverson, Saheed Olaide Jimoh, Douglas H Johnson, Martin Johnsson, Jesse Jorna, Tommaso Jucker, Martin Jung, Ineta Kačergytė, Oliver Kaltz, Alison Ke, Clint D Kelly, Katharine Keogan, Friedrich Wolfgang Keppeler, Alexander K Killion, Dongmin Kim, David P Kochan, Peter Korsten, Shan Kothari, Jonas Kuppler, Jillian M Kusch, Malgorzata Lagisz, Kristen Marianne Lalla, Daniel J Larkin, Courtney L Larson, Katherine S Lauck, M Elise Lauterbur, Alan Law, Don-Jean Léandri-Breton, Jonas J Lembrechts, Kiara L’Herpiniere, Eva JP Lievens, Daniela Oliveira de Lima, Shane Lindsay, Martin Luquet, Ross MacLeod, Kirsty H Macphie, Kit Magellan, Magdalena M Mair, Lisa E Malm, Stefano Mammola, Caitlin P Mandeville, Michael Manhart, Laura Milena Manrique-Garzon, Elina Mäntylä, Philippe Marchand, Benjamin Michael Marshall, Charles A Martin, Dominic Andreas Martin, Jake Mitchell Martin, April Robin Martinig, Erin S McCallum, Mark McCauley, Sabrina M McNew, Scott J Meiners, Thomas Merkling, Marcus Michelangeli, Maria Moiron, Bruno Moreira, Jennifer Mortensen, Benjamin Mos, Taofeek Olatunbosun Muraina, Penelope Wrenn Murphy, Luca Nelli, Petri Niemelä, Josh Nightingale, Gustav Nilsonne, Sergio Nolazco, Sabine S Nooten, Jessie Lanterman Novotny, Agnes Birgitta Olin, Chris L Organ, Kate L Ostevik, Facundo Xavier Palacio, Matthieu Paquet, Darren James Parker, David J Pascall, Valerie J Pasquarella, John Harold Paterson, Ana Payo-Payo, Karen Marie Pedersen, Grégoire Perez, Kayla I Perry, Patrice Pottier, Michael J Proulx, Raphaël Proulx, Jessica L Pruett, Veronarindra Ramananjato, Finaritra Tolotra Randimbiarison, Onja H Razafindratsima, Diana J Rennison, Federico Riva, Sepand Riyahi, Michael James Roast, Felipe Pereira Rocha, Dominique G Roche, Cristian Román-Palacios, Michael S Rosenberg, Jessica Ross, Freya E Rowland, Deusdedith Rugemalila, Avery L Russell, Suvi Ruuskanen, Patrick Saccone, Asaf Sadeh, Stephen M Salazar, Kris Sales, Pablo Salmón, Alfredo Sánchez-Tójar, Leticia Pereira Santos, Francesca Santostefano, Hayden T Schilling, Marcus Schmidt, Tim Schmoll, Adam C Schneider, Allie E Schrock, Julia Schroeder, Nicolas Schtickzelle, Nick L Schultz, Drew A Scott, Michael Peter Scroggie, Julie Teresa Shapiro, Nitika Sharma, Caroline L Shearer, Diego Simón, Michael I Sitvarin, Fabrício Luiz Skupien, Heather Lea Slinn, Grania Polly Smith, Jeremy A Smith, Rahel Sollmann, Kaitlin Stack Whitney, Shannon Michael Still, Erica F Stuber, Guy F Sutton, Ben Swallow, Conor Claverie Taff, Elina Takola, Andrew J Tanentzap, Rocío Tarjuelo, Richard J Telford, Christopher J Thawley, Hugo Thierry, Jacqueline Thomson, Svenja Tidau, Emily M Tompkins, Claire Marie Tortorelli, Andrew Trlica, Biz R Turnell, Lara Urban, Stijn Van de Vondel, Jessica Eva Megan van der Wal, Jens Van Eeckhoven, Francis van Oordt, K Michelle Vanderwel, Mark C Vanderwel, Karen J Vanderwolf, Juliana Vélez, Diana Carolina Vergara-Florez, Brian C Verrelli, Marcus Vinícius Vieira, Nora Villamil, Valerio Vitali, Julien Vollering, Jeffrey Walker, Xanthe J Walker, Jonathan A Walter, Pawel WaryszakPawel Waryszak, Ryan J Weaver, Ronja EM Wedegärtner, Daniel L Weller, Shannon Whelan, Rachel Louise White, David William Wolfson, Andrew Wood, Scott W Yanco, Jian DL Yen, Casey Youngflesh, Giacomo Zilio, Cédric Zimmer, Gregory Mark Zimmerman, Rachel A Zitomer

Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology

History

Related Materials

1.
DOI - Is version of https://doi.org/10.1186/s12915-024-02101-x

Location

London, Eng.

Open access

Yes

Language

eng

Publication classification

C1.1 Refereed article in a scholarly journal

Journal

BMC Biology

Volume

23

Article number

35

Pagination

35-35

ISSN

1741-7007

eISSN

1741-7007

Issue

1

Publisher

BioMed Central

Publication URL

https://doi.org/10.1186/s12915-024-02101-x

Usage metrics

Keywords

Animals Biological Evolution Ecology Eucalyptus Passeriformes Analytical heterogeneity Many-analyst Metascience Replication crisis Reproducibility

Licence

CC BY-NC-ND 4.0

Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology

History

Related Materials

Location

Open access

Language

Publication classification

Journal

Volume

Article number

Pagination

ISSN

eISSN

Issue

Publisher

Publication URL

Usage metrics

Categories

Keywords

Licence

Exports