SCIENCE@home

Improving Statistical Analysis in Team Science: The Case of a Bayesian Multiverse of Many Labs 4

S. Hoogeveen,S. Berkhout,Q. Gronau,E. Wagenmakers,J. Haaf

Published 2023 in Advances in Methods and Practices in Psychological Science

ABSTRACT

Team-science projects have become the “gold standard” for assessing the replicability and variability of key findings in psychological science. However, we believe the typical meta-analytic approach in these projects fails to match the wealth of collected data. Instead, we advocate the use of Bayesian hierarchical modeling for team-science projects, potentially extended in a multiverse analysis. We illustrate this full-scale analysis by applying it to the recently published Many Labs 4 project. This project aimed to replicate the mortality-salience effect—that being reminded of one’s own death strengthens the own cultural identity. In a multiverse analysis, we assess the robustness of the results with varying data-inclusion criteria and prior settings. Bayesian model comparison results largely converge to a common conclusion: The data provide evidence against a mortality-salience effect across the majority of our analyses. We issue general recommendations to facilitate full-scale analyses in team-science projects.

PUBLICATION RECORD

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-73 of 73 references · Page 1 of 1

CITED BY

Showing 1-9 of 9 citing papers · Page 1 of 1