ReplicHAI › Metascience: replication projects & definitions

Shared by Changkun Ou with everyone

Year ↓	Title added	Authors	Venue
2026	Investigating the analytical robustness of the social and behavioural sciences	Aczel et al.	Nature
2026	Investigating the replicability of the social and behavioural sciences	Tyner et al.	Nature
2026	Investigating the reproducibility of the social and behavioural sciences	Miske et al.	Nature
2026	Reproducibility and robustness of economics and political science research	Brodeur et al.	Nature
2026	TOP 2025: An update to the Transparency and Openness Promotion Guidelines	Grant et al.	Research Integrity and Peer Review
2024	Nonstandard Errors	Menkveld et al.	The Journal of Finance
2024	Report of the AEA Data Editor	Vilhuber	AEA Papers and Proceedings
2023	Replication games: how to make reproducibility research more systematic	Brodeur et al.	Nature
2023	The State of Play of Reproducibility in Statistics: An Empirical Analysis	Xiong, Cribben	The American Statistician
2023	What's in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of Psychological Science	Crüwell et al.	Psychological Science
2022	Is Economics Research Replicable? Sixty Published Papers From Thirteen Journals Say “Often Not”	Chang, Li	Critical Finance Review
2022	Many Labs 4: Failure to Replicate Mortality Salience Effect With and Without Original Author Involvement	Klein et al.	Collabra: Psychology
2022	Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty	Breznau et al.	Proceedings of the National Academy of Sciences
2022	Replicability, Robustness, and Reproducibility in Psychological Science	Nosek et al.	Annual Review of Psychology
2022	The past, present and future of Registered Reports	Chambers, Tzavella	Nature Human Behaviour
2021	An Excess of Positive Results: Comparing the Standard Psychology Literature with Registered Reports	Scheel et al.	Advances in Methods and Practices in Psychological Science
2021	Analytic reproducibility in articles receiving open data badges at the journal Psychological Science: an observational study	Hardwicke et al.	Royal Society Open Science
2021	Challenges for assessing replicability in preclinical cancer biology	Errington et al.	eLife
2021	Investigating the replicability of preclinical cancer biology	Errington et al.	eLife
2021	Systematizing Confidence in Open Research and Evidence (SCORE)	Alipourfard et al.	SocArXiv
2020	Analysis of Open Data and Computational Reproducibility in Registered Reports in Psychology	Obels et al.	Advances in Methods and Practices in Psychological Science
2020	Artifact Review and Badging — Version 1.1	Machinery
2020	Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability	Ebersole et al.	Advances in Methods and Practices in Psychological Science
2020	Reproducibility and Replicability in Economics	Vilhuber	Harvard Data Science Review
2020	Variability in the analysis of a single neuroimaging dataset by many teams	Botvinik-Nezer et al.	Nature
2020	What is replication?	Nosek, Errington	PLOS Biology
2019	Reproducibility and Replicability in Science	Medicine	The National Academies Press
2019	What's next for Registered Reports?	Chambers	Nature
2018	An empirical analysis of journal policy effectiveness for computational reproducibility	Stodden et al.	Proceedings of the National Academy of Sciences
2018	Badges for sharing data and code at Biostatistics: an observational study	Rowhani-Farid, Barnett	F1000Research
2018	Data Availability, Reusability, and Analytic Reproducibility: Evaluating the Impact of a Mandatory Open Data Policy at the Journal Cognition	Hardwicke et al.	Royal Society Open Science
2018	Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015	Camerer et al.	Nature Human Behaviour
2018	Making replication mainstream	Zwaan et al.	Behavioral and Brain Sciences
2018	Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results	Silberzahn et al.	Advances in Methods and Practices in Psychological Science
2018	Many Labs 2: Investigating Variation in Replicability Across Samples and Settings	Klein et al.	Advances in Methods and Practices in Psychological Science
2018	Psychological Science Accelerator: Advancing Psychology Through a Distributed Collaborative Network	Moshontz	Advances in Methods and Practices in Psychological Science
2018	Reproducibility vs. Replicability: A Brief History of a Confused Terminology	Plesser	Frontiers in Neuroinformatics
2018	Terminologies for Reproducible Research	Barba	arXiv
2018	The preregistration revolution	Nosek et al.	Proceedings of the National Academy of Sciences
2016	1,500 scientists lift the lid on reproducibility	Baker	Nature
2016	Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency	Kidwell et al.	PLOS Biology
2016	Evaluating replicability of laboratory experiments in economics	Camerer et al.	Science
2016	Many Labs 3: Evaluating participant pool quality across the academic semester via replication	Ebersole et al.	Journal of Experimental Social Psychology
2016	What does research reproducibility mean?	Goodman et al.	Science Translational Medicine
2015	Estimating the reproducibility of psychological science	Collaboration	Science
2015	Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say “Usually Not”	Chang, Li	Board of Governors of the Federal Reserve System
2015	Promoting an open research culture	Nosek et al.	Science
2014	An open investigation of the reproducibility of cancer biology research	Errington et al.	eLife
2014	Investigating Variation in Replicability: A “Many Labs” Replication Project	Klein et al.	Social Psychology
2011	False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant	Simmons et al.	Psychological Science
2005	Why Most Published Research Findings Are False	Ioannidis	PLoS Medicine
1992	Electronic documents give reproducible research a new meaning	Claerbout, Karrenbach	SEG Technical Program Expanded Abstracts 1992

/ filter · j k or ↑ ↓ select · Enter open page · c copy BibTeX