ReplicHAI › Cited in CHI 2027 draft

Shared by Changkun Ou with everyone

Year ↓	Title added	Authors	Venue
2026	Coding-agents can replicate scientific machine learning papers	Hans, Bilionis	arXiv
2026	Deployment Decision Reliability: A Generalizability-Theory Framework for Sizing Long-Horizon Agent Evaluations	Srinivasan	arXiv
2026	Investigating the analytical robustness of the social and behavioural sciences	Aczel et al.	Nature
2026	Many AI analysts, one dataset: Navigating the agentic data science multiverse	Bertran et al.	Proceedings of the National Academy of Sciences
2026	On the Computational Reproducibility of Human-Computer Interaction	Iarygina et al.	Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
2026	Read the Paper, Write the Code: Agentic Reproduction of Social-Science Results	Kohler et al.	arXiv
2026	ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences	Nguyen et al.	Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD '26)
2026	Revibing Code from Papers: Reimplementing HCI Artifacts	Adar et al.	Proceedings of the 39th Annual ACM Symposium on User Interface Software and Technology (UIST '26)
2026	The AI Replication Engine: First Experiments and What's Next	Barbarioli	Institute for Replication (I4R)
2026	This human study did not involve human subjects: Validating LLM simulations as behavioral evidence	Hullman et al.	arXiv
2026	VERITAS: Towards a General-Purpose Replication Tool for Scientific Research	Liu et al.	arXiv
2026	What We Learned by Reproducing 2,200 papers from ICML	Abid et al.	Hugging Face Blog
2025	PaperBench: Evaluating AI's Ability to Replicate AI Research	Starace et al.	Proceedings of the 42nd International Conference on Machine Learning
2025	The 2025 ReproNLP Shared Task on Reproducibility of Evaluations in NLP: Overview and Results	Belz et al.	Proceedings of the 4th Workshop on Generation, Evaluation and Metrics
2024	Nonstandard Errors	Menkveld et al.	The Journal of Finance
2024	Using Large Language Models to Create AI Personas for Replication, Generalization and Prediction of Media Effects: An Empirical Test of 133 Published Experimental Research Findings	Yeykelis et al.	arXiv
2023	What's in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of Psychological Science	Crüwell et al.	Psychological Science
2022	Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty	Breznau et al.	Proceedings of the National Academy of Sciences
2021	Challenges for assessing replicability in preclinical cancer biology	Errington et al.	eLife
2018	Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results	Silberzahn et al.	Advances in Methods and Practices in Psychological Science
2017	The Coefficient of Determination R^2 and Intra-Class Correlation Coefficient from Generalized Linear Mixed-Effects Models Revisited and Expanded	Nakagawa et al.	Journal of the Royal Society Interface
2014	Is Once Enough? On the Extent and Content of Replications in Human-Computer Interaction	Hornbæk et al.	Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
2001	Generalizability Theory	Brennan	Springer
1996	Forming Inferences About Some Intraclass Correlation Coefficients	McGraw, Wong	Psychological Methods

/ filter · j k or ↑ ↓ select · Enter open page · c copy BibTeX