Blog post · 2026

What We Learned by Reproducing 2,200 papers from ICML

Abubakar Abid, Bram Vanroy, Leandro von Werra, Yacine Jernite, Niels Rogge, Nikolay Iyer, Joel Niklaus

VenueHugging Face Blog
URLhttps://huggingface.co/blog/icml-2026-open-reproductions
TopicsReplicHAI / Agentic reproduction: systems & benchmarks
ReplicHAI / Cited in CHI 2027 draft
Tagsreplichai
citationKeyabid2026icmlreproductions
extraNote: Frozen verdicts dataset at https://huggingface.co/datasets/ICML-2026-agent-repro/verdicts; 6,816 logbooks, 2,226 papers, 35,908 claims. Not peer reviewed. Source: chi2027/paper/refs.bib

BibTeX

@misc{abid2026icmlreproductions,
	title = {What {We} {Learned} by {Reproducing} 2,200 papers from {ICML}},
	url = {https://huggingface.co/blog/icml-2026-open-reproductions},
	journal = {Hugging Face Blog},
	author = {Abid, Abubakar and Vanroy, Bram and von Werra, Leandro and Jernite, Yacine and Rogge, Niels and Iyer, Nikolay and Niklaus, Joel},
	month = aug,
	year = {2026},
	note = {Note: Frozen verdicts dataset at https://huggingface.co/datasets/ICML-2026-agent-repro/verdicts; 6,816 logbooks, 2,226 papers, 35,908 claims. Not peer reviewed.
Source: chi2027/paper/refs.bib},
	keywords = {replichai},
}