Preprint · 2025

ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers?

Christine Ye, Sihan Yuan, Suchetha Cooray, Steven Dillmann, Ian L. V. Roque, Dalya Baron, Philipp Frank, Sergio Martin-Alvarez, Nolan Koblischke, Frank J. Qu, Diyi Yang, Risa Wechsler, Ioana Ciuca

VenuearXiv
DOI10.48550/arXiv.2510.24591
URLhttps://arxiv.org/abs/2510.24591
TopicsReplicHAI / Agent & LLM run-to-run variability
ReplicHAI / Agentic reproduction: systems & benchmarks
Tagsreplichai
archiveIDarXiv:2510.24591
citationKeyye2025replicationbench
libraryCatalogbackground/agentic-systems/refs.bib, background/bib/bib-q1q2.bib

BibTeX

@misc{ye2025replicationbench,
	title = {{ReplicationBench}: {Can} {AI} {Agents} {Replicate} {Astrophysics} {Research} {Papers}?},
	url = {https://arxiv.org/abs/2510.24591},
	doi = {10.48550/arXiv.2510.24591},
	publisher = {arXiv},
	author = {Ye, Christine and Yuan, Sihan and Cooray, Suchetha and Dillmann, Steven and Roque, Ian L. V. and Baron, Dalya and Frank, Philipp and Martin-Alvarez, Sergio and Koblischke, Nolan and Qu, Frank J. and Yang, Diyi and Wechsler, Risa and Ciuca, Ioana},
	year = {2025},
	keywords = {replichai},
}