Conference paper · 2025

SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers

Yanzheng Xiang, Hanqi Yan, Shuyin Ouyang, Lin Gui, Yulan He

VenueConference on Language Modeling (COLM)
URLhttps://arxiv.org/abs/2504.00255
TopicsReplicHAI / Agentic reproduction: systems & benchmarks
Tagsreplichai
citationKeyxiang2025scireplicate
extraarXiv: 2504.00255 Note: PDF running header claims COLM 2025; not confirmed in DBLP or Semantic Scholar | COLM 2025 per the PDF running header
libraryCatalogbackground/agentic-systems/refs.bib

BibTeX

@inproceedings{xiang2025scireplicate,
	title = {{SciReplicate}-{Bench}: {Benchmarking} {LLMs} in {Agent}-driven {Algorithmic} {Reproduction} from {Research} {Papers}},
	url = {https://arxiv.org/abs/2504.00255},
	booktitle = {Conference on {Language} {Modeling} ({COLM})},
	author = {Xiang, Yanzheng and Yan, Hanqi and Ouyang, Shuyin and Gui, Lin and He, Yulan},
	year = {2025},
	note = {arXiv: 2504.00255
Note: PDF running header claims COLM 2025; not confirmed in DBLP or Semantic Scholar {\textbar} COLM 2025 per the PDF running header},
	keywords = {replichai},
}