Conference paper · 2025

ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Code

Tianyu Hua, Harper Hua, Violet Xiang, Benjamin Klieger, Sang Truong, Weixin Liang, Fan-Yun Sun, Nick Haber

VenueAdvances in Neural Information Processing Systems
DOI10.52202/085713-4687
URLhttps://proceedings.neurips.cc/paper_files/paper/2025/file/cd0d0a873cc3e601c76f46dccc3d4c5f-Paper-Datasets_and_Benchmarks_Track.pdf
TopicsReplicHAI / Agentic reproduction: systems & benchmarks
Tagsreplichai
citationKeyhua2025researchcodebench
libraryCatalogbackground/agentic-systems/refs.bib
volume38, Main Conference

BibTeX

@inproceedings{hua2025researchcodebench,
	title = {{ResearchCodeBench}: {Benchmarking} {LLMs} on {Implementing} {Novel} {Machine} {Learning} {Research} {Code}},
	volume = {38, Main Conference},
	url = {https://proceedings.neurips.cc/paper_files/paper/2025/file/cd0d0a873cc3e601c76f46dccc3d4c5f-Paper-Datasets_and_Benchmarks_Track.pdf},
	doi = {10.52202/085713-4687},
	booktitle = {Advances in {Neural} {Information} {Processing} {Systems}},
	author = {Hua, Tianyu and Hua, Harper and Xiang, Violet and Klieger, Benjamin and Truong, Sang and Liang, Weixin and Sun, Fan-Yun and Haber, Nick},
	year = {2025},
	keywords = {replichai},
}