Preprint · 2025

From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking

Gyeongwon James Kim, Alex Wilf, Louis-Philippe Morency, Daniel Fried

VenuearXiv
URLhttps://arxiv.org/abs/2506.19724
TopicsReplicHAI / Agentic reproduction: systems & benchmarks
Tagsreplichai
archiveIDarXiv:2506.19724
citationKeykim2025autoexperiment
extraNote: Introduces AutoExperiment
libraryCatalogbackground/agentic-systems/refs.bib

BibTeX

@misc{kim2025autoexperiment,
	title = {From {Reproduction} to {Replication}: {Evaluating} {Research} {Agents} with {Progressive} {Code} {Masking}},
	url = {https://arxiv.org/abs/2506.19724},
	publisher = {arXiv},
	author = {Kim, Gyeongwon James and Wilf, Alex and Morency, Louis-Philippe and Fried, Daniel},
	year = {2025},
	note = {Note: Introduces AutoExperiment},
	keywords = {replichai},
}