Conference paper · 2026

RExBench: Can coding agents autonomously implement AI research extensions?

Nicholas Edwards, Yukyung Lee, Yujun Audrey Mao, Yulu Qin, Sebastian Schuster, Najoung Kim

VenueProceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
DOI10.18653/v1/2026.acl-long.745
URLhttps://aclanthology.org/2026.acl-long.745
TopicsReplicHAI / Agent Evals / 01 Research replication & science
languageen
libraryCatalogDOI.org (Crossref)
pages16380-16417
placeSan Diego, California, United States
publisherAssociation for Computational Linguistics
shortTitleRExBench

BibTeX

@inproceedings{edwards_rexbench_2026,
	address = {San Diego, California, United States},
	title = {{RExBench}: {Can} coding agents autonomously implement {AI} research extensions?},
	shorttitle = {{RExBench}},
	url = {https://aclanthology.org/2026.acl-long.745},
	doi = {10.18653/v1/2026.acl-long.745},
	language = {en},
	urldate = {2026-11-06},
	booktitle = {Proceedings of the 64th {Annual} {Meeting} of the {Association} for {Computational} {Linguistics} ({Volume} 1: {Long} {Papers})},
	publisher = {Association for Computational Linguistics},
	author = {Edwards, Nicholas and Lee, Yukyung and Mao, Yujun Audrey and Qin, Yulu and Schuster, Sebastian and Kim, Najoung},
	year = {2026},
	pages = {16380--16417},
}