Conference paper · 2024
SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories
| Venue | Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing |
|---|---|
| DOI | 10.18653/v1/2024.emnlp-main.702 |
| URL | https://aclanthology.org/2024.emnlp-main.702/ |
| Topics | ReplicHAI / Agentic reproduction: systems & benchmarks |
| Tags | replichai |
| citationKey | bogin2024super |
| libraryCatalog | background/agentic-systems/refs.bib |
| pages | 12622-12645 |
| place | Miami, Florida, USA |
| publisher | Association for Computational Linguistics |
BibTeX
@inproceedings{bogin2024super,
address = {Miami, Florida, USA},
title = {{SUPER}: {Evaluating} {Agents} on {Setting} {Up} and {Executing} {Tasks} from {Research} {Repositories}},
url = {https://aclanthology.org/2024.emnlp-main.702/},
doi = {10.18653/v1/2024.emnlp-main.702},
booktitle = {Proceedings of the 2024 {Conference} on {Empirical} {Methods} in {Natural} {Language} {Processing}},
publisher = {Association for Computational Linguistics},
author = {Bogin, Ben and Yang, Kejuan and Gupta, Shashank and Richardson, Kyle and Bransom, Erin and Clark, Peter and Sabharwal, Ashish and Khot, Tushar},
year = {2024},
keywords = {replichai},
pages = {12622--12645},
}