Blog post · 2024
Introducing SWE-bench Verified
| URL | https://openai.com/index/introducing-swe-bench-verified/ |
|---|---|
| Topics | ReplicHAI / Agent Evals / 02 Software engineering & coding |
| Tags | agent-eval |
Abstract
Measures: Human-validated 500-task SWE-bench subset. Metric: % resolved.
BibTeX
@misc{openai_introducing_2024,
title = {Introducing {SWE}-bench {Verified}},
url = {https://openai.com/index/introducing-swe-bench-verified/},
abstract = {Measures: Human-validated 500-task SWE-bench subset. Metric: \% resolved.},
author = {{OpenAI}},
month = aug,
year = {2024},
keywords = {agent-eval},
}