Changkun Ou/Library

ReplicHAI › Agent Evals › 03 ML & research engineering

Shared by Changkun Ou with everyone

14 entries Export .bib
Year ↓ Title added Authors Venue
Preprint 2026 Can AI Agents Answer Your Data Questions? A Benchmark for Data Agents Ma et al. arXiv
Preprint 2026 Measuring AI Ability to Complete Long Software Tasks Kwa et al. arXiv
Preprint 2025 DSBench: How Far Are Data Science Agents from Becoming Data Science Experts? Jing et al. arXiv
Preprint 2025 HCAST: Human-Calibrated Autonomy Software Tasks Rein et al. arXiv
Blog post 2025 Measuring AI Ability to Complete Long Tasks METR
Preprint 2025 MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering Chan et al. arXiv
Preprint 2025 MLGym: A New Framework and Benchmark for Advancing AI Research Agents Nathani et al. arXiv
Preprint 2025 RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts Wijk et al. arXiv
Preprint 2025 Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows Lei et al. arXiv
Preprint 2024 DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models Huang et al. arXiv
Preprint 2024 InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks Hu et al. arXiv
Preprint 2024 ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code Tang et al. arXiv
Preprint 2024 MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation Huang et al. arXiv
Preprint 2024 SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulation Ma et al. arXiv

/ filter · j k or ↑ ↓ select · Enter open page · c copy BibTeX