Conference paper · 2026

ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences

Bang Nguyen, Dominik Soós, Qian Ma, Rochana R. Obadage, Zack Ranjan, Sai Koneru, Timothy M. Errington, Shakhlo Nematova, Sarah Rajtmajer, Jian Wu, Meng Jiang

VenueProceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD '26)
DOI10.1145/3770855.3819003
URLhttps://arxiv.org/abs/2602.11354
TopicsReplicHAI / Agentic reproduction: systems & benchmarks
ReplicHAI / Cited in CHI 2027 draft
Tagsreplichai
citationKeynguyen2026replicatorbench
extraarXiv: 2602.11354 Note: arXiv:2602.11354, v3 29 Jun 2026
libraryCatalogbackground/agentic-systems/refs.bib, chi2027/paper/refs.bib
placeJeju Island, Republic of Korea
publisherACM

BibTeX

@inproceedings{nguyen2026replicatorbench,
	address = {Jeju Island, Republic of Korea},
	title = {{ReplicatorBench}: {Benchmarking} {LLM} {Agents} for {Replicability} in {Social} and {Behavioral} {Sciences}},
	url = {https://arxiv.org/abs/2602.11354},
	doi = {10.1145/3770855.3819003},
	booktitle = {Proceedings of the 32nd {ACM} {SIGKDD} {Conference} on {Knowledge} {Discovery} and {Data} {Mining} {V}.2 ({KDD} '26)},
	publisher = {ACM},
	author = {Nguyen, Bang and Soós, Dominik and Ma, Qian and Obadage, Rochana R. and Ranjan, Zack and Koneru, Sai and Errington, Timothy M. and Nematova, Shakhlo and Rajtmajer, Sarah and Wu, Jian and Jiang, Meng},
	year = {2026},
	note = {arXiv: 2602.11354
Note: arXiv:2602.11354, v3 29 Jun 2026},
	keywords = {replichai},
}