Conference paper · 2025

Rating Roulette: Self-Inconsistency in LLM-As-A-Judge Frameworks

Rajarshi Haldar, Julia Hockenmaier

VenueFindings of the Association for Computational Linguistics: EMNLP 2025
DOI10.18653/v1/2025.findings-emnlp.1361
URLhttps://doi.org/10.18653/v1/2025.findings-emnlp.1361
TopicsReplicHAI / Agent & LLM run-to-run variability
Tagsreplichai
citationKeyhaldar2025rating
libraryCatalogbackground/bib/bib-q1q2.bib

BibTeX

@inproceedings{haldar2025rating,
	title = {Rating {Roulette}: {Self}-{Inconsistency} in {LLM}-{As}-{A}-{Judge} {Frameworks}},
	url = {https://doi.org/10.18653/v1/2025.findings-emnlp.1361},
	doi = {10.18653/v1/2025.findings-emnlp.1361},
	booktitle = {Findings of the {Association} for {Computational} {Linguistics}: {EMNLP} 2025},
	author = {Haldar, Rajarshi and Hockenmaier, Julia},
	year = {2025},
	keywords = {replichai},
}