Preprint · 2026

Hidden Measurement Error in LLM Pipelines Distorts Annotation, Evaluation, and Benchmarking

Solomon Messing

VenuearXiv
URLhttps://arxiv.org/abs/2604.11581
TopicsReplicHAI / Agent & LLM run-to-run variability
Tagsreplichai
archiveIDarXiv:2604.11581
citationKeymessing2026hidden
libraryCatalogbackground/bib/bib-q1q2.bib

BibTeX

@misc{messing2026hidden,
	title = {Hidden {Measurement} {Error} in {LLM} {Pipelines} {Distorts} {Annotation}, {Evaluation}, and {Benchmarking}},
	url = {https://arxiv.org/abs/2604.11581},
	publisher = {arXiv},
	author = {Messing, Solomon},
	year = {2026},
	keywords = {replichai},
}