Towards Better Aligned LLM Judges for Radiology Report Evaluation across Modalities and Anatomies
arXiv:2604.03376v2 Announce Type: replace Abstract: Current work on radiology report evaluation has focused primarily on LLM-based metrics for chest X-rays (CXR), leaving open whether such approaches remain robust across other modalities and anatomies, and which model and prompt configurations are best suited to serve as LLM judges. We present a comprehensive evaluation of LLM judges for radiology report evaluation across diverse model families, prompting strategies, and adaptation methods, lev…