medium10 pts · first answer countsllm-as-judgeevaluation
The judge prefers answer A
In pairwise comparisons, your LLM judge picks whichever answer is shown first more often than chance. How do you reduce this effect?
In pairwise comparisons, your LLM judge picks whichever answer is shown first more often than chance. How do you reduce this effect?