medium10 pts · first answer countsllm-evaluationllm-as-judge

Making judge scores consistent

A judge uses a 1–5 helpfulness scale, but 3s and 4s seem random. What improves consistency most?

A.Define each score level with concrete criteriaB.Ask the judge to be strict and fairC.Use a 1–100 scale for more precisionD.Run the judge at a higher temperature

Discussion 0

Join free to post in the discussion.

Making judge scores consistent

Discussion 0

Related questions