Skip to content
Skills
Problems
Questions
Roles
Skills
Interview
Contest
Leaderboard
Problems
Questions
Roles
Skills
Interview
Contest
Leaderboard
Home
/
Skills
/
LLM As Judge
LLM As Judge
8 practice items · needed by 2 roles
Easy
0
Medium
4
Hard
4
Practice questions
Pairwise LLM judge bias
medium
Judge prefers longer answers
medium
A judge with 90% agreement
hard
The judge prefers answer A
medium
Vague 1-10 judge scores
medium
Can we trust the LLM judge
hard
Judge and candidate from one family
hard
Longer answers keep winning
hard