Skip to content

Problems QuestionsSkills Interview Contest Leaderboard

Problems QuestionsSkills Interview Contest Leaderboard

Home
AI Engineer (LLM & Generative AI)
Questions
Evaluation

AI Engineer (LLM & Generative AI)

Evaluation questions

12 questions on Evaluation for ai engineer (llm & generative ai)s, easiest first.

Easy 3

Why keep a separate test seteasy
Computing precisioneasy
What a golden set is foreasy

Medium 4

Pairwise LLM judge biasmedium
Computing recall at 5medium
Computing MRRmedium
Judge prefers longer answersmedium

Hard 5

Shipping a prompt change safelyhard
A judge with 90% agreementhard
Computing nDCG at 3hard
Is a 4-point gain realhard
Fine-tuned model scores too wellhard

More AI Engineer (LLM & Generative AI) skills

RAG 11 Embeddings 8 Tool Calling 8 LLM Basics 7 Reliability 7 Sampling 6 Vector Search 6 Agents 6 Prompt Design 5 Transformers 5 Structured Output 5 Latency 5 Security 5 Deployment 5 ML Basics 4 Fine Tuning 4 Retrieval Metrics 4

Evaluation across all roles →

🏆 Evaluation leaderboard →

RED SAG Skills

Free practice for every job role: coding problems, role challenges and mock interviews. Built and managed by RED SAG Fintech Solutions.

Software Engineering

Frontend Developer interview questions
Backend Developer interview questions
Full Stack Developer interview questions
Mobile App Developer interview questions
Game Developer interview questions
Blockchain Developer interview questions

Data, AI & Machine Learning

Machine Learning Engineer interview questions
AI Engineer (LLM & Generative AI) interview questions
Data Scientist interview questions
MLOps Engineer interview questions
Prompt Engineer interview questions
Data Analyst interview questions

Cloud, DevOps & Security

DevOps Engineer interview questions
Cloud Engineer interview questions
Site Reliability Engineer interview questions
Database Administrator interview questions
Cybersecurity Analyst interview questions

© 2026 RED SAG Fintech SolutionsAll roles Coding problems Leaderboard About Careers at RED SAG