Skip to content

Problems Questions Drills Roles Skills Interview Contest Leaderboard

Problems Questions Drills Roles Skills Interview Contest Leaderboard

Home
AI Engineer (LLM & Generative AI)
Questions
Transformers

AI Engineer (LLM & Generative AI)

Transformers questions

5 questions on Transformers for ai engineer (llm & generative ai)s, easiest first.

Easy 1

What LLM pretraining learnseasy

Hard 4

Why long contexts eat GPU memoryhard
Sizing the KV cachehard
Why attention divides by sqrt(d_k)hard
What the causal mask preventshard

More AI Engineer (LLM & Generative AI) skills

Evaluation 12 RAG 11 Embeddings 8 Tool Calling 8 LLM Basics 7 Reliability 7 Sampling 6 Vector Search 6 Agents 6 Prompt Design 5 Structured Output 5 Latency 5 Security 5 Deployment 5 ML Basics 4 Fine Tuning 4 Retrieval Metrics 4

Transformers across all roles →

🏆 Transformers leaderboard →

RED SAG Skills

Free practice for every job role: coding problems, role challenges and mock interviews. Built and managed by RED SAG Fintech Solutions.

Software Engineering

Frontend Developer interview questions
Backend Developer interview questions
Full Stack Developer interview questions
Mobile App Developer interview questions
Game Developer interview questions
Blockchain Developer interview questions

Data, AI & Machine Learning

Machine Learning Engineer interview questions
AI Engineer (LLM & Generative AI) interview questions
Data Scientist interview questions
MLOps Engineer interview questions
Prompt Engineer interview questions
Data Analyst interview questions

Cloud, DevOps & Security

DevOps Engineer interview questions
Cloud Engineer interview questions
Site Reliability Engineer interview questions
Database Administrator interview questions
Cybersecurity Analyst interview questions

© 2026 RED SAG Fintech SolutionsAll roles Coding problems Leaderboard About Careers at RED SAG