Skip to content
Skills
Problems
Questions
Roles
Skills
Interview
Contest
Leaderboard
Problems
Questions
Roles
Skills
Interview
Contest
Leaderboard
Home
/
Skills
/
Transformers
Transformers
8 practice items · needed by 2 roles
Easy
1
Medium
1
Hard
6
Practice questions
Scaling factor in attention
medium
Parameters in a multi-head attention block
hard
Why RoPE encodes relative position
hard
What LLM pretraining learns
easy
Why long contexts eat GPU memory
hard
Sizing the KV cache
hard
Why attention divides by sqrt(d_k)
hard
What the causal mask prevents
hard
