Skip to content
Skills
Problems
Questions
Roles
Skills
Interview
Contest
Leaderboard
Problems
Questions
Roles
Skills
Interview
Contest
Leaderboard
Home
/
Skills
/
GPU Memory
GPU Memory
5 practice items · needed by 2 roles
Easy
1
Medium
1
Hard
3
Practice questions
Model does not fit in GPU memory
hard
Memory for 7B parameters in fp16
easy
KV cache size for one long request
medium
KV cache with grouped-query attention
hard
Memory to fully fine-tune 7B with Adam
hard
