Skip to content
Skills
Problems
Questions
Drills
Roles
Skills
Interview
Contest
Leaderboard
Problems
Questions
Drills
Roles
Skills
Interview
Contest
Leaderboard
Home
/
Machine Learning Engineer
/
Questions
/
LLM Serving
Machine Learning Engineer
LLM Serving questions
5 questions on LLM Serving for machine learning engineers, easiest first.
Medium
1
Memory for 4-bit weights
medium
Hard
4
KV cache size for one sequence
hard
Speculative decoding and output quality
hard
Why serving engines page the KV cache
hard
Daily cost of an LLM feature
hard