Skip to content
Skills
Problems
Questions
Drills
Roles
Skills
Interview
Contest
Leaderboard
Problems
Questions
Drills
Roles
Skills
Interview
Contest
Leaderboard
Home
/
MLOps Engineer
/
Questions
/
Model Serving
MLOps Engineer
Model Serving questions
9 questions on Model Serving for mlops engineers, easiest first.
Easy
4
When batch inference fits
easy
Traffic before the model has loaded
easy
Why export a model to ONNX
easy
Protocol for internal inference calls
easy
Medium
2
Low GPU use under load
medium
Silent wrong predictions from bad input
medium
Hard
3
p99 latency spikes during traffic bursts
hard
Hundreds of low-traffic models
hard
State leaking between requests
hard
