easy5 pts · first answer countsmodel-servingdeployment
Same code, different outputs after rebuild
After rebuilding the serving container, outputs changed slightly with no code change. The Dockerfile uses pip install torch transformers with no versions. What should you do?
Discussion 0
Join free to post in the discussion.
Related questions
- When batch inference fitsMLOps Engineer
- Canary deploymentMLOps Engineer
- Traffic before the model has loadedMLOps Engineer
- Why export a model to ONNXMLOps Engineer
- Protocol for internal inference callsMLOps Engineer
- Running a model in shadowMLOps Engineer
- Champion and challengerMLOps Engineer
- Latency and throughputMLOps Engineer