easy5 pts · first answer countsmodel-servinghardware
Hardware for a small tree model
A gradient-boosted tree model scores loan applications in 2 ms on a CPU. A teammate wants to move it to a GPU. What is the best reply?
Discussion 0
Join free to post in the discussion.
Related questions
- When batch inference fitsMLOps Engineer
- Traffic before the model has loadedMLOps Engineer
- Why export a model to ONNXMLOps Engineer
- Protocol for internal inference callsMLOps Engineer
- Matching the GPU to the jobMLOps Engineer
- Memory on common data-centre GPUsMLOps Engineer
- Latency and throughputMLOps Engineer
- What TTFT measuresMLOps Engineer