medium10 pts · first answer countsmodel-servingcostcapacity-planning
GPU hours for an offline job
You must classify 36 million support tickets. One GPU processes 500 tickets per second. How many GPU hours does the job need?
Discussion 0
Join free to post in the discussion.
Related questions
- When batch inference fitsMLOps Engineer
- Traffic before the model has loadedMLOps Engineer
- Throughput of four replicasMLOps Engineer
- Why export a model to ONNXMLOps Engineer
- Protocol for internal inference callsMLOps Engineer
- GPU bill keeps risingMLOps Engineer
- Cost of an 8-GPU node for a dayMLOps Engineer
- Matching the GPU to the jobMLOps Engineer