easy5 pts · first answer countsgpu-computinghardwarecost

Matching the GPU to the job

A team wants to serve a 3B model to modest traffic and also pretrain a 70B model next quarter. Which pairing makes sense?

A.H100 clusters for both, sized the sameB.Consumer gaming GPUs for pretrainingC.CPUs for pretraining, H100 for servingD.L4-class for serving, H100-class for pretraining

Discussion 0

Join free to post in the discussion.

Matching the GPU to the job

Discussion 0

Related questions