medium10 pts · first answer countsgpu-computingcostcapacity-planning
Cost of a pretraining run
A run needs about 1.2 × 10^20 FLOPs. Each GPU sustains 125 TFLOPS in practice and costs $2 per hour. What is the rough compute cost?
Discussion 0
Join free to post in the discussion.