hard20 pts · first answer countsgpu-computingperformance
Time for a 4K matmul
A 4,096 × 4,096 by 4,096 × 4,096 BF16 matmul runs on a GPU that sustains 500 TFLOPS. Roughly how long does it take?
Discussion 0
Join free to post in the discussion.
A 4,096 × 4,096 by 4,096 × 4,096 BF16 matmul runs on a GPU that sustains 500 TFLOPS. Roughly how long does it take?
Join free to post in the discussion.