medium10 pts · first answer countsgpu-computingzerogpu-memory

Offloading optimizer state to CPU

You enable optimizer state offload to CPU so a model fits on fewer GPUs. What trade-off should you expect?

A.More GPU memory and faster stepsB.No change in speed or memoryC.Less GPU memory, but slower stepsD.Lower accuracy from rounding on the CPU

Discussion 0

Join free to post in the discussion.