Skip to content
RED SAGSkills
medium10 pts · first answer countsgpu-computingdistributed-training

Strong and weak scaling

You keep the global batch fixed at 1,024 and go from 8 to 64 GPUs, so each GPU gets a smaller batch. What kind of scaling is this?

Choose one answer

Discussion 0

Join free to post in the discussion.

Related questions

More GPUs and distributed training questionsMore Distributed Training questions