hard20 pts · first answer countsgpu-computinggpu-memory
OOM late in a long evaluation
An evaluation over 200,000 examples runs out of GPU memory near the end, even inside torch.no_grad(). The loop appends logits to a Python list. What is the fix?
Discussion 0
Join free to post in the discussion.