easy5 pts · first answer countsoptimisationtraining-debugging

Symptom of a learning rate that is too high

During training, the loss jumps up and down wildly and sometimes becomes NaN. What is the most likely cause?

A.The batch size is too largeB.The learning rate is too highC.The model has too few parametersD.The training set is perfectly balanced

Discussion 0

Join free to post in the discussion.