easy5 pts · first answer countsdeep-learningoptimization
A learning rate that is too high
You train a model with a very high learning rate. What are you most likely to see?
Discussion 0
Join free to post in the discussion.
Related questions
- Why activation functions existAI Engineer (LLM & Generative AI)
- Different results every inference runMachine Learning Engineer
- Early layers stop learningMachine Learning Engineer
- Why use learning rate warmupMachine Learning Engineer
- Initialisation for a deep ReLU networkMachine Learning Engineer
- Why fp16 needs loss scaling but bf16 usually does notMachine Learning Engineer