medium10 pts · first answer countsdeep-learningloss-functionsmaths
Gradient size of L1 and L2 losses
For a single prediction with error e = prediction − target, how do the gradients of L1 loss |e| and L2 loss e² compare as e shrinks towards 0?
Discussion 0
Join free to post in the discussion.
Related questions
- Expected starting loss, 10 classesMachine Learning Engineer
- Parameters in nn.Linear(10, 5)Machine Learning Engineer
- Why sigmoid slows deep trainingMachine Learning Engineer
- Range of tanhMachine Learning Engineer
- Cross-entropy loss by handMachine Learning Engineer
- Telling autograd to track a tensorMachine Learning Engineer
- Why wrap inference in no_gradMachine Learning Engineer
- Logging loss without leaking memoryMachine Learning Engineer