easy5 pts · first answer countsfine-tuningevaluation
Reading train and validation loss
During fine-tuning, training loss keeps falling but validation loss starts rising after epoch 2. What is most likely happening?
Discussion 0
Join free to post in the discussion.
Related questions
- What full fine-tuning changesMachine Learning Engineer
- Why begin from a pretrained modelMachine Learning Engineer
- Training only a new headMachine Learning Engineer
- Learning rate for fine-tuningMachine Learning Engineer
- Shape of SFT training dataMachine Learning Engineer
- Meaning of PEFTMachine Learning Engineer
- What the LoRA rank r setsMachine Learning Engineer
- Merging a LoRA adapterMachine Learning Engineer