hard20 pts · first answer countsnormalizationfine-tuning
Fine-tuning a CNN with batch size 2
You fine-tune a pre-trained CNN with BatchNorm using batch size 2 because of memory limits. Validation accuracy is erratic and worse than before fine-tuning. What is the most likely fix?
Discussion 0
Join free to post in the discussion.
Related questions
- Trainable parameters in a LoRA adapterMachine Learning Engineer
- How DPO differs from PPO-based RLHFMachine Learning Engineer
- Fine-tuned model forgets general skillsMachine Learning Engineer
- Third normal formDatabase Administrator
- Knowledge that changes every dayAI Engineer (LLM & Generative AI)
- What LoRA trainsAI Engineer (LLM & Generative AI)
- Counting LoRA parametersAI Engineer (LLM & Generative AI)
- Fine-tuned model scores too wellAI Engineer (LLM & Generative AI)