hard20 pts · first answer countsfine-tuningllm
Fine-tuned model forgets general skills
After full fine-tuning on a narrow support dataset, your LLM handles support tickets well but has lost general reasoning and formatting skills. What is the best response?
Discussion 0
Join free to post in the discussion.
Related questions
- Why LLMs use subword tokensMachine Learning Engineer
- Trainable parameters in a LoRA adapterMachine Learning Engineer
- Fine-tuning a CNN with batch size 2Machine Learning Engineer
- How DPO differs from PPO-based RLHFMachine Learning Engineer
- Knowledge that changes every dayAI Engineer (LLM & Generative AI)
- What LoRA trainsAI Engineer (LLM & Generative AI)
- Counting LoRA parametersAI Engineer (LLM & Generative AI)
- Fine-tuned model scores too wellAI Engineer (LLM & Generative AI)