hard20 pts · first answer countsfine-tuningevaluation
Splitting chat logs for evaluation
Your dataset has 40,000 chats from 2,000 customers, many repeating similar issues. You split rows randomly into train and test, and the test score is very high. What is the better split?
Discussion 0
Join free to post in the discussion.
Related questions
- What full fine-tuning changesMachine Learning Engineer
- Why begin from a pretrained modelMachine Learning Engineer
- Training only a new headMachine Learning Engineer
- Learning rate for fine-tuningMachine Learning Engineer
- Shape of SFT training dataMachine Learning Engineer
- Reading train and validation lossMachine Learning Engineer
- Meaning of PEFTMachine Learning Engineer
- What the LoRA rank r setsMachine Learning Engineer