easy5 pts · first answer countsfine-tuningrlhf

Order of classic RLHF stages

The classic RLHF pipeline used for early chat models has three stages. In what order do they run?

A.SFT, then reward model, then RL against the rewardB.Reward model, then pretraining, then SFTC.RL first, then SFT, then the reward modelD.Distillation, then SFT, then pretraining

Discussion 0

Join free to post in the discussion.

Order of classic RLHF stages

Discussion 0

Related questions