hard20 pts · first answer countsllm-evaluationonline-eval

Testing on live traffic without risk

You want to see how a new model behaves on real production inputs before any user sees its replies. Which approach fits?

A.A/B test where half the users see the new modelB.Shadow mode: run on live requests, log but hide repliesC.Switch everyone to the new model on a SundayD.Run it only on the original 50 test cases

Discussion 0

Join free to post in the discussion.

Testing on live traffic without risk

Discussion 0

Related questions