hard20 pts · first answer countsllm-fundamentalsmodel-migration

Testing a new model on live traffic

Offline evals look good for a new model, but you worry about real traffic you did not foresee. What is a low-risk next step?

A.Run it in shadow mode on live requests, hidden from usersB.Switch all users at once and roll back if complaints come inC.Ask the new model whether it is ready for productionD.Run offline evals again with the same examples

Discussion 0

Join free to post in the discussion.

Testing a new model on live traffic

Discussion 0

Related questions