hard20 pts · first answer countsevaluationmodel-migration

Switching to a newer model

Your team plans to switch the application to a newer, more capable model. What is the right approach for existing prompts?

A.Keep prompts unchanged; newer models always do betterB.Run the full eval set on the new model, review differences, and adjust prompts where behaviour changed before switching trafficC.Delete all examples from prompts since new models do not need themD.Double the length of every prompt

← Can we trust the LLM judge Prompting a reasoning model →