hard20 pts · first answer countsevaluationprompt-design

Shipping a prompt change safely

A teammate rewrote the system prompt to fix one customer complaint. How should you decide whether to ship it?

A.Run the full eval set (real and edge-case examples with expected outcomes) before and after, compare scores per category, then ship gradually while monitoringB.Test the one complaint example manually; if it works, ship itC.Ship it and wait for complaintsD.Ask the model whether the new prompt is better

← What LoRA trains Agent stuck in a loop →