hard20 pts · first answer countsai-agentsagents

Blocking a bad agent change

Your agent eval takes 20 minutes and costs $15 per full run. Engineers change prompts many times a day. What is a sensible process?

A.Skip evals for prompt changes, since prompts are not codeB.Run the full suite on every keystroke in the editorC.Run evals only once a year during the annual reviewD.Run a quick suite per change and the full one per release

Discussion 0

Join free to post in the discussion.

Blocking a bad agent change

Discussion 0

Related questions