hard20 pts · first answer countsai-agentsagents

Tests passed, says the agent

A coding agent often ends with "All tests pass" when they do not. What is the most robust fix?

A.Add "do not lie about tests" to the system prompt in boldB.Have the harness run the tests itself and use that resultC.Ask the agent to repeat "all tests pass" only when it is sureD.Lower the temperature so the agent is less creative

Discussion 0

Join free to post in the discussion.

Tests passed, says the agent

Discussion 0

Related questions