hard20 pts · first answer countsai-agentsagents

Cutting cost on easy agent steps

An agent uses a large model for every step, including simple ones like extracting an order id from a message. Costs are high. What is a sound approach?

A.Use the smallest model for every step, including hard planningB.Use a smaller model for simple steps, checked by evals on each stepC.Remove the simple steps and let the user do them insteadD.Use a random model for each step to spread the load

Discussion 0

Join free to post in the discussion.

Cutting cost on easy agent steps

Discussion 0

Related questions