medium10 pts · first answer countsai-agentsagents

Batch discounts for a chat agent

Finance wants your live customer chat agent moved to a batch API that is 50% cheaper. Why is that a poor fit?

A.Batch APIs do not allow any tools or system prompts at allB.Batch APIs are only for images, not text conversationsC.Batch jobs can take hours, but each agent turn needs a quick replyD.Batch APIs charge more for output tokens than live APIs

Discussion 0

Join free to post in the discussion.

Batch discounts for a chat agent

Discussion 0

Related questions