Skip to content
RED SAGSkills
hard20 pts · first answer countsprompt-engineeringprompt-cachingcost

Savings from a cached prefix

Each request has a 10,000-token fixed system prompt plus 1,000 tokens of user input. Input costs $3 per million tokens, and cache reads cost 10% of that. Ignoring cache-write cost, what is the input cost per request when the system prompt is read from cache?

Choose one answer

Discussion 0

Join free to post in the discussion.

Related questions