hard20 pts · first answer countsprompt-engineeringprompt-cachingcost
Savings from a cached prefix
Each request has a 10,000-token fixed system prompt plus 1,000 tokens of user input. Input costs $3 per million tokens, and cache reads cost 10% of that. Ignoring cache-write cost, what is the input cost per request when the system prompt is read from cache?
Discussion 0
Join free to post in the discussion.
Related questions
- A business metric for a support botPrompt Engineer
- Budget for one eval runPrompt Engineer
- What top_p controlsPrompt Engineer
- What a stop sequence doesPrompt Engineer
- Reply ends mid-sentencePrompt Engineer
- Estimating tokens from wordsPrompt Engineer
- Letting the model say it does not knowPrompt Engineer
- Asking for a precise lengthPrompt Engineer