medium10 pts · first answer countscost-optimisationlatency

Making prompt caching work

Your provider supports prompt (prefix) caching. Each request has a long fixed instruction block, a large fixed document set, and a short user question. How should you order the prompt to benefit most?

A.User question first, then documents, then instructionsB.Put a timestamp at the very start so each request is uniqueC.Randomise the order of documents on every requestD.Fixed instructions and documents first, the changing user question last

Discussion 0

Join free to post in the discussion.

Making prompt caching work

Discussion 0

Related questions