easy5 pts · first answer countstransformerscontext-window

What fills the context window

A model has a 128K-token context window. What has to fit inside that limit for a single request?

A.Only the user message; the system prompt is stored separatelyB.The prompt tokens plus the tokens the model generatesC.Only the generated answer; the prompt has its own limitD.The number of characters, not tokens, across the whole chat

Discussion 0

Join free to post in the discussion.

What fills the context window

Discussion 0

Related questions