easy5 pts · first answer countsllm-fundamentalscontext-window
Does the reply use context space
A model has a 128,000-token context window. Your prompt is 125,000 tokens. Why might you get little or no reply?
Discussion 0
Join free to post in the discussion.
Related questions
- Tokens in a 3,000-word reportAI Engineer (LLM & Generative AI)
- How a reply is generatedAI Engineer (LLM & Generative AI)
- A base model ignores the questionAI Engineer (LLM & Generative AI)
- What 8 billion parameters meansAI Engineer (LLM & Generative AI)
- Do examples in a prompt train the modelAI Engineer (LLM & Generative AI)
- Hello and hello are not the sameAI Engineer (LLM & Generative AI)
- What happens to a token id firstAI Engineer (LLM & Generative AI)
- How the model decides to stopAI Engineer (LLM & Generative AI)