medium10 pts · first answer countssampling
How many tokens top-p keeps
Sorted next-token probabilities are 0.50, 0.20, 0.15, 0.10, 0.05. With top-p = 0.8, how many tokens stay in the sampling pool?
Discussion 0
Join free to post in the discussion.
Related questions
- Effect of temperatureAI Engineer (LLM & Generative AI)
- Temperature close to zeroAI Engineer (LLM & Generative AI)
- What top-k sampling doesAI Engineer (LLM & Generative AI)
- Temperature changes probabilitiesAI Engineer (LLM & Generative AI)
- Temperature 0 is not deterministicAI Engineer (LLM & Generative AI)
- Survey sent only to app usersData Scientist
- Halving a confidence intervalData Scientist
- Halving the margin of errorData Analyst