medium10 pts · first answer countsllm-fundamentalssampling
How many tokens min-p keeps
With min-p sampling, a token is kept if its probability is at least min_p times the top token's probability. Probabilities are 0.60, 0.20, 0.10, 0.05 and 0.05, and min_p is 0.1. How many tokens are kept?
Discussion 0
Join free to post in the discussion.
Related questions
- Effect of temperatureAI Engineer (LLM & Generative AI)
- Temperature close to zeroAI Engineer (LLM & Generative AI)
- What top-k sampling doesAI Engineer (LLM & Generative AI)
- Tokens in a 3,000-word reportAI Engineer (LLM & Generative AI)
- How a reply is generatedAI Engineer (LLM & Generative AI)
- A base model ignores the questionAI Engineer (LLM & Generative AI)
- What 8 billion parameters meansAI Engineer (LLM & Generative AI)
- Do examples in a prompt train the modelAI Engineer (LLM & Generative AI)