hard20 pts · first answer countsprompt-engineeringsampling-parameters
How many tokens min_p keeps
Next-token probabilities are 0.50, 0.20, 0.08, 0.05 and 0.04 (others smaller). With min_p = 0.1, a token is kept if its probability is at least min_p × the top probability. How many of these five tokens are kept?
Discussion 0
Join free to post in the discussion.
Related questions
- Raising the temperaturePrompt Engineer
- What top-p controlsPrompt Engineer
- Temperature 0 still variesPrompt Engineer
- What top_p controlsPrompt Engineer
- What a stop sequence doesPrompt Engineer
- Reply ends mid-sentencePrompt Engineer
- Estimating tokens from wordsPrompt Engineer
- Letting the model say it does not knowPrompt Engineer