easy5 pts · first answer countsprompt-engineeringsampling-parameters

What top_p controls

An API call sets top_p = 0.9. What does this setting do when the model picks each next token?

A.It forces the model to pick the single most likely token 90% of the timeB.It samples only from the smallest set of tokens whose probabilities add up to 90%C.It cuts the reply off once 90% of max_tokens has been usedD.It lowers every token probability by 10% before sampling

Discussion 0

Join free to post in the discussion.

What top_p controls

Discussion 0

Related questions