medium10 pts · first answer countsprompt-engineeringsampling-parameters

What top_k = 40 means

A model API offers top_k. With top_k = 40, how is the next token chosen?

A.The model writes 40 replies and returns the best oneB.Only the 40 most likely tokens are kept, then one is sampledC.The reply is limited to the 40 most common English wordsD.The top 40 tokens get their probability set equal

Discussion 0

Join free to post in the discussion.

What top_k = 40 means

Discussion 0

Related questions