easy5 pts · first answer countssampling

What top-k sampling does

With top-k sampling and k = 40, how is the next token chosen?

A.The model generates 40 tokens and keeps the last oneB.The 40 longest tokens are removed from the vocabularyC.The model runs 40 times and votesD.Only the 40 most likely tokens are kept, then one is sampled from them

Discussion 0

Join free to post in the discussion.

What top-k sampling does

Discussion 0

Related questions