easy5 pts · first answer countstransformerstokenizationdecoding

What the end-of-sequence token does

During generation, what is the job of the end-of-sequence (EOS) token?

A.It marks where the system prompt ends and the user message startsB.It is added after every sentence so the model knows to start a new lineC.It replaces unknown words that the tokenizer cannot encodeD.When the model produces it, generation stops because the reply is complete

Discussion 0

Join free to post in the discussion.

What the end-of-sequence token does

Discussion 0

Related questions