hard20 pts · first answer countstransformersdecoding

Greedy decoding stuck in a loop

A small model with greedy decoding writes "The product is great. The product is great. The product is great..." Why does greedy decoding fall into such loops?

A.Greedy decoding has a bug that copies the previous sentenceB.The model ran out of vocabulary and reused old tokensC.The stop sequence was too long for the model to produceD.Each repeat makes repeating again the most likely next step

Discussion 0

Join free to post in the discussion.

Greedy decoding stuck in a loop

Discussion 0

Related questions