medium10 pts · first answer countsllm-fundamentalssampling

Why chat models skip beam search

Beam search keeps several candidate sequences and picks the most likely overall. Why is it rarely used for open-ended chat replies?

A.It can only produce replies in a single languageB.It is banned by the terms of every providerC.It forces the model to answer in fewer than ten wordsD.It tends to give bland, repetitive text at more cost

Discussion 0

Join free to post in the discussion.

Why chat models skip beam search

Discussion 0

Related questions