medium10 pts · first answer countsllm-fundamentalssampling

Forcing output to fit a grammar

With a self-hosted model, you need output that always matches a strict format, such as a date regex. Which approach guarantees the shape?

A.A longer prompt that shows the format in capital lettersB.A higher temperature so the model tries more formatsC.Constrained decoding that masks tokens the grammar does not allowD.A second model that guesses what the first one meant

Discussion 0

Join free to post in the discussion.

Forcing output to fit a grammar

Discussion 0

Related questions