hard20 pts · first answer countsllm-fundamentalssampling-parameters

Temperature and top-p together

In common implementations, temperature reshapes the distribution first and top-p then keeps the smallest set of tokens reaching the chosen mass. With top-p fixed at 0.9, what happens when you raise temperature?

A.More tokens fall inside the 0.9 mass, so more can be pickedB.Fewer tokens fall inside the 0.9 mass, so output is saferC.Top-p is switched off whenever temperature goes above 1D.Nothing changes, as the two settings never interact

Discussion 0

Join free to post in the discussion.

Temperature and top-p together

Discussion 0

Related questions