hard20 pts · first answer countssamplingllm-basics

Temperature 0 is not deterministic

You call a hosted model with temperature 0 and the same prompt 20 times, and get 3 slightly different answers. What is the most accurate explanation?

A.Batching and floating-point order shift logits slightly, so near-ties can flipB.Temperature 0 is silently replaced by temperature 1 on all hosted APIsC.The model learns from each call and updates its weights in real timeD.The API caches the first answer, but only for some of the users

Discussion 0

Join free to post in the discussion.

Temperature 0 is not deterministic

Discussion 0

Related questions