easy5 pts · first answer countslatency-optimization

Making replies faster

Users complain the assistant is slow. Which change usually cuts response time the most?

A.Adding more examples to the promptB.Raising the temperatureC.Asking for shorter, more focused answers, since output tokens are generated one at a timeD.Writing the prompt in capital letters

Discussion 0

Join free to post in the discussion.

Making replies faster

Discussion 0

Related questions