hard20 pts · first answer countstransformersstructured-outputdecoding

JSON parse errors on long outputs

About 3% of your JSON responses fail to parse, all of them for the longest documents. The model otherwise follows the schema well. What should you check first?

A.Whether the finish reason is "length", meaning the output was cut offB.Whether the temperature is above 0.2 for those requestsC.Whether the model was updated by the provider that weekD.Whether the JSON keys use camelCase or snake_case

Discussion 0

Join free to post in the discussion.

JSON parse errors on long outputs

Discussion 0

Related questions