medium10 pts · first answer countsmodel-monitoringllm-monitoring
More refusals after an update
After the LLM provider updated its model behind the same model alias, your app’s "I can’t help with that" rate tripled. What would have prevented the surprise?
Discussion 0
Join free to post in the discussion.
Related questions
- What concept drift isMLOps Engineer
- What label shift meansMLOps Engineer
- Common PSI thresholdsMLOps Engineer
- Drift test for payment methodMLOps Engineer
- Watching prediction distributionMLOps Engineer
- Missing values jump overnightMLOps Engineer
- A new category appearsMLOps Engineer
- Average latency looks fineMLOps Engineer