medium10 pts · first answer countsllm-evaluationonline-evalerror-analysis
Which traces to review
You can review 200 production conversations a week out of 50,000. Intents are 80% order status and 20% spread across refunds, complaints and account issues. How should you sample?
Discussion 0
Join free to post in the discussion.
Related questions
- What exact match measuresPrompt Engineer
- Accuracy from four countsPrompt Engineer
- What a false positive isPrompt Engineer
- 99% accuracy that is uselessPrompt Engineer
- Code checks or an LLM judgePrompt Engineer
- Tracking broken JSONPrompt Engineer
- Grading with or without a referencePrompt Engineer
- Offline and online evaluationPrompt Engineer