hard20 pts · first answer countsmodel-evaluationclassification-metricslabelling
Agreement beyond chance
Two annotators agree on 80% of tickets. Based on how often each uses each label, they would agree 50% of the time by chance. What is Cohen's kappa?
Discussion 0
Join free to post in the discussion.
Related questions
- Big gap between train and validation accuracyMachine Learning Engineer
- Why keep a separate test setMachine Learning Engineer
- Definition of precisionMachine Learning Engineer
- Accuracy on imbalanced dataMachine Learning Engineer
- Recall from confusion countsMachine Learning Engineer
- How often a row is validated in k-foldMachine Learning Engineer
- Why stratify the foldsMachine Learning Engineer
- Specificity by handMachine Learning Engineer