hard20 pts · first answer countsmodel-evaluationclassification-metricsdrift
Which metric is stable when base rate shifts
Fraud prevalence drops from 2% to 0.5%, but the score distributions within fraud and within legitimate transactions stay the same. Which metric should stay about the same?
Discussion 0
Join free to post in the discussion.
Related questions
- Big gap between train and validation accuracyMachine Learning Engineer
- Why keep a separate test setMachine Learning Engineer
- Definition of precisionMachine Learning Engineer
- Accuracy on imbalanced dataMachine Learning Engineer
- Recall from confusion countsMachine Learning Engineer
- What data drift meansMachine Learning Engineer
- How often a row is validated in k-foldMachine Learning Engineer
- Why stratify the foldsMachine Learning Engineer