hard20 pts · first answer countsmodel-evaluationcalibration
Average prediction versus observed rate
On 10,000 recent loans, a default model's mean predicted probability is 6%, but 3% actually defaulted. AUC is unchanged from launch. What is the most likely issue and fix?
Discussion 0
Join free to post in the discussion.
Related questions
- Big gap between train and validation accuracyMachine Learning Engineer
- Why keep a separate test setMachine Learning Engineer
- How often a row is validated in k-foldMachine Learning Engineer
- Why stratify the foldsMachine Learning Engineer
- Specificity by handMachine Learning Engineer
- The x-axis of an ROC curveMachine Learning Engineer
- MAE of three errorsMachine Learning Engineer
- MAPE by handMachine Learning Engineer