hard20 pts · first answer countsmodel-evaluationdata-leakagecross-validation
Choosing features before cross-validating
With 10,000 random features and 100 rows, you pick the 50 most correlated with the label using all rows, then run 5-fold CV and get 90% accuracy. Labels are actually random. Why?
Discussion 0
Join free to post in the discussion.
Related questions
- Big gap between train and validation accuracyMachine Learning Engineer
- Why keep a separate test setMachine Learning Engineer
- How often a row is validated in k-foldMachine Learning Engineer
- Why stratify the foldsMachine Learning Engineer
- Specificity by handMachine Learning Engineer
- The x-axis of an ROC curveMachine Learning Engineer
- MAE of three errorsMachine Learning Engineer
- MAPE by handMachine Learning Engineer