Did your rank just drop sharp in the private leaderboard in a Kaggle competition? I’ve been through that, too. We all learn about overfitting when we started machine learning, but Kaggle makes you really feel the pain of overfitting. Should I have been more careful in the Higgs Boson Machine Learning competition, I would have selected a solution that would gave me a rank 4 than rank 22. I vow to c
![How to Select Your Final Models in a Kaggle Competition](https://cdn-ak-scissors.b.st-hatena.com/image/square/bf7dfd815e3f6ee15ef42eb05060d78049af1b5a/height=288;version=1;width=512/http%3A%2F%2Fwww.chioka.in%2Fwp-content%2Fuploads%2F2014%2F10%2Ftop-score.png)