[2014/11/30: Updated the L1-norm vs L2-norm loss function via a programmatic validated diagram. Thanks readers for the pointing out the confusing diagram. Next time I will not draw mspaint but actually plot it out.] While practicing machine learning, you may have come upon a choice of the mysterious L1 vs L2. Usually the two decisions are : 1) L1-norm vs L2-norm loss function; and 2) L1-regulariza
![Differences between L1 and L2 as Loss Function and Regularization](https://cdn-ak-scissors.b.st-hatena.com/image/square/dc516068a088d51ffc964068c3e5815c0f1de026/height=288;version=1;width=512/http%3A%2F%2Fwww.chioka.in%2Fwp-content%2Fuploads%2F2013%2F12%2FL1-vs-L2-norm-visualization-3.png)