[1805.11604] How Does Batch Normalization Help Optimization? (No, It Is Not About Internal Covariate Shift)Batch Normalization (BatchNorm) is a widely adopted technique that enables faster and more stable training of deep neural networks (DNNs). Despite its pervasiveness, the exact reasons for BatchNorm's effectiveness are still poorly understood. The popular belief is that this effectiveness stems from controlling the change of the layers' input distributions during training to reduce the so-called "i
Batch Normalization について軽くまとめ - しえログ
