Squeeze the Memory Consumption of Deep Learning — mxnet 0.5.0 documentationSqueeze the Memory Consumption of Deep Learning¶ One important theme about deep learning is to train deeper and larger nets. While the hardware has been upgraded rapidly in recent years, the huge deepnet monsters are always hungry about the GPU RAMS. Being able to use less memory for the same net also means we can user larger batch size, and usually higher GPU utilization rate. This article discus
