Binarized Neural Networks

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time and when computing the parameters' gradient at train-time. We conduct two sets of experiments, each based on a different framework, namely Torch7 and Theano, where we train BNNs on MNIST, CIFAR-10 and SVHN, and achieve nearly state-of-the-art results. During the forward

[kaz_uki_1014]

Abstract: In this work we introduce a binarized deep neural network (BDNN) model. BDNNsare trained using a novel binarized back propagation algorithm (BBP), whichuses binary weights and binary neuro...