Plain backprop is terribly slow and everyone wants it to go faster. There are a series of things that can be done to speed up learning: Fudge the Derivative Term Scale the Data Direct Input-Output Connections Vary the Sharpness (Gain) of the Activation Function Use a Different Activation Function Use Better Algorithms A summary of these and other methods can be found in the online article: Efficie