Generating Text with Recurrent Neural NetworksGenerating Text with Recurrent Neural Networks Ilya Sutskever ILYA@CS.UTORONTO.CA James Martens JMARTENS@CS.TORONTO.EDU Geoffrey Hinton HINTON@CS.TORONTO.EDU University of Toronto, 6 King’s College Rd., Toronto, ON M5S 3G4 CANADA Abstract Recurrent Neural Networks (RNNs) are very powerful sequence models that do not enjoy widespread use because it is extremely diffi- cult to train them properly. F
