Deep learning with COTS HPC systems Adam Coates acoates@cs.stanford.edu Brody Huval brodyh@stanford.edu Tao Wang twangcat@stanford.edu David J. Wu dwu4@cs.stanford.edu Andrew Y. Ng ang@cs.stanford.edu Stanford University Computer Science Dept., 353 Serra Mall, Stanford, CA 94305 USA Bryan Catanzaro bcatanzaro@nvidia.com NVIDIA Corporation, 2701 San Tomas Expressway, Santa Clara, CA 95050 Abstract