GPU Benchmark Methodology To measure the relative effectiveness of GPUs when it comes to training neural networks we’ve chosen training throughput as the measuring stick. Training throughput measures the number of samples (e.g. tokens, images, etc...) processed per second by the GPU. Using throughput instead of Floating Point Operations per Second (FLOPS) brings GPU performance into the realm of t