All You Need Is One GPU: Inference Benchmark for Stable Diffusion

UPDATE 2022-Oct-13 (Turning off autocast for FP16 speeding inference up by 25%) What do I need for running the state-of-the-art text to image model? Can a gaming card do the job, or should I get a fancy A100? What if I only have a CPU? To shed light on these questions, we present an inference benchmark of Stable Diffusion on different GPUs and CPUs. These are our findings: Many consumer grade GPUs