The Tail at Scale – Communications of the ACMSoftware techniques that tolerate latency variability are vital to building responsive large-scale Web services. Systems that respond to user actions quickly (within 100ms) feel more fluid and natural to users than those that take longer.3 Improvements in Internet connectivity and the rise of warehouse-scale computing systems2 have enabled Web services that provide fluid responsiveness while consu
