Puzzling outcomes in A/B testing

A fun upcoming KDD 2012 paper out of Microsoft, "Trustworthy Online Controlled Experiments: Five Puzzling Outcomes Explained" (PDF), has a lot of great insights into A/B testing and real issues you hit with A/B testing. It's a light and easy read, definitely worthwhile. Selected excerpts:We present ... puzzling outcomes of controlled experiments that we analyzed deeply to understand and explain ..

[pcod]

おもしろそう。あとで読もう。