I have for some years been running the queries of the DBT-3 benchmark, both to verify the effect of new query optimization features, and to detect any performance regressions that may have been introduced. However, I have had issues with getting stable results. While repeated runs of a query is very stable, I can get quite different results if I restart the server. As an example, I got a coefficie
![Improving the Stability of MySQL Single-Threaded Benchmarks](https://cdn-ak-scissors.b.st-hatena.com/image/square/35b5ee27ec25d205722a97ce4fd7ee354c7ed3a8/height=288;version=1;width=512/https%3A%2F%2Fblogger.googleusercontent.com%2Fimg%2Fb%2FR29vZ2xl%2FAVvXsEhU9PQQsjerlxwggnFg4mfMlpFfJ2AZZ3yvFjXt8rHia_ahXVilierV8uBnMJ45bMBqBgFEu4if-jKlDX354g0uKuWrlr8488wLGuX9YYWAas6qjYuT7shv_8lVBcxWBkzEm5DwaupeIFU%2Fw1200-h630-p-k-no-nu%2Faslr.bmp)