This document discusses benchmarking deep learning frameworks like Chainer. It begins by defining benchmarks and their importance for framework developers and users. It then examines examples like convnet-benchmarks, which objectively compares frameworks on metrics like elapsed time. It discusses challenges in accurately measuring elapsed time for neural network functions, particularly those with
![闇のニコニコ学会β - 闇と欲望とコンピュータビジョン](https://cdn-ak-scissors.b.st-hatena.com/image/square/d7e2a269f736403adacf9a5b31e2a33aeb3dee56/height=288;version=1;width=512/https%3A%2F%2Fcdn.slidesharecdn.com%2Fss_thumbnails%2Fyaminico2014-140425201544-phpapp02-thumbnail.jpg%3Fwidth%3D640%26height%3D640%26fit%3Dbounds)