First, Project Brainwave leverages the massive FPGA infrastructure (opens in new tab)that Microsoft has been deploying over the past few years. By attaching high-performance FPGAs directly to our datacenter network, we can serve DNNs as hardware microservices (opens in new tab), where a DNN can be mapped to a pool of remote FPGAs and called by a server with no software in the loop. This system a