Dopamine is a research framework for fast prototyping of reinforcement learning algorithms. It aims to fill the need for a small, easily grokked codebase in which users can freely experiment with wild ideas (speculative research). Our design principles are: Easy experimentation: Make it easy for new users to run benchmark experiments. Flexible development: Make it easy for new users to try out res