1Carnegie Mellon University, USA 2RWTH Aachen University, Germany 3Inria & Universite Cote d’Azur, France Abstract We present a method that simultaneously addresses the tasks of dynamic scene novel-view synthesis and six degree-of-freedom (6-DOF) tracking of all dense scene elements. We follow an analysis-by-synthesis framework, inspired by recent work that models scenes as a collection of 3D Gaus