The way you bridge the physical weight to the virtual is to use the center of mass of the physical controller to determine in-game velocity. First, find where that real center-of-mass point is in-game. The controllers are telling you where they are in game-space; it's up to you to peek under the headset and try to calibrate just where the center-of-mass is. Then you track that point relative