For game world models, the action labels are the bottleneck, not the video. What makes game data actually trainable? [D]

Most of the public story around game data and world models comes back to one thing: video is cheap, the action that caused each frame is not - vpt: about 2,000 hours of contractor play with keyboard and mouse recorded wa