Diffusion Models Are Real-Time Game Engines

Researchers developed GameNGen, the first neural network-powered game engine that can simulate the classic video game DOOM in real-time at 20 frames per second. The system uses a diffusion model trained on gameplay data to generate each frame based on player actions and previous frames, achieving visual quality so high that human observers can barely distinguish between real gameplay and AI-generated footage.