D4RT: Unified, Fast 4D Scene Reconstruction & Tracking

Researchers have developed D4RT, a new AI model that can understand dynamic scenes in four dimensions by reconstructing 3D environments from 2D videos while tracking objects through time. The system uses a unified encoder-decoder architecture with a flexible querying mechanism that performs tasks like point tracking, 3D reconstruction, and camera pose estimation up to 300 times faster than previous methods.