
WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
WorldCrafter is a video world model that learns a camera-queryable implicit 3D-aware memory to preserve consistency across long horizons and viewpoints during interactive scene exploration. A memory encoder and pose-conditioned readout module, trained jointly with the video generator, compress multi-view historical observations into fixed target-view-specific tokens without explicit depth-based correspondences, and combined with few-step distillation enable streaming exploration from a single image or text prompt with improved long-horizon consistency and camera-control accuracy.
TL;DR A video world model using implicit 3D-aware memory tokens for consistent, camera-controllable long-horizon scene exploration.
Technologies named here
- WorldCrafter
Techniques named here
- Camera-queryable implicit 3D-aware memory
- Memory encoder and pose-conditioned readout module
Related in multimodal
[AINews] Pi 1.0, Pi Durable, and AIE NYC
Show HN: Made an open-source Lego AI generator
