Skip to content

Back to the catalog

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory
arxiv.orgpaper

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory

WorldCrafter is a video world model that learns a camera-queryable implicit 3D-aware memory to preserve consistency across long horizons and viewpoints during interactive scene exploration. A memory encoder and pose-conditioned readout module, trained jointly with the video generator, compress multi-view historical observations into fixed target-view-specific tokens without explicit depth-based correspondences, and combined with few-step distillation enable streaming exploration from a single image or text prompt with improved long-horizon consistency and camera-control accuracy.

TL;DR A video world model using implicit 3D-aware memory tokens for consistent, camera-controllable long-horizon scene exploration.

Technologies named here

  • WorldCrafter

Techniques named here

  • Camera-queryable implicit 3D-aware memory
  • Memory encoder and pose-conditioned readout module