Skip to content

Back to the catalog

Guiding Image-to-3D Generation with Test-Time Partial Observations
arxiv.orgpaper

Guiding Image-to-3D Generation with Test-Time Partial Observations

This paper introduces a training-free framework for incorporating partial geometric observations (e.g. depth or point measurements) at test time into pretrained image-to-3D generative models, without retraining or finetuning. It guides generation via a ray-consistent observation likelihood over the model's occupancy representation, combining surface occupancy and free-space evidence, applied to SAM 3D and its multi-view extension to improve geometric fidelity and visual quality.

TL;DR Training-free test-time guidance injects partial geometric observations into pretrained image-to-3D models like SAM 3D to improve geometric fidelity.

Technologies named here

  • SAM 3D