tech
January 28, 2026
Introducing SAM 3D: Powerful 3D Reconstruction for Physical World Images
This release introduces two new state-of-the-art models: SAM 3D Objects for object and scene reconstruction, and SAM 3D Body for human body and shape...
TL;DR
- Announcement of SAM 3D, including SAM 3D Objects for object/scene reconstruction and SAM 3D Body for human body/shape estimation.
- Release includes training/evaluation data, benchmarks, model checkpoints, inference code, and a parametric human model (MHR).
- Introduction of the Segment Anything Playground for public experimentation with SAM models.
- SAM 3D and SAM 3 are powering Facebook Marketplace's new View in Room feature.
- SAM 3D Objects reconstructs detailed 3D shapes, textures, and layouts from single images, overcoming data limitations with a novel data annotation engine and training recipe.
- SAM 3D Body provides accurate 3D human pose and shape estimation from single images, even in complex scenarios, using a large dataset and automated data engine.
- Limitations for SAM 3D Objects include moderate output resolution and the need for improved object layout reasoning.
- Limitations for SAM 3D Body include the lack of multi-person/human-object interaction reasoning and the need for further improvement in hand pose estimation.