unPIC:How to Spin an Object: First, Get the Shape Right

Rishabh Kabra Drew A. Hudson Sjoerd van Steenkiste João Carreira Niloy J. Mitra

TL;DR Given a single 2D image, unPIC reconstructs 3D objects via a shape-first hierarchical pipeline: it first predicts canonical 3D Normalized Object Coordinates (NOCS) in [0, 1]³ to establish global 3D geometry, then synthesizes appearance (RGB) conditioned on those 3D coordinates to unproject a dense 3D RGB point cloud and reconstruct a Screened Poisson 3D mesh.

Animals & Figurines
01 3D Shape Prior (NOCS)
(R, G, B) = (X, Y, Z) ∈ [0, 1]³
Loading 3D...
02 3D RGB Point Cloud
92,779 points
Loading 3D...
03 Screened Poisson Mesh
102,771 triangles
Loading 3D...
2D → 3D Unproject
Point Size