Robot Learning

3D Diffusion Policy

3D Diffusion Policy (DP3) is a visuomotor imitation learning method, introduced by Ze et al. in 2024, that conditions a diffusion-based action head on compact 3D representations extracted from sparse point clouds rather than on 2D images. The 3D scene encoding yields strong sample efficiency, learning many manipulation tasks from a few dozen demonstrations, and improved robustness to viewpoint and appearance variation.

Why it matters for physical AI

Demonstrations are the scarcest resource in imitation learning, and results like DP3 argue that explicit 3D structure, not just bigger 2D backbones, is a lever for cutting data requirements per skill.