Perception

Object Pose Tracking

Object pose tracking is the continuous estimation of an object's 6-DoF position and orientation across a video or sensor stream, updating the pose as the object or camera moves. Trackers combine an initial pose estimate with frame-to-frame updates using image features, depth alignment, or learned models such as FoundationPose, and must remain robust to occlusion and fast motion.

Why it matters for physical AI

Closed-loop manipulation, such as regrasping, insertion, and handovers, depends on knowing where an object is throughout the interaction, not just at the first frame.