Control

Visual Servoing

Visual servoing is closed-loop robot control in which the feedback signal comes directly from camera measurements. Image-based visual servoing (IBVS) regulates errors defined in image-feature coordinates using the interaction matrix, while position-based visual servoing (PBVS) regulates errors in the estimated 3D pose of the target; hybrid schemes combine both. Continuous visual feedback confers robustness to calibration error and target motion.

Why it matters for physical AI

Closing the loop through vision is what lets robots achieve millimeter-level alignment with imprecise kinematics, and modern learned policies that react to images at high rate are effectively visual servoing generalized beyond hand-designed features.