Teleoperation

Hand Tracking

Hand tracking is the estimation of human hand pose, including wrist position and finger joint angles, from cameras, gloves, or VR headset sensors. Vision-based systems such as MediaPipe Hands and the inside-out tracking on Meta Quest headsets recover 21-keypoint hand skeletons in real time, which teleoperation systems retarget to robot grippers or dexterous hands.

Why it matters for physical AI

Glove-free hand tracking makes teleoperation rigs cheap and portable, enabling large-scale collection of dexterous demonstration data that fuels imitation learning for multi-fingered manipulation.

Build physical AI

Put these concepts to work on real hardware

Axol is a dual-arm robot built for physical AI — teleoperate it, collect demonstrations, and deploy learned policies out of the box.