Data & Benchmarks

Interaction Data

Interaction data is data generated by an agent acting in an environment, pairing observations with the actions taken and their outcomes, as opposed to passive data such as internet video that lacks action labels. Robot interaction data from teleoperation, autonomous rollouts, and interventions carries the causal, closed-loop structure policies need, but it is orders of magnitude scarcer than passive web data.

Why it matters for physical AI

The scarcity of action-labeled experience is the defining bottleneck of robot learning, driving investment in teleoperation fleets, simulation-generated rollouts, and deployment flywheels that convert operations into training data.