Robot Learning

Behavior Transformer (BeT)

Behavior Transformer is an imitation learning method, introduced by Shafiullah et al. in 2022, designed to clone unlabeled, multimodal demonstration data containing several distinct ways of performing tasks. It discretizes actions with k-means clustering, has a transformer predict the cluster plus a continuous residual offset, and thereby captures multiple behavior modes that mean-regression policies average away. VQ-BeT later replaced the clustering with vector-quantized codes.

Why it matters for physical AI

Human demonstrations are inherently multimodal, and BeT's discretize-plus-offset scheme was an influential early answer to mode collapse, a design thread continued by diffusion and flow-based action heads.