Robot Learning

HIL-SERL

HIL-SERL (Human-in-the-Loop Sample-Efficient Reinforcement Learning) is a framework from UC Berkeley (Luo et al., 2024) for training manipulation policies with real-world RL, combining off-policy actor-critic learning seeded with demonstrations and corrective human interventions during training. It reported near-perfect success rates on contact-rich tasks such as insertion and assembly within roughly one to two and a half hours of robot time.

Why it matters for physical AI

Demonstrating that on-robot RL can reach production-grade reliability in hours rather than weeks makes autonomous fine-tuning a practical stage after imitation pretraining for deployed manipulation systems.