Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data
Ego2Robot is a scalable pipeline that converts egocentric human manipulation videos into robot training data through action retargeting, robot-arm visual synthesis, and multi-level quality curation, producing 18,561 hours of data across 15 robot morphologies — the largest ego-to-robot dataset to date. Joint pretraining on Ego2Robot-synthesized and robot data consistently improves out-of-distribution generalization across visual appearance, scene layout, embodiment morphology, and task semantics, with benefits validated on real-robot deployment.
First large-scale ego-to-robot data synthesis pipeline: 18,561 hours across 15 morphologies with disentangled OOD perturbation evaluation and real-robot validation; directly attacks the VLA pretraining data bottleneck. Novelty 27/30, evidence 22/25, industry value 23/25.