Learning Reusable Hybrid Motion Priors for Humanoid Locomotion from Motion Imitation

Background

Reinforcement learning can produce robust humanoid controllers, but each new task typically requires a separate policy with its own reward design. Motion imitation provides an alternative source of motor competence by training policies to track retargeted human motions, yet the resulting controllers remain reference trackers and are not directly usable as task policies.

Core Innovation

The paper proposes a three-stage pipeline that converts motion-imitation skills into a reusable Hybrid Motion Prior (HMP):

1. Expert training: Train a policy to imitate retargeted human motion-capture clips
2. Knowledge distillation: Distill the expert into a frozen architecture with a proprioceptive encoder, Residual Vector-Quantized (RVQ) codebook, and action decoder
3. Task training: Train task-level policies to solve locomotion tasks by selecting discrete codebook entries while the HMP remains frozen

Key technical highlights:

• The number of active RVQ stages modulates available gait patterns, creating an interpretable hierarchical codebook structure
• Training the codebook with the “rotation trick” improves latent organization and reduces downstream falls

Results

• Evaluated on velocity tracking, point-goal navigation, and fall-recovery velocity tracking in simulation
• Velocity-tracking policy successfully deployed on a real Unitree G1 robot
• Distillation preserves the expert’s tracking behavior
• Rotation trick produces better latent organization than standard straight-through estimator

Limitations

Current method is validated on only one hardware platform (Unitree G1). The quality of motion priors in the codebook depends on the diversity and quality of motion capture data. Generalization to extreme terrain and complex environments requires further validation.

Industry Implications

Humanoid robotics is one of the most active sectors in robotics today. The reusable HMP architecture can significantly reduce development costs for new humanoid skills — instead of training independent policies for each task, teams can share a frozen motion codebook. This “train once, reuse across tasks” paradigm is directly relevant to platforms like Unitree G1, Tesla Optimus, and other humanoid robots. Robotics companies could train a general motion prior from a modest motion-capture dataset and rapidly adapt it to different application scenarios.