HuMBLE: Human Motion-Driven Behavior Learning for Embodied Locomotion

· Editorial Team estimated
humanoid locomotion human-motion reinforcement-learning distillation sim-to-real

Humanoid locomotion controllers tend to fail in one of two ways: ones optimized purely for command tracking and robustness produce mechanical gaits, while ones tied to human motion data fail to generalize outside that data. HuMBLE is a learning framework that balances the two. It first learns a natural locomotion prior through teacher-student distillation, training a full-body reference-conditioned policy with reinforcement learning and then distilling it into a lightweight prior conditioned only on proprioception and a planar torso-velocity steering command. That prior is then fine-tuned with multi-task RL that pairs a goal-conditioned command-tracking task with a reference-guided task that keeps the human data as an explicit style regularizer. The framework is validated on Boston Dynamics Atlas R1, Atlas D1 and Unitree G1, including real-world user-controlled indoor and outdoor walking and integration as the locomotion layer within hierarchical control stacks.

Paper · arXiv:2610.10489

Humanoid locomotion controllers usually fail in one of two ways: tune them for command tracking and robustness and they walk like machines, or anchor them to human motion data and they cannot step outside it. HuMBLE’s bet is that the conflict is in the training objective, not in the physics, and that it can be resolved.

Background

A humanoid’s gait is both a control signal and a signature of how it was trained. Policies optimized for tracking arbitrary velocity commands and surviving disturbances tend to converge on efficient, mechanical, often stiff motions that look nothing like a person. Policies trained to imitate human motion data look natural but generalize poorly to commands outside that data, which is fatal for a controller that has to accept arbitrary steering inputs. Most deployed stacks pick a side, or layer one on top of the other and inherit both sets of problems.

Core Innovation

HuMBLE treats the conflict as something to balance directly. It starts from an in-house curated locomotion dataset covering diverse speeds and directions and first learns a natural locomotion prior through teacher-student distillation: a full-body reference-conditioned policy is trained with reinforcement learning, then distilled into a lightweight prior conditioned only on proprioception and a planar torso-velocity steering command. That prior is then fine-tuned with multi-task RL that deliberately pairs two objectives, a goal-conditioned task that tracks arbitrary commands to expand coverage and robustness beyond the human data, and a reference-guided task that tracks the human data as an explicit style regularizer. The human data is therefore not the command distribution but a constraint that keeps the gait human even out of distribution.

Results

  • Validated on three humanoids: the Boston Dynamics Atlas R1 and Atlas D1, and the Unitree G1.
  • Robust real-world performance, including direct user-controlled locomotion in indoor and outdoor environments.
  • Integrated as the locomotion layer within hierarchical control stacks.
  • Benchmarks against Tabula Rasa RL policies trained without human data, plus ablations, confirm a lightweight and deployable policy that reconstructs coordinated whole-body behavior from a steering command.
  • The policy retains human gait characteristics while remaining robust and fully steerable.

Limitations

The headline claim is qualitative, that it walks like a person while staying steerable, and the abstract reports no motion-similarity metric or success rate to quantify how much human character survives the fine-tuning stage. The dataset is in-house and curated, so its release status and coverage are unclear, which limits reproduction. Three robots from two vendors is a meaningful spread but a small sample for claiming generality across humanoids. The comparison is against Tabula Rasa RL policies rather than other human-motion-based controllers, so the advantage over the closest alternatives is not directly measured. Integration into a hierarchical stack is demonstrated but not characterized in terms of how the higher layer interacts with the style constraint.

Industry Implications

For humanoid developers, the interesting move is the treatment of human motion data as a style regularizer layered on top of a command-tracking objective rather than as the objective itself. That decouples the two things a commercial locomotion controller must do at once, obey an arbitrary steering command and look acceptable doing it, and it points to a training recipe that produces a small, deployable policy rather than a large imitation network. Validation on the Boston Dynamics Atlas platforms alongside a Unitree G1 is a strong signal that the approach is not tied to one hardware stack, and the ability to sit under a hierarchical controller makes it directly composable with higher-level planners. The open question for adopters is how much of the human character is preserved once the reference-guided term is tuned down for robustness, and whether the whole-body behaviors generalize to terrain and loads outside the curated dataset.