SuperMimic: Scaling Humanoid Whole-Body Control with One Differentiable World Model

Humanoids have been buying dynamics with compute, one motion at a time. SuperMimic learns the dynamics once and lets every motion share them.

Background

The most effective way to give a bipedal humanoid general, natural whole-body behaviour is to make it copy people: collect large motion-capture corpora and train a policy to track every reference motion. This works, and it produces expressive whole-body control, but it carries a structural cost — the learning cost grows roughly linearly, sometimes worse, with the number of motions.

Existing pipelines take one of two forms. The first trains a specialist per motion and distils the specialists into one policy; distillation is lossy, and interference between motions grows as the library grows. The second brute-forces a single policy over all motions with cluster-scale compute. Both accept the same hidden premise: every motion has to rediscover the dynamics from scratch.

The authors ask the obvious question. These motions all run on the same robot and share one set of rigid-body dynamics. Learn the dynamics once, then amortize everything else.

Core Innovation

The core is a differentiable world model fitted from transitions logged by a standard rigid-body simulator, describing the dynamics shared by the whole motion set. World model and tracking policy are optimised together in a single loop: the policy performs short imagined rollouts inside the model, and backpropagation through time over those rollouts supplies analytic gradients, replacing the high-variance sampling estimates of model-free reinforcement learning.

This buys two things at once. Sample efficiency, because analytic gradients carry far more information per rollout than policy-gradient estimates, so short horizons suffice. And amortization, because there is exactly one dynamics model for all motions — adding a motion means continuing to optimise a policy against a shared model rather than paying the dynamics-discovery cost again.

The methodological restraint is worth noting. The authors do not build a bigger policy; they locate the bottleneck in the learning algorithm and replace model-free sampling with a classical model-based control idea. That is why the payoff shows up as an order-of-magnitude compute reduction rather than a few points of success rate.

Results

• Three hours on a single GPU exceeds the return of the prior state-of-the-art motion tracker trained for seven days on 128 GPUs.
• GPU-hours fall by more than 1000x.
• Only 25 of 129,514 benchmark motions fail, against 179 for the baseline; 9.8 hours on two GPUs reaches zero failures.
• Scaling motion data from 1 to 264 hours leaves world-model prediction error stable and makes GPU-hours-to-target grow slowly, which is the precondition for measuring scaling laws.
• The learned policy transfers to a physical Unitree G1 across diverse and acrobatic motions.

Limitations

The abstract reports return and failure counts, not a fine-grained distribution of tracking accuracy, so it is impossible to tell whether the advantage is uniform or concentrated in the long tail. The world model is fitted from a rigid-body simulator’s logs, which caps its fidelity at the simulator’s: contact, friction and actuator-delay effects that the simulator models poorly are inherited by the world model and amplified inside imagined rollouts, exactly where backpropagation is most sensitive to model bias. Hardware demonstrations are confined to one platform, with no evidence of transfer across embodiments, payloads or terrain. And zero failures is measured on a benchmark of motion-capture references that contain no perception loop, external perturbation or online adaptation in unstructured space — what it establishes is that tracking capability can be scaled cheaply, not that whole-body control is field-reliable.

Industry Implications

The immediate effect for humanoid teams is on the R&D budget line. If a tracker covering a hundred thousand motions costs single-digit GPU-hours, motion-library coverage stops being a scarce resource rationed by compute and becomes a data-procurement question: teams can systematically fill in whole task families instead of hand-picking a few representative motions and optimising them repeatedly. That matters for pre-production skill coverage planning, where the old argument was whether adding a motion class justified a cluster-week and the new marginal cost is small enough to A/B directly.

The second effect is iteration cadence. Single-GPU, hour-scale training means an algorithm change gets feedback over the entire motion library within half a day instead of waiting on a week-long cluster job. The finding that world-model error stays stable from 1 to 264 hours of motion suggests the amortization does not decay as the library grows, so the library can be treated as a long-lived asset. The caveat is that simulator fidelity becomes the new single point of failure: the world model learns the simulator’s dynamics, and any sim-to-real gap is transmitted almost directly into the policy, which raises the return on investing in simulator calibration.