HAF-VLA: Staging Whole-Body Humanoid Control Inside a Flow-Matching Policy

On a fixed-base arm you can generate the whole action chunk at once. On a humanoid, the order in which you commit to the base, the waist and the hands turns out to decide whether the robot stays upright.

Background

Generalist vision-language-action policies have become good at tabletop manipulation, and almost all of that progress rests on an assumption that is invisible until you remove it: the base does not move. A humanoid breaks the assumption in the most expensive way. Its action space spans locomotion, posture, gaze and two arms, and the dimensions are not independent. If the base drifts or the waist rotates slightly wrong, the arms must compensate, and the compensation is exactly the aggressive, unstable upper-body motion that makes humanoid demos look fragile.

The obvious engineering answer is a hierarchy: a navigation or locomotion policy underneath, an arm policy on top. But splitting the controller also splits the learned representation, and the upper layer loses the ability to reason about how its reach depends on where the robot chose to stand. Adapting a strong mobile-manipulation VLA directly is attractive, except that such models emit one action chunk in a single denoising pass, with no structure that distinguishes base from torso from hands.

Core Innovation

HAF-VLA keeps the pretrained flow-matching VLA intact where it can. The vision-language prefix encoder and the action expert weights are inherited rather than retrained from scratch, which is what makes the adaptation affordable.

The change is in how the action chunk is produced. Instead of denoising the full whole-body action vector in one go, the model runs a staged schedule over a shared action space: first locomotion and head commands, then waist refinement, then full-body manipulation. Each stage conditions on the output of the previous one, so the manipulation stage is not guessing where the base ended up — it is refining a plan that already committed to a base trajectory.

Two mechanisms make the staging work. Learnable stage embeddings tell the action expert which phase it is in, so one set of weights can serve three different generative roles. Cross-stage KV-cache conditioning then carries the earlier stages’ action representations forward, letting later stages refine and augment rather than regenerate. That is the substantive difference from simply running the policy three times with different masks: the conditioning preserves structural dependencies across stages instead of severing them.

Results

The framework is evaluated on six real-world humanoid loco-manipulation tasks, where it is reported to significantly improve the performance of existing models. The claim is comparative — the base flow-matching VLA adapted this way beats the same family of models without the hierarchical action flow — which is the right comparison for isolating the contribution of the staging scheme.

Limitations

The abstract gives no per-task success rates, no baseline identities beyond “existing models”, and no indication of how many trials back each of the six tasks, so the size of the gain cannot be assessed. Six tasks on what appears to be a single humanoid platform is a narrow evidence base for a whole-body control claim, and there is no reported comparison against a conventional hierarchy with a separate locomotion controller — arguably the strongest alternative and the one most teams would deploy today. The stage ordering (locomotion, then waist, then manipulation) is a fixed design decision; tasks where the arms must lead, such as catching or bracing against a surface, may not fit it. Because the action expert is inherited from a mobile-manipulation VLA, the method also inherits that model’s data distribution, and it is unclear how much humanoid-specific data was needed to overcome the mismatch.

Industry Implications

Humanoid teams spend a disproportionate amount of engineering effort on the seam between locomotion and manipulation, usually by building two controllers and a handoff. A result showing that the seam can be moved inside a single pretrained policy, and that ordering the denoising stages is enough to keep the upper body stable, suggests a cheaper architecture: one model, one action space, and a schedule that reflects the physical dependency chain. The practical payoff is fewer bespoke interfaces and less per-platform tuning when moving from one humanoid to another, since the inherited VLA carries the semantic and visual competence. The mechanism itself — stage embeddings plus cross-stage KV-cache conditioning — is generic enough to transfer to other high-dimensional action spaces where dimensions have a natural hierarchy, which is most of them.