G0.5: One Autoregressive Stream for Robot Reasoning and Action

· Editorial Team estimated
embodied-ai VLA autoregressive-model robot-foundation-model reasoning-and-action

G0.5 unifies robot reasoning and action in a single autoregressive transformer decoder that emits reasoning and action tokens under one objective, surpassing state-of-the-art models across 7 independent regimes, including real-robot fine-tuning (76.7% vs 53.3% for pi0.5 on R1lite/R1pro), the 2025 BEHAVIOR Challenge, DROID zero-shot transfer (82.5%), and LIBERO (98.9%).

Paper · arXiv:2608.11739

The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained vision-language model (VLM) with a separately trained flow-matching action expert. That design reduces the VLM to a context encoder rather than a decision-maker, splitting reasoning from physical behavior. G0.5 challenges this structure: a single transformer decoder emits both reasoning tokens and action tokens under a single training objective.

Core Innovation

G0.5 is a pretrained autoregressive VLA built on three components:

  • A learnable cross-embodiment action tokenizer that maps heterogeneous robot actions into a shared vocabulary, so different morphologies (humanoids, arms, etc.) can be modeled uniformly;
  • A native chain-of-thought stream interleaving task decomposition, object grounding, and action hints with action tokens, so the model reasons before it acts;
  • A visual memory module that injects multi-second history through the vision encoder for long-horizon context.

Because reasoning and action share a single set of weights, the pretrained VLM’s capabilities carry over to physical behavior: the model follows instructions closely, and prompts directly steer action granularity, task horizon, and out-of-distribution scene handling — without further training.

Results

Pretrained on a large collection of robot datasets together with VQA samples, G0.5 surpasses state-of-the-art models across 7 independent regimes:

  • Real-world fine-tuning on R1lite and R1pro robots: 76.7% vs 53.3% for π0.5 and 24.4% for GR00T-N1.7;
  • 2025 BEHAVIOR Challenge: 31.4% on 50 long-horizon household mobile manipulation tasks with a generalist policy, vs 26.3% for π0.5 and 26.1% for the challenge winner;
  • DROID post-training with zero-shot transfer to an unseen environment and objects: 82.5%;
  • LIBERO 98.9%, RoboTwin 2.0 93.3%, SimplerEnv-Bridge 87.3%, plus a language-following Pick-and-Place benchmark.

Limitations

All numbers are self-reported, and the real-robot evidence is concentrated on the R1lite/R1pro platforms; most benchmarks are simulated, leaving cross-platform deployment stability to be verified. The abstract does not disclose the compute, data mix, or scale required for pretraining, so reproduction may be costly.

Industry Implications

A single-stream architecture simplifies the VLA training and deployment pipeline — no separately trained action expert is needed, and joint reasoning-action learning yields stronger instruction following and out-of-distribution handling. For humanoid and embodied-AI companies, prompt-steerable behavior granularity means per-task retraining is no longer required, cutting iteration cost. G0.5 is also strong evidence for the commercial viability of general-purpose robot foundation models.