TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model

· Editorial Team estimated
humanoid vision-language-action navigation whole-body-control sim-to-real

TANGO is the first whole-body vision-language navigation framework for humanoid robots in cluttered indoor environments. Unlike 2D path-planning approaches, it treats traversal as a continuous geometry-aware whole-body problem: given a natural-language instruction and egocentric RGB observations, TANGO directly predicts 29-DoF joint-space actions. It is trained entirely in simulation using synthesized collision-free traversal behaviors built from global path planning, kinematic whole-body motion generation, obstacle-aware motion editing, and RL-based tracking. TANGO achieves state-of-the-art vision-language navigation results in simulation, outperforming strong modular baselines in obstacle-negotiation scenes, and deploys zero-shot on a Unitree G1 humanoid in cluttered real-world scenes without any real-world navigation training data.

Paper · arXiv:2609.09158

Conventional robot navigation treats movement as 2D path planning, but a humanoid moving through a cluttered space must solve a far harder problem: every step can require coordinated arm placement, torso adjustment, and gait modulation to thread its full body through complex 3D geometry. TANGO reframes navigation as a whole-body, language-conditioned task and learns it end to end.

Core Innovation

TANGO is a whole-body vision-language navigation framework that consumes a natural-language instruction plus egocentric RGB and directly outputs 29-DoF joint-space actions ready for downstream whole-body control. The key training insight is a synthetic data pipeline: diverse collision-free traversal behaviors are generated in simulation via global path planning, kinematic whole-body motion generation, obstacle-aware motion editing, and RL-based tracking. This yields dynamically feasible action supervision for learning language-conditioned whole-body policies — no real-world navigation data is required.

Results

  • State-of-the-art performance in simulated vision-language navigation, outperforming strong modular baselines in challenging scenes that require obstacle negotiation.
  • Extensive simulation experiments across cluttered indoor scenarios.
  • Zero-shot deployment on a Unitree G1 humanoid: robust language-guided traversal in cluttered real-world scenes, with no training on real-world navigation data.

Limitations

The abstract reports simulation-scale comparisons and real-robot deployments, but without quantitative real-world success metrics (e.g., task completion rates or failure counts across scenes). The 29-DoF action output is designed for whole-body control but downstream tracking robustness outside the tested G1 platform is not addressed. Real-world evaluation breadth — number of scenes, objects, and instruction diversity — is not detailed in the abstract.

Industry Implications

Language-guided, cluttered-space traversal is precisely what humanoid robots must master to leave demo labs: navigating aisles, storerooms, and homes while obeying natural-language commands. A purely simulation-trained whole-body navigation policy that transfers zero-shot to commodity hardware like the Unitree G1 points toward scalable training without expensive real-world data collection — a meaningful step for humanoid deployment in logistics, service, and domestic robotics.