LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation

· Editorial Team estimated
vision-language-models embodied-navigation generalist-policies robot-learning spatial-intelligence

LightNav-0 is a compact generalist navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads. A unified token interface expresses task-, scene-, and embodiment-agnostic spatial intent through dual-channel pointing, while a residual vector-quantized action tokenizer maps that intent to precise, embodiment-specific trajectories. Trained on 2K+ scenes and 4K+ hours of embodied navigation data, LightNav-0 achieves state-of-the-art monocular success rates across all 10 public navigation simulation settings and demonstrates zero-shot generalization across robot embodiments and dynamic targets in the real world.

Paper · arXiv:2608.30935

Embodied navigation forces agents to translate heterogeneous goals — a verbal instruction, an open-vocabulary object name, a person to follow — into actions, and to do so across tasks, environments, and robot embodiments. Modern vision-language models already encode spatial priors for visual grounding, spatial reasoning, and pointing, but these capabilities are rarely elicited directly for robot control. Existing navigation systems instead bolt on task- or embodiment-specific components, fragmenting perception, reasoning, and action while limiting generalization.

Core Innovation

LightNav-0 is a compact generalist model that extracts the spatial intelligence of a pretrained VLM and aligns it with navigation — without task-specific prediction heads. The key design choice is a unified token interface: dual-channel pointing expresses task-, scene-, and embodiment-agnostic spatial intent (where to look, where to go), while a residual vector-quantized action tokenizer maps that intent into precise, embodiment-specific trajectories.

Temporally aware visual history compression lets the model reason over time; ER mid-training, supervised fine-tuning, and reinforcement learning refine the alignment. The result is a single model that handles instruction following, open-vocabulary object navigation, and visual tracking.

Results

  • Training scale: a navigation corpus spanning 2K+ scenes and 4K+ hours of embodied navigation data.
  • Reasoning backbone: LightNav-ER, the checkpoint used to initialize LightNav-0, attains the highest complete-set average across 8 embodied-reasoning benchmarks.
  • Simulation: LightNav-0 achieves state-of-the-art monocular success rates across all 10 public navigation simulation settings.
  • Real world: zero-shot generalization across robot embodiments, diverse scenes, and both static and dynamic targets.

Limitations

The abstract reports benchmark leadership but does not detail failure modes — for example, performance on very long horizons, extreme clutter, or novel scene types is not broken out. As a compact model, its ceiling may be below much larger VLMs on pure reasoning, even if navigation performance is state of the art. Real-world results are described qualitatively; quantitative hardware-specific numbers are not provided in the abstract.

Industry Implications

A single navigation model that transfers zero-shot across embodiments and scenes is directly relevant to AMR and service robotics fleets: instead of retraining per platform, a fleet could share one navigation backbone while per-robot action tokenizers handle embodiment differences. The unified token interface also lowers the cost of adding new task types — a practical path toward generalist mobile robots. For companies building warehouse, delivery, or inspection robots, this points to VLM-based navigation as a consolidating technology rather than a per-application engineering effort.