Robostral Navigate: Monocular RGB-Only Visual Navigation with an 8B VLM
Robostral Navigate is an 8B vision-language model for visual navigation that consumes only monocular RGB images — the most ubiquitous sensor across robotic platforms — and predicts waypoints by pointing to the next target in the current camera view. Operating purely in image space makes it robust to changes in camera intrinsics and scene scale, enabling zero-recalibration deployment across wheeled, legged, and aerial robots. It sets a new state of the art on R2R-CE (77.4% success rate) and RxR-CE (75.1%), surpassing the best monocular methods by 10.5 points and even depth- or multi-camera systems by 5.3 points.
Paper · arXiv:2607.20785Background
Visual navigation has traditionally depended on depth sensors, multi-camera rigs, or pre-built maps to achieve reliable results. These hardware assumptions limit the range of platforms that can run learned navigation policies and increase deployment cost. Monocular RGB cameras are the one sensor present on virtually every robotic platform, but monocular navigation policies have historically lagged behind their depth-equipped counterparts.
Core Innovation
Robostral Navigate is an 8B vision-language model that consumes only a stream of monocular RGB images and predicts waypoints by pointing to the next target location in the current camera view. Operating purely in image space — rather than robot-specific coordinates — makes the policy naturally robust to changes in camera intrinsics and scene scale, enabling deployment across wheeled, legged, and aerial robots without recalibration. The training pipeline generates 2.4 million trajectories across 350K simulated scenes. A novel prefix-caching recipe packs entire episodes into single training sequences, reducing training tokens by 22x and cutting training time from months to days. A tree-based attention mask prevents conditioning on previous ground-truth actions, encouraging visually grounded action prediction, and reinforcement learning further improves exploration and recovery capabilities.
Key Results
On the Room-to-Room and Room-Across-Room in Continuous Environments (R2R-CE and RxR-CE) benchmarks, Robostral Navigate sets a new state of the art. On R2R-CE, it achieves a 77.4% success rate, surpassing the best monocular method by 10.5 points and the strongest depth- or multi-camera system by 5.3 points despite using only a single RGB camera. On RxR-CE, it reaches 75.1% success rate, outperforming all monocular baselines. The model demonstrates that careful training design can close and even invert the gap between monocular and depth-equipped navigation.
Limitations
The model was trained and evaluated on simulated environments (Habitat). Real-world deployment on physical robots with the same RGB-only setup would be a necessary next step to validate sim-to-real transfer. The 8B parameter size, while modest by modern LLM standards, may still be challenging for resource-constrained onboard compute. The prefix-caching approach, while dramatically reducing training cost, adds architectural complexity.
Industry Implications
Robostral Navigate has significant implications for scalable robot deployment. By eliminating the need for depth sensors, multi-camera rigs, or pre-built maps, it reduces both hardware cost and calibration effort. The ability to deploy a single policy across wheeled, legged, and aerial robots without modification is transformative for fleet operators and robotics-as-a-service providers. The 22x training token reduction also makes this approach accessible to teams without massive compute budgets. This work pushes toward a future where navigation is a software capability enabled by ubiquitous RGB cameras, not a sensor-dependent integration challenge.