FactorDrive: Adaptive Multi-Step Reasoning Driven by Planning-Critical Factors for End-to-End Autonomous Driving

Background

Vision-language models have brought explicit reasoning into end-to-end autonomous driving, but two gaps remain. First, existing methods do not sufficiently integrate spatial-physical evidence into planning reasoning — the chain of thought often floats above the geometry and dynamics that actually determine a good trajectory. Second, reasoning adaptation is coarse-grained: models apply roughly the same reasoning pattern to every scene instead of adapting to the planning demands of the situation. Finally, optimizing the reasoning path itself for better planning quality is largely unexplored in autonomous-driving post-training, leaving the reasoning process as a fixed byproduct of instruction tuning.

Core Innovation

FactorDrive structures planning reasoning around planning-critical factors (PCFs). After large-scale driving-domain instruction tuning establishes foundational driving knowledge, the authors construct PCF-CoT, a chain-of-thought dataset that grounds reasoning in trajectory-relevant spatial-physical evidence and organizes the chain around scene-specific PCFs, so the composition and depth of reasoning paths adapt to different planning demands. On top of this, Quality Search-Guided Group Relative Policy Optimization (QS-GRPO) guides Monte Carlo Tree Search (MCTS) with trajectory-level planning rewards to discover reasoning paths that yield higher planning quality, then uses the discovered responses to optimize the policy through GRPO — treating reasoning-path search as a first-class part of post-training rather than an afterthought.

Results

Extensive experiments on open-loop (nuScenes) and closed-loop-oriented (NAVSIM) benchmarks show that FactorDrive achieves state-of-the-art planning performance. The evaluation spans both major evaluation paradigms used in the driving community, and the gains come from the combination of PCF-grounded reasoning and search-guided reasoning optimization rather than from scaling model size.

Limitations

The abstract reports state-of-the-art results without per-metric breakdowns, so the magnitude of the improvements over prior end-to-end planners is not yet quantified publicly. Evaluation is benchmark-based; real-world closed-loop validation and safety-critical edge-case analysis remain to be reported. The MCTS-guided reasoning search adds post-training and inference complexity that needs to be weighed against the planning gains in production settings.

Industry Implications

End-to-end planning is a central battleground for autonomous driving stacks, and verifiable, evidence-grounded reasoning is what regulators and safety teams increasingly expect from learned planners. FactorDrive’s demonstration that reasoning paths can be searched and optimized explicitly — with trajectory-level rewards — points toward a practical recipe for improving planning quality without enlarging models. For companies building production driving systems, the combination of scene-adaptive reasoning depth and search-optimized chain-of-thought is directly relevant to both performance and explainability of planning decisions.