AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learning

· Editorial Team estimated
vision-language-action-models robotic-manipulation compositional-generalization foundation-models

AC-VLA is a plug-and-play compositional learning framework that addresses trajectory overfitting and perceptual shortcuts in VLA models, achieving ~28% absolute improvement on compositional OOD tasks while maintaining near-perfect in-distribution performance.

Paper · arXiv:2607.15714

Vision-Language-Action (VLA) models excel at end-to-end robotic manipulation but struggle with out-of-distribution (OOD) generalization when familiar sub-tasks are recombined in unseen configurations. AC-VLA identifies two mutually reinforcing failure modes: trajectory overfitting (models overfit to holistic trajectory patterns rather than compositional sub-skill semantics) and perceptual shortcuts (action tokens over-rely on wrist-view textures at the expense of global spatial grounding).

Core innovation. AC-VLA introduces two architecture-agnostic components: (1) a compositional learning module that uses an LLM-driven instruction decomposer and a proprioceptive trajectory aligner to generate dense sub-task supervision, followed by mixed training on complete demonstrations and decomposed data; (2) a state-conditioned asymmetric masking strategy that suppresses wrist-view inputs during closed-gripper phases, enforcing global semantic grounding. Both components integrate directly into any VLA backbone without architectural modification.

Experimental results. Instantiated on pi_0.5 and evaluated on LIBERO and LIBERO-OOD benchmarks, AC-VLA achieves approximately 28% absolute improvement on compositional OOD tasks while maintaining near-perfect in-distribution performance. This demonstrates that the plug-and-play components address generalization without sacrificing nominal performance — a critical property for real-world deployment.

Limitations. The compositional module relies on an LLM for instruction decomposition, adding latency and cost. The asymmetric masking strategy is hard-coded for gripper states and may not transfer directly to non-prehensile manipulation tasks. Evaluation is limited to the LIBERO suite; broader validation across diverse robot platforms and task distributions would strengthen the conclusions.

Industry implications. As VLA models (pi_0, Octo, RT-2) move toward commercial deployment, AC-VLA offers a practical, zero-retraining solution for improving their robustness. The ability to maintain in-distribution performance while substantially improving OOD generalization is directly valuable for any robotics company deploying foundation model policies across heterogeneous environments.