GloVLA: Let Geometry Move and Local VLA Interact for Robust Object-Centric Manipulation in Unstructured Environments

· Editorial Team estimated
VLA manipulation object-centric robot-learning LIBERO

GloVLA is a hybrid framework that separates object-centric manipulation into two complementary regimes: a geometric transport controller moves the end-effector into interaction-centric handoff regions, while local Vision-Language-Action (VLA) policies handle only the short-horizon, contact-rich interaction phases. It is model-agnostic, integrates with different VLA backbones without additional demonstrations, and requires no changes to the action space or success predicate. Under clutter, distractors, illumination changes, visual shifts, and obstruction, full-trajectory GR00T N1.6 execution degrades to 20.9% average success while GloVLA retains 88.5%. On a physical UR10e, overall success improves from 35.6% to 90.0% while mean inference time is more than halved.

Paper · arXiv:2609.06256

End-to-end Vision-Language-Action (VLA) policies that must both transport the end-effector over long ranges and execute short-horizon, contact-rich interactions are inefficient and brittle: small visual shifts, distractors, clutter, occlusions, or unfavorable initial gripper poses push the policy outside its trained local state distribution and cause task failure. GloVLA addresses this by recognizing that the two regimes have very different failure modes and should not be solved by a single monolithic policy.

Core Innovation

GloVLA is a hybrid, model-agnostic framework that decomposes object-centric manipulation into two explicit regimes. A geometric transport controller moves the end-effector into interaction-centric handoff regions, solving long-range, geometry-dominated motion. Local VLA policies then handle only the short-horizon interaction phases where contact and semantics matter. The framework integrates with different VLA backbones with no additional demonstrations and no changes to the action space or success predicate, making it a lightweight architectural intervention rather than a retraining recipe.

Results

  • On standard LIBERO and LIBERO-Plus Object tasks, plus a newly introduced LIBERO-Challenge benchmark with clutter, distractors, illumination changes, visual shifts, and obstruction, GloVLA improves task success over full end-to-end execution.
  • Under challenge conditions, full-trajectory GR00T N1.6 execution degrades to 20.9% average success while GloVLA retains 88.5%.
  • On a physical UR10e arm, overall success improves from 35.6% to 90.0%, while mean inference time is more than halved.

Limitations

The abstract does not fully specify the evaluation protocol behind the LIBERO-Challenge numbers, and the LIBERO suite remains tabletop-scale even with added perturbations. The transport/interaction split assumes that object-centric tasks can be cleanly separated into a geometric phase and an interaction phase, which may be less natural for highly deformable or articulated manipulation. Full per-task breakdowns and the choice of VLA backbones tested require the complete paper.

Industry Implications

Deploying VLA policies in real production cells means confronting exactly the unstructured conditions GloVLA targets: changing lighting, clutter, distractors, and imperfect initial poses. A framework that roughly doubles real-arm success while halving inference cost is directly relevant to robotic bin picking, kitting, and assembly applications where end-to-end policies currently fail in the field. Because GloVLA is model-agnostic and demonstration-free, integrators can retrofit it onto existing VLA stacks rather than re-collecting data or retraining from scratch.