Learning Terrain-Adaptive Humanoid Locomotion on Granular Terrain

· Editorial Team estimated
humanoid locomotion granular-terrain reinforcement-learning sim-to-real

This work builds a physics-grounded granular contact model from three-dimensional resistive force theory (3D RFT) and simulates granular terrain efficiently for reinforcement learning, replacing rigid or heuristic contact solvers with physically accurate intrusion dynamics that capture penetration and tangential drag. A terrain-adaptive controller is trained via teacher-student RL, with a variational autoencoder compressing terrain information into a compact latent for zero-shot terrain identification and adaptation. MPM/NVIDIA Newton studies show generalization to unseen granular terrains and higher success rates than baselines, and hardware experiments on basalt, dry sand, and beach sand deliver what the authors state is the first demonstration of agile humanoid locomotion on real-world granular terrain.

Paper · arXiv:2609.10286

Humanoid robots have learned to walk on rock, gravel, and stairs, but granular media — sand, dirt, beach, basalt — remains a stubborn frontier. The difficulty is not perception or planning but contact physics: granular ground yields under load, so the foot penetrates, drags, and deforms the substrate. Rigid-contact simulators, on which most locomotion policies are trained, model foot-ground interaction as a hard constraint; simplified granular models bolt on heuristic tangential forces. Neither reproduces the intrusion dynamics that dominate on real sand, which is why policies that look robust in simulation can fail the moment they touch loose ground.

Core Innovation

The paper replaces heuristics with physics. Its contact solver is built on three-dimensional resistive force theory (3D RFT), a continuum model of granular intrusion that accounts for penetration depth and tangential drag as a function of foot velocity and orientation. This solver is embedded in a simulation pipeline efficient enough to drive reinforcement-learning training, so the policy learns against physically accurate granular forces rather than ad-hoc approximations.

On top of the contact model, the authors train a terrain-adaptive locomotion controller via teacher-student RL. A variational autoencoder encodes terrain information into a compact latent representation, giving the student policy a low-dimensional handle on the material it is standing on. That latent supports zero-shot terrain identification and adaptation — the controller can infer and adjust to terrain it has never been trained on.

Results

  • Simulation studies using the material point method (MPM) with NVIDIA Newton show the method generalizes to unseen granular terrains and achieves a significantly higher success rate than baselines.
  • The learned controller demonstrates zero-shot terrain identification and adaptation.
  • Hardware experiments span diverse real-world granular terrains: basalt, dry sand, and beach sand.
  • The authors state this is the first demonstration of agile humanoid locomotion on real-world granular terrain.

Limitations

The abstract does not report per-terrain success rates, energy cost, or walking speed on hardware, so the margin over rigid-contact baselines on real ground is hard to quantify from the summary alone. Granular contact modeling via 3D RFT is most defensible for dry, cohesionless media; wet, cohesive, or vegetated ground is not addressed. Training depends on an MPM-based simulator, which is computationally heavier than rigid-contact engines, and the abstraction may not transfer to every granular material.

Industry Implications

Legged robots are being pushed out of the lab into construction sites, farms, beaches, and disaster fields — almost all of which are covered in loose material. A policy that only works on hard ground is a policy that stalls at the edge of the job site. By making granular contact physically trainable and by learning a terrain-conditioned latent that adapts without prior exposure, this work extends humanoid mobility into exactly the unstructured environments that commercial deployments target. For teams building field humanoids, or simulation vendors building learning-grade granular terrain, this is a meaningful capability step.