Ostrich: Taking Large Strides Through Stiff Contact in Differentiable Dynamics

· Editorial Team estimated
differentiable-simulation rigid-body-dynamics robot-learning GPU trajectory-optimization

Ostrich is a GPU-accelerated differentiable rigid-body simulator that resolves hard contacts and friction with non-smooth Newton iteration at large timesteps (~0.1 s) and differentiates the converged residual via the implicit function theorem, reusing the forward Schur complement to compute the adjoint at O(1) memory per timestep. On real-robot trajectories over a pallet obstacle, Ostrich holds MuJoCo's sim-to-real accuracy at up to 50x larger timesteps. Its gradients converge from random initializations where MJX descends slowly and Newton Semi-Implicit stalls; a warm iteration runs 211x faster than MJX and 4.7x faster than Semi-Implicit. Ostrich differentiates 8,192 parallel worlds on a single 24 GB GPU, sustaining 29x checkpointed MJX's optimization throughput. It closes with gradient-based trajectory optimization over triangle-mesh terrain across a 10 s horizon.

Paper · arXiv:2609.08800

Gradient-based robot learning through contact — trajectory optimization, reinforcement learning, system identification — depends on differentiable simulators, but three properties have historically fought each other: simulation accuracy, gradient reliability, and per-iteration cost. Tape-based engines like MJX and Newton Semi-Implicit need small timesteps to keep contacts numerically tractable, and their backpropagation memory grows linearly with horizon length. Surrogate models bound memory by approximating contact away, but then the gradients lose the very geometry optimization depends on. Ostrich breaks this triangle.

Core Innovation

Ostrich is a GPU-accelerated rigid-body simulator that resolves hard contacts and friction with non-smooth Newton iteration at large timesteps (h ≈ 0.1 s). Rather than backpropagating through a tape, it differentiates the converged contact residual via the implicit function theorem, reusing the forward Schur complement to compute the adjoint at O(1) memory per timestep — constant memory regardless of horizon length. Large steps plus constant memory make long-horizon, contact-rich, gradient-based optimization practical for the first time, including on triangle-mesh terrain rather than only primitive geometry.

Results

  • On real-robot trajectories over a pallet obstacle, Ostrich holds MuJoCo’s sim-to-real accuracy at up to 50x larger timesteps.
  • Gradients converge from random initializations where MJX descends slowly and Newton Semi-Implicit stalls.
  • A warm iteration runs 211x faster than MJX and 4.7x faster than Semi-Implicit.
  • Differentiates 8,192 parallel worlds on a single 24 GB GPU, sustaining 29x checkpointed MJX’s optimization throughput; without checkpointing, both baselines exhaust memory at far fewer worlds.
  • Demonstrates gradient-based trajectory optimization over triangle-mesh terrain across a 10 s horizon.

Limitations

The abstract emphasizes the contact-resolution regime (h ≈ 0.1 s, stiff contact, rigid bodies); deformable bodies and extremely high-frequency effects are not covered. Accuracy claims rest on one real-robot pallet-obstacle trajectory as the sim-to-real anchor. Integration with existing learning frameworks and full benchmark breadth (beyond MJX and Newton Semi-Implicit comparisons) require the complete paper.

Industry Implications

Differentiable simulation is the engine room of modern robot learning: grasping, locomotion, and manipulation policies are trained and tuned against gradients through contact. Ostrich’s combination of large timesteps, constant-memory adjoints, and GPU-scale parallel worlds directly attacks the cost wall that limits contact-rich sim-to-real pipelines. For teams doing policy optimization, system identification, or trajectory optimization over long horizons — and for sim vendors building the next generation of learning-grade physics — this is foundational infrastructure.