PanoTac: A Sub-$50 Three-Axis Tactile Fingertip for Contact-Rich Manipulation

Contact-rich manipulation is where vision-only policies break. Pouring salt, scooping grain, sliding a test tube into a rack: the states that matter are barely visible. Fingers occlude the view, granular flow has no stable shape, and force changes are implicit in the pixels at best. A vision-only policy can look like it is performing the task while getting it wrong.

Adding touch is the accepted answer. The hard part is the sensor. Laboratory-grade tactile hardware tends to be expensive, fragile and fiddly to calibrate, which makes instrumenting a fleet of data-collection robots impractical. PanoTac takes the other road: it targets the specifications that make a sensor deployable in quantity.

Core innovation

Three axes of dense touch per fingertip. Each fingertip yields a 12x32x3 representation: 12x32 spatial resolution, with a normal (z) component and two shear (x, y) components at each taxel. The shear channels are the point. Resistance during a grasp, and the incipient slip just before an object slides, live in the tangential forces. A normal-only sensor knows how hard it is pressing but not whether the object is about to escape.

Compliant construction at low cost. The soft fingertip conforms to object geometry, so fragile or irregular objects do not demand precise force control. Under $50 per finger at 60 Hz is what determines whether the sensor can go on many robots and generate data at volume, which is the actual root of the tactile data shortage.

Characterization before policy. The paper quantifies response repeatability and consistency across sensor instances and contact locations. This step is often skipped in tactile papers, yet it decides a fatal question: if you swap a finger or move the contact point, does the mapping the policy learned still hold? Poor cross-instance consistency means every gripper change forces a new data collection round.

Integrated into a visuo-tactile policy. The sensor is not a standalone demo. It feeds a policy jointly with vision and is validated end to end on three tasks.

Results

• Tasks: test-tube preparation, grain scooping, salt pouring.
• Visuo-tactile policies outperform vision-only baselines by an average of 46.7 percentage points.
• Ablations: removing spatial contact information or shear feedback both reduce overall performance, so each contributes independent information.
• Characterization: repeatability plus consistency across instances and contact locations is reported.
• Project page: https://panotac.github.io

That 46.7 point gap deserves care. On tasks like these a vision-only baseline may be close to failing outright — you cannot see salt flow — so a large gain does not imply the same gain on medium-difficulty tasks. The ablations carry more information than the headline number: shear and spatial contact are each irreplaceable, which is direct evidence that the sensor’s design choices were the right ones.

Limitations

The abstract gives relative gains only, no absolute success rates per task, and no episode counts or training details. All three tasks belong to one family — granular or liquid media plus a pinch grasp — with relatively simple contact patterns. Whether the range and resolution suffice for assembly, insertion or cable routing, where force control is finer, is untested. What physical area the 12x32 grid covers, and whether it spans the whole fingertip pad, is not stated. Durability of the compliant sensing element — drift, wear and failure cycles under repeated compression — is the metric that decides whether this reaches a production line, and it is absent from the abstract. At 60 Hz the sensor is fine for slow processes like pouring salt but still slow for impact events such as drops and collisions.

Industry implications

For teams working on dexterous manipulation and dual-arm assembly, the significance is that touch moves from a lab option to a component you can buy in quantity. Under $50, replaceable, with shear: that means instrumenting every line and every data-collection robot, not just a demo cell.

For data strategy, cross-instance consistency matters more than precision. If sensors agree with each other, episodes collected in parallel can be pooled into one training set. If they do not, the cost of calibration eats the advantage of scale. Reporting consistency as a first-class metric is a practice worth copying.

There is also a lesson about task selection. Touch helps most where vision fails for a specific, identifiable reason: occlusion and invisible flow. Where the visual signal is already rich, the marginal value of touch is much smaller. Whether a task needs tactile sensing should be decided by asking whether the critical state is observable, not by asking whether the task involves contact.