WHOLE-HAND TACTILE SIMULATION

RevoSim

Scalable Multimodal Tactile Simulation
for Dexterous Manipulation

Ke Zhang1,2*   Lixin Xu1,2*   Ziyi Wang3*   Xiyue Dong1,2   Jie Tan2
Lianghu Shao2   Xianpeng Wang1,2   Chuanyu Li2   Renjing Xu1†

1 HKUST(GZ)2 BrainCo3 Georgia Tech

* Equal contribution   † Corresponding author

Read the paper (coming soon)Code Watch demos
Explore the senses BRAINCO REVO3 · ISAAC LAB

01 / TACTILE MODALITIES

Different views
of the same contact.

RevoSim brings two sensor families into one simulator: visuotactile sensing at the five fingertips, and piezoresistive sensing across the palm and finger pads. They capture different aspects of contact.

SYNCHRONIZED TACTILE DEMO

Touch in motion.

Right-hand index fingertip

The simulated hand and its tactile observations, frame by frame. Depth, marker displacement, RGB and distributed pressure remain synchronized throughout the contact sequence.

Download video ↓
ONE RECORDED CONTACT EXAMPLE

All five examples share the same simulation frame from RevoBench, Cup grasp task · right ring fingertip

Fingertip detail.
Whole-hand coverage.

RGB, depth, and markers describe local fingertip contact in different forms. The 6D wrench summarizes the resultant load; distributed pressure preserves where the hand makes contact.

Reading the examples. Pressure is a nonnegative, unitless sensor response. The hand is shown in a fixed reference pose; finger taxel arrays are aligned and arranged within the pads for readability.

RGB and marker displacement are separate outputs; the plotted vectors do not warp the RGB image. The 6D example is a simulator-derived contact wrench.

02 / THE FRAMEWORK

From contact geometry
to synchronized touch.

RevoSim models the BrainCo Revo3 hand in Isaac Lab. Geometry-aware taxel responses and adaptive fingertip sampling produce aligned tactile observations for simulation-based robot learning.

01 / PRESSURE

Follow the hand’s surface.

Object penetration drives each taxel’s calibrated response. Diffusion follows the curved sensing surface, accounts for surface normals, and preserves the total response.

02 / DEPTH

Spend rays where contact occurs.

A coarse 32 × 24 map localizes contact. A 25 × 40 sampling lattice tracks that region, then reconstructs a dense 240 × 320 fingertip observation.

03 / APPEARANCE & MOTION

Render and deform together.

Depth drives the RGB renderer and marker dilation. A temporal shear model contributes tangential deformation at 100 calibrated marker locations per fingertip.

Four views of simulated object grasping, with whole-palm pressure and five fingertip depth observations below
Whole-hand pressure and five fingertip depth observations during simulated object grasping.

Learning with touch

The paper studies in-hand manipulation and grasping in simulation. These experiments provide a foundation for future sim-to-real transfer.

03 / SCALABILITY

Tactile simulation,
in parallel.

Measurements on one NVIDIA RTX 5090. Memory use depends on the selected observations; the largest reported configuration excludes RGB.

4,096

Parallel environments

Depth-conditioned marker displacement at 31.36 GiB, with RGB excluded.

9.2 GiB

Depth at 1,024 environments

Compared with TacMap’s 30.6 GiB in the paper’s depth-only benchmark.

~70%

Lower depth memory use

At 1,024 environments in that comparison. These figures measure memory capacity.

Adding RGB increases memory use. The cumulative setting with depth, pressure, markers, and RGB reaches capacity at 1,024 environments in the reported benchmark.

04 / DATA COLLECTION

Manipulation in motion.
Ready for LeRobot.

RevoSim supports data collection in the LeRobot dataset format. The demonstrations below show manipulation together with camera views, whole-hand pressure, fingertip observations, and recorded trajectories.

FURTHER EVALUATION

Qualitative results coming soon.

Additional task comparisons and tactile evaluation results will be added as they become available.

Citation

@misc{zhang2026revosim,
  title = {{RevoSim}: Scalable Multimodal Tactile Simulation for Dexterous Manipulation},
  author = {Zhang, Ke and Xu, Lixin and Wang, Ziyi and Dong, Xiyue and Tan, Jie and Shao, Lianghu and Wang, Xianpeng and Li, Chuanyu and Xu, Renjing},
  year = {2026},
  url = {https://davidlxu.github.io/RevoSim-web/}
}

Visitor statisticsGoatCounter
— visits— countries & territories
Visits by continent; darker shading indicates more visits
Asia
—
Europe
—
North America
—
South America
—
Africa
—
Oceania
—
Antarctica
—

Expand to load statistics.

Cookie-free visit statistics by GoatCounter, since 20 September 2026 (UTC). Only aggregate country and continent counts are published here. Privacy details.

Repeat visits may count again; totals are not all-time unique people. Locations are approximate. Map: Natural Earth. Country grouping: GeoNames (CC BY 4.0).