
MS @CarnegieMellon | Previous BS @sjtu1896
Joined November 2024
- Tweets4
- Following227
- Followers26
- Likes25
Super excited that our paper won the Best Paper Award! 🎉
Grateful to be part of this work and lucky to collaborate with such an awesome team. More to come 🚀
OmniTacTune won the Best Paper Award at the Tactile Sensing for Robotic Foundation Models Workshop at RSS 2026! (tac-for-fm.github.io/rss2026…)
Huge thanks to the coauthors @HaodeZ47056 and @HanYunhai, and our advisors @h_ravichandar and @RuohanGao1.
Haode Zhang retweeted
1/ 👀Vision tells robots where to go. 👋Touch tells robots about the interactions.
2/ Visual policies from teleoperated robot demos and human videos are scaling fast — but they don't have paired tactile data, so they still fail at the last millimeter of contact-rich manipulation.
❓So here is the question:
How can we adapt tactile feedback into pretrained visual policies?
Humans solve this naturally.
1️⃣ Learn from demonstrations through vision: we understand the task structure and the motion priors.
2️⃣ Then practice with touch: we interact with the world, feel what happens, and refine the motion.
🚀 We introduce OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies ⬇️
✦ Adapting tactile feedback into existing visual policies
✦ No offline tactile demonstrations
✦ Real-world RL in 40–80 minutes, 5–40% → 85–100%
✦ Works across human flow policies, ACT, DP, π0.5
✦ Works across different tactile representations
🌐 Website: colinyu1.github.io/omnitactu…
📖 Paper: arxiv.org/abs/2607.03723
📷 Video: youtube.com/watch?v=anRD7lhh…
In this demo, we show four challenging contact-rich manipulation tasks and a 40-mins, one-take recording of an online RL training demo.
1/n


