I joined Michelle Sun on Core Matter to discuss robot skin and tactile sensing, learning across tactile sensors, and industrial research with Unilever and Ocado. Watch: youtu.be/zORIEuxs9_Q
Inside tactile robotics w/ Professor Shan Luo, King's College London
Robot skin changes. Models must adapt.
“But hardware still matters a lot.”
Luo leads the Robot Perception Lab. We discuss Unilever's material-assessment questions, Ocado's delicate-object handling, and the data behind a robot's sense of touch.
GenForce studies transferring force-prediction knowledge across tactile sensors. His ViTacGen example concerns object pushing: learning uses physical touch, while deployment in that task can use vision.
We cover:
› Material assessment and contact force
› Cross-sensor learning with GenForce
› Vision-to-touch generation for object pushing
› What changes when robot skin is replaced?
› Task-specific finger and sensor design
› Unilever, Ocado and open tactile datasets
Chapters
00:00 Cold open: what happens when robot skin changes?
00:29 Why Shan Luo chose tactile sensing
02:04 Scaling tactile data and simulation
03:40 The interface between different sensors
05:04 Material assessment, cleaning and insertion
09:18 Vision, contact and the last mile
11:54 Manipulating transparent objects
14:29 GenForce: transferring force-prediction knowledge
17:59 Hardware, shared datasets and standards
21:43 ViTacGen: learning from touch, deploying with vision
25:42 How tactile sensor skin wears
28:43 Replacement skin and model calibration
30:49 Manufacturing cost and consistency
32:38 TacDiff: designing the finger and policy together
36:47 Industrial research with Unilever and Ocado
40:01 ViTac workshop and open tactile data
45:11 A startup question and a surprise announcement
49:43 What warehouse robots could feel in 2031
Shan Luo retweeted
🏙️ AI fellows to tackle public services challenges through opensource tool development
Backed by $1 million from @Meta & delivered through the Turing, leading British AI specialists are working to modernise critical systems for people across the UK.
bit.ly/4q3Hciy
Shan Luo retweeted
Unlock the future of robotics at the 6th UK Robot Manipulation Workshop! 🤖
📅 Jan 7-8, 2025
📍 King’s College London
This two-day event is your opportunity to dive into the latest in robot manipulation and connect with leading researchers.
Register: loom.ly/1V0bJ5k
Save the dates! We look forwards to welcoming academics, early career researchers, industrial innovators, funding agencies and many others who work on or are interested in robot manipulation research on 7th and 8th January 2025!
Unlock the future of robotics at the 6th UK Robot Manipulation Workshop! 🤖
📅 Jan 7-8, 2025
📍 King’s College London
Become a sponsor or an exhibitor and make your mark!
Learn more and secure your spot:
loom.ly/1V0bJ5k
Shan Luo retweeted
Unlock the future of robotics at the 6th UK Robot Manipulation Workshop! 🤖
📅 Jan 7-8, 2025
📍 King’s College London
Become a sponsor or an exhibitor and make your mark!
Learn more and secure your spot:
loom.ly/1V0bJ5k
Check out our latest paper on a new concept of Tactile Zero-Shot Learning for robotic material recognition, recently published at Robotics and Autonomous Systems.
Paper: sciencedirect.com/science/ar…
Website (with access to videos, code and dataset): sites.google.com/view/multim…
Shan Luo retweeted
The #RSS2023 workshop on Generalizable Manipulation Policy Learning was a great success! Informative presentations, lively discussions, and big thanks to our amazing speakers @andyzeng_, @Xingyu2017, @QinYuzhe, @GeorgiaChal, @JoeLilKim, @ShanLuoRobotics, and all participants!
I will be attending the RSS 2023 conference, reach out to me if you will be also around!
Check out our work on simulation of optical tactile sensors
I will give a talk at the workshop on Interdisciplinary Exploration of Generali…lnkd.in/etEncqYb lnkd.in/e-4TiuCi
Great to have another ViTac workshop at #icra2023! I am incredibly grateful for the inspiring talks delivered by all the speakers and the thought-provoking discussions that took place during the workshop. I would also like to extend my heartfelt appreciat…lnkd.in/et63gKh4
Come and join us at the ViTac workshop at ICRA 2023 that is happening now. #ICRA2023 lnkd.in/ejQQp8f9
As part of the UK Festival of Robotics 2023, on Weds 21st June 4pm - 6pm BST, we will take part in the #RobotLabLive event and will livestream our latest research at the Centre for Robotics Research (CORE) at King's College London.…lnkd.in/eJY-HAh8 lnkd.in/e7-TU9Jk
ICRA 2023 is coming soon! As part of ICRA23 lab tours, we will demonstrate research at our Centre for Robotics Research (CORE) in the MB-4 lab space, at King’s Strand Campus, on 29th May from 9am to 5pm. You will have a chance to t…lnkd.in/egguaACu lnkd.in/eTK4JK4B
This is really sad news Zhanat. I am very sorry to hear that. I remember vividly having Vincent in the ICRA ViTac workshop in Montreal in 2019, and was looking forward to seeing him soon at ICRA in London, I still can’t believe it will not happen. His wor…lnkd.in/efwNq-js
Another exciting news, together with Prof. Nathan Lepora from University of Bristol, Prof. Wenzhen Yuan from Carnegie Mellon University, Prof. Kaspar Althoefer from Queen Mary University of London, Prof. @GordonCheng9 from Technische Universität München …lnkd.in/eJbE9h2g
Only one month left! Our ICRA 2023 ViTac Workshop on "Blending Virtual and Real Visuo-Tactile Perception” will take place on Friday 2nd June. Join us at ICC Capital Suite 6 to discover the latest research in tactile robotics. If you're attending ICRA 2023…lnkd.in/ebFBsvfS
Are you curious about the cutting-edge research in robotic perception of transparent objects? Our recent review paper offers a comprehensive survey of the platforms and latest advances in this field. Transparent object perception is a rapidly developing r…lnkd.in/gUahBvic
[Call for contributions and participation] Get ready for a groundbreaking event! Our highly anticipated ICRA ViTac workshop series is coming to London this year and it's going to be our first-ever hybrid workshop! We're thrilled to bring together world-le…lnkd.in/egApbQqR
We will showcase the cutting-edge robotics research at our Centre for Robotics Research @Kings_CoRe, sponsored by the @UKRobotics UK-RAS Network Robot Lab Live event on 21st June 4pm – 6pm through live-streaming on YouTube, stay tuned! @KingsNMES @kcl_engineering
Here is a pic of another talk I gave at the workshop, but on our research in visuo-tactile learning for manipulating challenging objects. Hope you enjoyed the talk
It was very nice to represent the IET Robotics & Mechatronics Network at the 4th UK Manipulation Workshop last week. Very well organised workshop with a lot of great discussions on the timely topics in robot manipulation!
@IETrobotics














