Shuo Cheng retweeted
Can one world model handle rigid boxes, plush toys, and cloth?
Introducing MoRE: a Mixture-of-Experts 3D world model that predicts how objects move across materials and plans real-robot actions with MPC.
See us at #CoRL2026: Monday, Spotlight Session 2 & Poster Session 1 🤠!
Shuo Cheng retweeted
Our group has been spearheading h2r research for a few years.
Excited about @ShuoCheng94 et al.’s fresh take about both *what* and *how* to transfer through test-time optimization!
What should transfer from a human video to a robot?
Human2Any learns how objects interact, then adapts that knowledge through test-time reasoning and planning.
Accepted to #CoRL2026! I'll be presenting in person next week—come say hi!
human2any.github.io (1/n)
What should transfer from a human video to a robot?
Human2Any learns how objects interact, then adapts that knowledge through test-time reasoning and planning.
Accepted to #CoRL2026! I'll be presenting in person next week—come say hi!
human2any.github.io (1/n)
Come chat at our #CoRL2026 poster!
Wed, Nov 11, 10:30 AM–12:00 PM
Lone Star (3rd floor), Poster #48
Paper: arxiv.org/abs/2606.28813
Team: @ShuoCheng94 @chuyez123 @alfie14x @CaelanGarrett @AjayMandlekar @danfei_xu
@GeorgiaTech @ICatGT @NVIDIARobotics @nvidia
2
8
331
Also thanks to @meta_aria (Aria Gen 2) for RBY-1 perception, Rainbow Robotics for RBY-1, and ROBOTERA @roboterax for XHAND hardware!
5
255
Shuo Cheng retweeted
We’ve all seen the cool “Astra for robotics” demos. But behind the scenes? Slow rollouts, hand-engineered APIs, and/or simulated behaviors that struggle on real robots.
How do we make coding agent actually work in the physical world? 🦾 Introducing SimEX: Simulation-Integrated Robotics AutoResearch 🧵
arxiv.org/abs/2609.38982
Shuo Cheng retweeted
Introducing EgoVerse: an ecosystem for robot learning from egocentric human data.
Built and tested by 4 research labs + 3 industry partners, EgoVerse enables both science and scaling
1300+ hrs, 240 scenes, 2000+ tasks, and growing
Dataset design, findings, and ecosystem 🧵
Shuo Cheng retweeted
New essay on robot learning from human data.
I like @karpathy’s idea that LLMs are “ghosts” distilled from human knowledge. In robotics, we are attempting something similar: to summon a sensorimotor ghost.
Our current ritual is teleoperation. It produces data, but strips away the reflexes, priors, and social interactions that make human behavior rich.
My bet: robot learning will scale less with more robots, and more with better models of humans. Right now we lack both the systems and algorithms to model humans well.
If we succeed, the result won’t just be better robots. It may be the first learned theory of how humans act in the physical world. Robots would simply be the first place we deploy it.
Can large-scale sim data enable real-world generalization?🤔
In our new work, we introduce a generalizable domain adaptation setting, where policies must handle real-world situations never presented in the real training data. (1/n)
In evaluation, our method delivers up to 30% higher success rates than the co-training baseline and generalizes to scenarios seen only in simulation, marking a step toward scalable robot learning without large real-world datasets. (4/n)
🤖 Curious how Sim-and-Real Co-Training with OT works?
Read the full paper here: arxiv.org/pdf/2509.18631
Website: ot-sim2real.github.io/
(n/n)
Shuo Cheng retweeted
What if one unified method helps robots learn from human videos across many tasks, many robots?
Meet ImMimic: Cross-Domain Imitation from Human Videos via Mapping and Interpolation (CoRL 2025 Oral Presentation🏆) @ICatGT
Check it here sites.google.com/view/immimi…!
Shuo Cheng retweeted
Introducing EgoMimic - just wear a pair of Project Aria @meta_aria smart glasses 👓 to scale up your imitation learning datasets!
Check out what our robot can do.
A thread below👇








