
reinforcement learning & robotics @sydekickbot
Joined October 2018
- Tweets159
- Following682
- Followers347
- Likes2.5K
Pinned Tweet
Watch our robot repeatedly assemble a collapsible crate, even while I perturb it 😅 It's a long-horizon task that requires many subtle non-prehensile actions.
This model was trained from scratch locally on my 5090 with only ~2 hours of data.
More soon! @sydekickbot
Rob retweeted
when we talk about intelligence, we’re talking about RL. all other learning paradigms are shortcuts and hacks.
Working with RL is always full of fun surprises. This policy learned to adjust its grasp using contact with the table. RGB policy, trained entirely in sim with sparse reward.
More soon @sydekickbot
Rob retweeted
pendulum has fully swung back from where it was last year (“scale up data collection, behavior clone large models”). everyone is finally seeing the shining light of RL!
Rob retweeted
"the bitter lesson comes for robotics" and it's literally a hand-designed architecture with its every component and hyperparameter painstakingly ablated against human-specified performance metrics that is then initialized by standing on the shoulders of humans as it consumes digitized civilizational knowledge of immense scale before it gets slow-cooked during an extended phase of further distilling human knowledge from pristine resources only to then be relentlessly beaten against the well-tuned reward functions of a million partly crowd-sourced and partly prompted-into-existence environments that humans decided were worth hillclimbing in the current quarterly iteration of the human-orchestrated cycle of intelligence creation
I love when robots move like robots should instead of human teleoperated or programmed behaviour.
RL can show the real potential of a given embodiment, beyond human priors.
Replying to @octi_zhang
(2/5) No human demonstrator would teach these behaviors. Our robot tips a rod upright by pushing it against the board’s leg, sets a gear upright by pushing it against its shaft, and flips the nut instead of regrasping it. These are strategies suited to its own gripper, not to a human hand.
Pure RL discovered them in sim, and they transferred zero-shot to the real robot.
This is super impressive, you can see it attempt to get the bonus strawberries a few times and then give up and go back to clearing the level (eg. 1:30).
so it seems like you can let Astra play games by looking at the screen and it'll do pretty well
here it completed Celeste chapter 1 with only a few retries
(this is non-realtime, game is paused when the model thinks)
3
227
Nice!
Replying to @hansenlillemark
In fact, we show that EqF can still learn the same optimal denoising field as Flow Matching!
This is because in high dimensions, the noisy sample itself carries the noise level information: explicit conditioning is superfluous.
2
306
Both XM and IMLE have been applied to imitation learning and planning, with similar benefits over Diffusion Policy and Diffuser respectively.
See page 1 of the IMLE policy paper (arxiv.org/pdf/2502.12371) by @krshnrana @roblee_rl David Pershouse and @nikoSuenderhauf.
11/n
Replying to @KL_Div @PengShichong @bryanzhang9 @JitendraMalikCV @realNingYu @paulzhou1108 @krshnrana @roblee_rl @nikoSuenderhauf @mehranag @Moazeni_Alireza @yszhang170 @du_yilun @mikacuy @rmbrualla @GuibasLeonidas
Whew! That was probably the longest thread I've ever written on Twitter. I hope you all found that to be informative :)
In summary, XM is just a special case of the earliest version of IMLE that we had back in 2018.
We've made a number of improvements since then - if you are interested in learning more, I'll tweet about the important ones in the coming weeks. Stay tuned!
I trained the policy on the right in 2020 with about 1 hour of robot data for my first CoRL paper. I had to use a lot of tricks to get it to work.
The policy on the left was also trained with about 1.5 hours of robot data in total. Robot learning has come a long way!
@sydekickbot
a good model trained on even a simple task with a tiny amount of data feels mesmerising, no matter how many times you see it.
IMLE Policy introduces a new way to train faster and more data efficient behavior cloning policies.
Will be presented at RSS2025!
imle-policy.github.io/
🧵⬇️
Check out the code and dataset!
github.com/krishanrana/imle_…
Paper here: roboticsproceedings.org/rss2…
In collaboration with: @krshnrana @dave_learn @nikoSuenderhauf

















