
reinforcement learning & robotics @sydekickbot
Joined October 2018
- Tweets159
- Following682
- Followers347
- Likes2.5K
Rob retweeted
when we talk about intelligence, we’re talking about RL. all other learning paradigms are shortcuts and hacks.
Rob retweeted
pendulum has fully swung back from where it was last year (“scale up data collection, behavior clone large models”). everyone is finally seeing the shining light of RL!
Rob retweeted
"the bitter lesson comes for robotics" and it's literally a hand-designed architecture with its every component and hyperparameter painstakingly ablated against human-specified performance metrics that is then initialized by standing on the shoulders of humans as it consumes digitized civilizational knowledge of immense scale before it gets slow-cooked during an extended phase of further distilling human knowledge from pristine resources only to then be relentlessly beaten against the well-tuned reward functions of a million partly crowd-sourced and partly prompted-into-existence environments that humans decided were worth hillclimbing in the current quarterly iteration of the human-orchestrated cycle of intelligence creation
Both XM and IMLE have been applied to imitation learning and planning, with similar benefits over Diffusion Policy and Diffuser respectively.
See page 1 of the IMLE policy paper (arxiv.org/pdf/2502.12371) by @krshnrana @roblee_rl David Pershouse and @nikoSuenderhauf.
11/n
Replying to @KL_Div @PengShichong @bryanzhang9 @JitendraMalikCV @realNingYu @paulzhou1108 @krshnrana @roblee_rl @nikoSuenderhauf @mehranag @Moazeni_Alireza @yszhang170 @du_yilun @mikacuy @rmbrualla @GuibasLeonidas
Whew! That was probably the longest thread I've ever written on Twitter. I hope you all found that to be informative :)
In summary, XM is just a special case of the earliest version of IMLE that we had back in 2018.
We've made a number of improvements since then - if you are interested in learning more, I'll tweet about the important ones in the coming weeks. Stay tuned!
Rob retweeted
New imitation learning algo just dropped
Rob retweeted
This looks like a game-changer for robotics and imitation learning! Diffusion policy is hard to run in real-time; the paper proposes IMLE policy, which can run at >110 Hz (a 61x speedup), use 38% less data and achieve better success rates.
Note: I wasn't involved in this work, but nevertheless it’s great to see RS-IMLE working so well in robotics :) All credit goes to @krshnrana, Robert Lee, David Pershouse, @nikoSuenderhauf for such amazing work!
Check out their paper here: arxiv.org/abs/2502.12371
Rob retweeted
Introducing ✨Posed DROID✨, results of our efforts at automatic post-hoc calibration of a large-scale robotics manipulation dataset.
We provide:
🤖 ~36k calibrated episodes with good quality extrinsic calibration
🦾 ~24k calibrated multi-view episodes with good-quality multi-view camera calibration
✅ Quality assessment metrics for all provided camera poses
To achieve this, we utilize:
1️⃣ Auto Segment Anything (SAM) based filtering (Camera-to-Base Calibration)
2️⃣ Tuned CtRNet-X for bringing in additional cams (Camera-to-Base Calibration)
3️⃣ Pretrained DUST3R with depth-based pose optimization (Camera-to-Camera Calibration)
Try it out at: droid-dataset.github.io/
Learn more at:
🌐 arXiv: arxiv.org/pdf/2403.12945
📄 Blog: medium.com/p/4ddfc45361d3
🧵 1/n
Rob retweeted
1/ Real2Sim and Sim2Real are well-known paradigms in robotics🤖. Is there another paradigm where sim and the real world are more tightly interlinked? We introduce Real-IS-Sim: a framework featuring an always-in-the-loop, correctable simulator for behavior cloning policies.
Rob retweeted
🚀 Embodied Gaussians is now opensource! 🔥
📂 GitHub: github.com/bdaiinstitute/emb…
✨ Key Features:
1️⃣ Gaussian Splatting (GSplat) + Physics (Warp) 💥
2️⃣ Parallelizable environments! ⚡
3️⃣ Render virtual cameras in parallel 📸
🔜 Coming Soon (hopefully):
🌀 Deformables!
Rob retweeted
Stoked to announce that BricksRL, our paper on using PyTorch/TorchRL to train the LEGO® robots in the wild has been accepted at @NeurIPSConf as a spotlight paper! 🪢
Rob retweeted
The wait is finally over!!! 😁
We just dropped an in-depth tutorial on how to build your own robot!
Teach it new skills by showing it a few moves with just a laptop.
Then watch your homemade robot act autonomously 🤯
1/🧵👇
Rob retweeted
✨Our 3D vision meets robotics papers list in the era of large models now has 80+ papers and crossed 50 stars and growing🚀
github.com/zubair-irshad/Awe…
Topics include policy learning, VLMs and VLAs, 3D Representations including NeRF, Gaussian Splatting, Simulations and Benchmarks and 3D Pretraining.
Check it out now. Contributions/Feedback welcome.
Rob retweeted
10 years after DQN, what are deep RL’s impacts on robotics? Which robotic problems have seen the most thrilling real-world successes thanks to DRL? Where do we still need to push the boundaries, and how?
Our latest survey explores these questions! Read on for more details. 👇
Rob retweeted
A great research project I would like to share: 𝗙𝗢𝗨𝗡𝗗𝗔𝗧𝗜𝗢𝗡 𝗣𝗢𝗦𝗘 𝗠𝗘𝗘𝗧𝗦 𝗗𝗜𝗙𝗙𝗨𝗦𝗜𝗢𝗡 𝗣𝗢𝗟𝗜𝗖𝗬
Long-horizon tasks with different objects are hard for robots to learn by imitation because they struggle with sample efficiency, generalization, and modularity.
✅ Images and fixed coordinates limit understanding.
✅ Their method uses “affordance-centric” coordinates for better learning.
✅ This helps robots combine small tasks for complex ones and adapt to new tasks.
With this method, robots can effectively learn complex tasks with fewer demonstrations.
Project: policy-decomposition.github.…
Thanks to @krshnrana for bringing my attention to this project! 🫶
•
•
•
•
🔔 Follow @Ilir_AI for updates on #robotics & #ai.
——————————————
🤖 Robotics Telegram: t.ly/gaTBP
🎙 Robotics Podcast: t.ly/MyoUO

















