Simulation, Telemedicine, Robotics, eXperimental education #Simulation #Robotics #Telemedicine #experimentalEducation #IoT #AI #Haptics

Space
Joined January 2022
Welcome to the official Mayo Clinic #STRX Fellowship account. We look forward to sharing a glimpse into our one-year, accredited fellowship in Jacksonville, FL through education, research, and patient care. Fellowship details: college.mayo.edu/academics/r… @MayoClinicNeuro
1
1
7
1,809
STR-X retweeted
We built a robotics data engine with Astra-level performance at 125x lower cost. And we are open-sourcing the weights today! Introducing Flora, a suite of open models to parse the physical world and turn raw footage into rich training signals. Flora already powers our in-house data engine, labeling 200K hours of videos a day on 500 GPUs. We created it to scale the frontier for robot learning. Now you own the weights too. Flora gives you: - High-quality, timestamped captions to curate and filter human egocentric and robot data; - Dense progress rewards for quality control and RL post-training; - Rubrics scoring for real-world benchmarking Try it today, links in thread:
183
199
65
1,682
122,407
Introducing EmbeddingGemma 2! 🚀 Our lightweight, multimodal embedding model maps text, code, images, video, and audio into a single, unified embedding space. Optimized for on-device use cases, it features: - 740M parameter form factor with modular encoders - Flexible dimension sizes (768dim-128dim) via Matryoshka Representation Learning (MRL) - 8K context window (4x larger than text-only EmbeddingGemma) - A commercially permissive Apache 2.0 license
108
372
137
3,636
269,393
The most important thing we can apply AI to is improving medicine and human health - very excited about this partnership with the CZI and the Virtual Biology Initiative!
Today, Isomorphic Labs joins the Virtual Biology Initiative (VBI) as a founding member. We are helping build an open resource for the global research community to accelerate how we understand and treat disease. Read more here: isomorphiclabs.com/articles/…
240
517
58
5,788
237,448
Still deciding which hands-on training sessions to attend at #NVIDIAGTC Berlin? If robotics is on your agenda, add these two must-attend sessions to your list: 🔹 Building Surgical and Medical Robotics With NVIDIA Isaac for Healthcare: nvidia.com/en-eu/gtc/session… 🔹 From Teleop to Torque: Deploying a GR00T Policy on a Humanoid: nvidia.com/en-eu/gtc/session…
Your #NVIDIAGTC Berlin agenda could use some work. 👀 Don't worry, we have recommended hands-on trainings for you. Explore our lineup to build physical AI skills across NVIDIA Cosmos, visual AI agents, humanoid robot policies, and more. 👉 nvda.ws/4dThidQ
6
16
120
8,969
STR-X retweeted
Today, we are open-sourcing the Innate OS, the intuitive agentic OS for general-purpose robots 🎮 Try it today in our simulator and make the smartest robot ⬇️ Here is a demo with two robots collaborating We are entering the physical agents era, but building for mobile robots is still reserved for PhDs. We designed the Innate OS for intuitiveness, so that everyone can start automating their lives. Innate OS runs on our <$1k open-source robot or on your computer. It takes just a minute to build your first agent in our simulator.
26
32
16
183
63,158
We put GPT-6 Astra in the RoboDojo. 🥋🤖 The RoboDojo Team conducted a comprehensive evaluation of GPT-6 Astra as an embodied agent, including: • RoboDojo Sim & Real, compared with GPT-5.5 and DeepSeek-Flash • Humanoid high-level control • Dexterous piano playing with RoboPianist 🎹 • A systematic study of in-context learning (ICL) Our key takeaway: GPT-6 Astra demonstrates remarkably strong semantic and spatial understanding, together with impressive in-context adaptation. At the same time, physical commonsense remains a clear bottleneck — revealing an important gap between understanding the world and truly reasoning about its physics. Full report & demos: robodojo-benchmark.com/repor… @_wenbozhang (project lead), @wenhaocha1, @frankzydou, @JinWeiyang18434, @YutaoOuyang, @minifullcapsule, @x_h_ucb, @YutaoOuyang, @YueChen614
35
96
31
677
159,891
For 20+ years @ShaneLegg and I've discussed AGI’s potential impact on the economy, science & society. With the DeepMind Institute, we're expanding interdisciplinary research on key questions for the AI era. We hope it spurs the discussions needed to get the next steps right: deepmind.google/institute
341
631
127
3,985
625,154
STR-X retweeted
Gpt-6 astra can do in-context learning on mobile manipulation! • Different environment • Different camera angle • Different layout No text prompt, it infers from video It even chooses when to use end-effector or joint space Trace recording after ⬇️
34
54
15
521
67,561
BREAKING: The Home Robot Companion Wars are coming. Choose your companion! They’re all cute! 🇫🇷 - @pollenrobotics Microduck 🇨🇳 - @mondorobotics Beni 🇯🇵 - @aopico Mirumi 🇯🇵 - @LOVOT_official Lovot 🇨🇳 - @UnitreeRobotics Qmini Which one is your favorite one?
59
67
45
484
70,192
STR-X retweeted
Replying to @nvidia
@nvidia and @huggingface are joining forces! At LeRobot, we believe the future of physical AI must be collaborative, open, and accessible to everyone. This partnership brings incredible momentum to the open robotics community while keeping our commitment to flexible, multi-platform development stronger than ever. Can't wait to see what you all build as we push the boundaries of embodied AI together. 🤗💚
23
69
9
668
96,760
STR-X retweeted
I'm so excited that our @theworldlabs team has achieved a major milestone today! Introducing Atlas - a first of its kind multimodal world model trained from scratch! 🚀 Atlas is capable of generating frames with pixel-perfect camera control, reconstructing large scenes from as few as one single input image, simulating space-time by reframing videos, natively outputting 3D spaces from one or more input images, composing multiple posed images into a consistent 3d world, and more! This is the best camera conditioned world model ever, opening doors to many possible use cases from VFX to robotics. I'm so so so proud of our team!♥️
Introducing Atlas: The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D. Model the world, move the camera, and simulate space & time.
326
1,101
194
9,721
1,263,773
STR-X retweeted
We took part in the research preview of MHS from @AnthropicAI Here is Claude Code running a real SO-ARM101. Nothing in this was trained - no policy, no teleoperation, no demonstrations. The agent measured the workspace itself and wrote the motion. The calibration is the interesting part. No checkerboard, no camera intrinsics: the arm is its own ruler. Torque drops, a human rests the closed gripper on 16 dots the software draws in the camera view, and the robot reads back where they are. 4.1 mm position accuracy, 3.0 mm placement. Best run so far: 12 bricks placed with all four colour groups formed. A full hands-off run, start to finish, is what's next. Research preview today, open source coming soon.
24
87
15
655
57,873
STR-X retweeted
Our friends at @pollenrobotics just dropped Microduck - open source biped for RL and locomotion🦆
We built a small biped robot you can teach new tricks to. Train it in simulation, run it on the real thing. Meet Microduck 🦆 $399, shipping before Christmas. pollen-robotics.com/microduc… github.com/pollen-robotics/m…
3
8
115
10,024
Congratulations 🎊🎈
It is an incredible pleasure to announce the creation of the Cedars-Sinai Center for Autonomous Robotic Surgery. I will serve as founding Director. For 15 years, my team’s work has harnessed AI to quantify surgeon performance and predict patient outcomes. Now we're extending that vision: building surgical robotics with autonomous capabilities that work in tandem with surgeons — augmenting clinical judgment and making surgery safer and more precise. And best of all — I'm not doing this alone. Next post, I'll reveal the co-director building this with me.
1
36
STR-X retweeted
100,000 hours of human hands doing real work. LeRobot format, fully annotated and open. EgoSuite-Open100K from @LightwheelAI X @huggingface: 15,000+ tasks across 15,000+ real scenes, hand + body pose and wrist cams. Recorded across 7 environment categories and 128 scene types, from kitchens and bedrooms to warehouse floors and assembly lines. It's open for academic research and commercial training, and streams straight from the Hub. Always great to see a dataset at this scale released openly on the Hub. More info: hf.co/collections/Lightwheel…
26
78
6
729
45,742
🧠 Predicting delirium in emergency critical care is a major hurdle. A new AI system called DeLiriuMAgents is changing that by simulating multidisciplinary clinical consultations. 🏥 Published in Cell Reports Medicine, this multi-agent LLM framework combines data-driven prediction with clinical specialist reasoning to catch delirium risk early in the emergency department. How it works: 1. EHRPromptAgent: Translates tabular EHR data into clinical narratives. 2. ModelPhysicianAgent: Employs a machine learning model to estimate baseline risk. 3. Multidisciplinary Specialists: Emergency, neurology, and psychiatry agents provide independent clinical reasoning. 4. MedEvidenceAgent: Pulls real-time guidelines and literature via Retrieval-Augmented Generation to reduce hallucinations. 5. DeliriumDecisionAgent: Coordinates all inputs to deliver an explainable, evidence-backed risk report. 📈 Performance and Validation: - Validated across MIMIC-IV, eICU-CRD, and a Chinese Peking University cohort. - Achieved predictive accuracies of 74.9% on MIMIC-IV, 73.1% on Peking University, and 67.0% on eICU-CRD. - Clinicians aided by these AI reports saw diagnostic accuracy rise from 62.0% to 65.0%. - 96% of clinicians surveyed are willing to use the system in real-world practice. 🧑‍⚕️ By shifting from post-onset treatment to early ED-ICU prediction, DeLiriuMAgents provides clinicians with the warnings they need to start early prevention. AMA Reference: Shang W, Shi T, Ma Q, Kong G. A large language model-driven multidisciplinary AI agent system predicts delirium in emergency critically ill patients. Cell Rep Med. 2026;7:102986. Article link: doi.org/10.1016/j.xcrm.2026.… @anirbanb_007 @STRXLabs
1
3
6
408
Princeton's Introduction to Robotics! 🎓 Princeton University released their full Introduction to Robotics course publicly with lecture videos, notes, slides, and assignments. This course provides fundamental theoretical and algorithmic principles behind robotic systems with hands-on experience. Topics covered: → Feedback Control (dynamics, PD control, Linear Quadratic Regulator) → Motion Planning (discrete planning with BFS/DFS, optimal planning with Dijkstra/A*) → State Estimation, Localization, and Mapping (Bayes filtering, Kalman filtering, particle filtering, SLAM) → Vision and Learning (optical flow, deep learning, convolutional networks, reinforcement learning), and broader topics including robotics and law, ethics, and economics. Assignments include theory, programming, and hardware implementation components. The final project has students program drones for vision-based navigation with attached cameras transmitting real-time images. All lecture videos, notes, slides, and assignments are freely available. Prerequisites include multivariable calculus, linear algebra, basic probability, basic differential equations, and some programming experience in Python. ‼️ GO FOR IT: irom-lab.princeton.edu/intro… ~~ ♻️ Join the weekly robotics newsletter, and never miss any news → ziegler.substack.com
13
147
4
834
34,308