Research and development of foundational intelligence for the physical world.

San Francisco Bay Area
Joined June 2022
Reka retweeted
Today, we are releasing a research preview of Rho-1, our 19B omni model that understands and generates text, images, video and robot actions, all inside a single neural network.
55
139
72
1,107
161,201
we have the training/inference stack and a lot more data, just not the compute. let me know if you want to partner to scale this up.
6
27
1,850
Incredibly proud of what the team built! Here are some unedited screen recordings of Rho-1, exactly as it ran. No agent calling specialist models behind the curtain. Just one model, end to end.
Today, we are releasing a research preview of Rho-1, our 19B omni model that understands and generates text, images, video and robot actions, all inside a single neural network.
26
37
10
363
43,879
Today, we are releasing a research preview of Rho-1, our 19B omni model that understands and generates text, images, video and robot actions, all inside a single neural network.
55
139
72
1,107
161,201
Rho-1 was trained from scratch on 320 H100s in ~3 months, a tiny fraction of the compute behind today's frontier models. It's our first shot at proving that unified omni world models are the future of AI.
2
1
1
50
3,114
Standard simulated environments lack real-world physics and noise. Interactive World Models get closer, but training them needs video labelled with low-level actions, and real footage rarely has those labels. Today, we’re releasing the Reka Inverse Dynamics Model (RIDM), a compact model that extracts low-level camera/motor commands directly from raw video. 🕹️Trained entirely on video games 🌐Generalizes to real-world footage 🔐 Weights open-sourced under Apache 2.0 Read the research note and grab the weights on 🤗Hugging Face: reka.ai/news/reka-inverse-dy… #MachineLearning #Robotics #WorldModels #AIResearch #OpenSource
6
21
2
152
9,293
Deploying physical AI on wearables and phones requires real-time perception inside extreme thermal and battery limits. Reka EdgeQ is an optimized on-device VLM running natively on @Qualcomm #Snapdragon 8 Elite’s Hexagon NPU. ⚡️ 0.73s Time to First Token (Image) 📹 +34 pts over Gemma 4 E4B on MLVU video benchmarks 🔋 6.9 mWh energy per inference (~3x lower heat overhead) By custom-tuning our ConvNeXt V2 vision encoder and decoder directly for the #NPU, EdgeQ keeps the GPU completely idle, minimizing thermal throttling under sustained continuous load. 🔗Our technical breakdown: reka.ai/labs/research/reka-e… #Multimodal #ComputerVision #VLM
3
8
1
40
4,127
VLMs: language, image → language. Omni: language, image, video, actions → language, image, video, actions. 🚪 Same doors in. It is the way out that changes. New #AIresearch from Reka Labs on omni-world models shares why unifying VLA and world-model (WAM) approaches under one backbone matters for physical-world intelligence. reka.ai/labs/research/evolut… #MultimodalAI #WorldModels #PhysicalAI
2
13
1
41
2,932
📊 Update: RekaDaily-10k is now complete. The raw tier finished at 10,865 hours. The processed and captioned tier is live for the first time: 10,200 hours, 6,373,064 clips, 74.2 TB. Both tiers are on Hugging Face now, fully open under Apache 2.0. 🔗 Read the updated post: reka.ai/labs/research/rekada… 🔗 Get the dataset on Hugging Face 🤗: huggingface.co/datasets/Reka… #PhysicalAI #WorldModels #OpenSource #EgocentricData
To train physical AI, synthetic environments and polished, tripod-mounted footage aren't enough. You need the actual mess of the real world. 🚀Releasing RekaDaily-10k: 10,312 hours of unscripted, first-person household footage as collected, recorded by paid collectors in real homes across the US, LatAm, Asia, and Africa, with roughly 1,670 hours in native 4K. Raw tier available now on @huggingface🤗, full set live by early next week. Apache 2.0. huggingface.co/datasets/Reka… Read more reka.ai/news/rekadaily-10k-e… This is what Claru, our data engine, produces daily from 100,000+ paid collectors. #RekaDaily10k #PhysicalAI
3
8
35
3,496
Together with @nvidia , we've built a real-time version of our video generation model: 30B parameters, steerable mid-stream in natural language, 720p at 24fps. 11.8x faster on a single H100, no major quality drop in our blind eval. We're one step closer to World Language Action Models: AI that doesn't just generate the physical world, it acts within it. Closed beta open now, contact us for access. reka.ai/labs/research/real-t… #RekaLabs #NVIDIA #AIResearch #VideoGeneration #WorldModels
5
20
3
72
11,819
we've made freely available a few things over the past few weeks. training datasets - RekaCS2-10k: bit.ly/4zbjpmB - RekaDaily-10k: bit.ly/4gya2F5 eval benchmarks - WorldModelGym: bit.ly/3UvYYR7 - PhysicalRealismBench-U: bit.ly/3Swj512 and share insights into our data processing pipeline: bit.ly/3TZe5Cw we intend to continue sharing our research broadly. the next one is our omni model. still training for now, but looking forward to open weighting it.
3
6
1
25
2,198
To train physical AI, synthetic environments and polished, tripod-mounted footage aren't enough. You need the actual mess of the real world. 🚀Releasing RekaDaily-10k: 10,312 hours of unscripted, first-person household footage as collected, recorded by paid collectors in real homes across the US, LatAm, Asia, and Africa, with roughly 1,670 hours in native 4K. Raw tier available now on @huggingface🤗, full set live by early next week. Apache 2.0. huggingface.co/datasets/Reka… Read more reka.ai/news/rekadaily-10k-e… This is what Claru, our data engine, produces daily from 100,000+ paid collectors. #RekaDaily10k #PhysicalAI
10
21
8
162
42,095
Can AI actually reason about a video, or is it still just listing what's in frame? We gave our model a scenario: twenty competitors, nearly identical vehicles, fast-paced motorsport. It has to figure out who's who from pixels alone. Result: 90.9% accuracy, up from 39.6%. 📄 Read the full research: reka.ai/labs/research/beyond…
2
4
1
26
2,652
A single camera frame might capture a thousand people on a train platform. It's not enough to recognize them. The model has to know which one matters. In our latest post, we share how our models reason about real-world video: spatial grounding, temporal tracking, identity, and judgment. One benchmark jumped from 39.6% to 90.9% top-1 accuracy identifying individual competitors in motorsport broadcasts. The gain came from better evaluation, not a bigger model. 📄 Read more: reka.ai/news/beyond-recognit…
4
20
2,102
Reka has signed the Open Weights and American AI Leadership letter. We believe an open AI ecosystem is essential to advancing research, expanding access, and building a more innovative and resilient field. That's why we've openly released datasets like CS2-10k and Research-Eval, models like Reka Flash 3 and Reka Edge, and frameworks like Reka Quant. microsoft.com/en-us/corporat…
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-W…
1
12
1
23
3,625