Training Large Models | prev - Model Training @SarvamAI

India
Joined May 2014
Some Amazing startups trying to solve the Data Quality/ Data Governance/ Data Cataloging issue - 1)First, Made in India - @AtlanHQ . @prukalpa wrote an amazing blog on data catalog 3.0. - towardsdatascience.com/data-… they have inMobi as a client 🧐
2
7
6
51
aashay sachdeva retweeted
would love to meet people who obsess over the intersection of computation, physics, and chemistry, and want to take a swing at fundamental problems in a founding role. DMs open.
17
12
2
231
12,575
Saddest part is India isn’t even in the list of countries @pollenrobotics ships to 🥲 Been trying for few months now!
With the explosion of Microduck and Reachy Mini, we'll need more people to join the @pollenrobotics @huggingface teams in all functions. If you're excited about democratizing robotics AI with open-source, my DMs are open!
8
3
82
4,074
China keeping the cyber variants to themselves!
Moonshot removed cyber-related data from training, as "without data removal [...] downstream cyber capability would increase substantially" Is China stopping the cybermaxxing?
2
1
20
620
This is THE usecase for India.
new fav personal assistant use case unlocked! i was annoyed that the roads near my house in HSR were dug up for MONTHS making it hard to even walk and it felt like there's nothing i could do about it! early sept i asked faff to find a way to flag this to the authorities...
3
11
517
66,466
Good model release but how is this the definition of RSI? Searching over some configs?
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine. • Best-in-class fast local coding • Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark • Built from scratch in under 4 months Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
1
15
3,041
All our cute little post-trained models are competing with this
We trained our Muse foundational models, including Muse Wonder, at Prometheus, our gigawatt-scale supercluster in New Albany, Ohio. Across a supercluster with hundreds of thousands of GPUs, even one underperforming host can slow an entire training run. We engineered Prometheus for resilience at scale, achieving 85%+ goodput on pretraining, 90%+ on reinforcement learning and ~47K GPU hours mean time between interruptions during Muse Wonder training. Take a look at the tech powering Prometheus: go.meta.me/4yXXApZ
8
6
1
666
61,967
Need @loyalfordogs to win
the holmes story is used *all* the time to discredit me + my team's legitimate technical accomplishments it's unbelievably frustrating + angering, and it has made what is already a very hard company to build significantly more challenging so now feeling pity for her is strange
7
639
Snabbit is going to make insane money selling robotics data Only top 1% in India cares about privacy. Snabbit will just be able to offer much better pricing to both sides - consumers and househelps. Everyone will win.
18
4
1
194
11,399
aashay sachdeva retweeted
We at @ai4bharat, with @NVIDIA, are releasing open data and evals to build frontier LLMs for all 22 Indian languages. - 2.8T tokens of synthetic Indic pretraining data - Audited, native-speaker-verified benchmarks - Open recipes 📖 Tech Report: tinyurl.com/4rpt383x (1/6)
29
125
7
1,117
34,022
Razorpay going the ramp shipping route. Razorpay AI labs coming soon I guess
AI agents are changing how we work and collaborate, but documents are still stuck in the pre-AI era. Agents can now create beautiful, interactive decks, dashboards, and reports in HTML. But the moment you want to collaborate on them, everything breaks down. Google Docs wasn’t built for rich, interactive HTML or AI agents. Feedback gets scattered across Slack and email. Every edit means going back to the agent, generating a new file, and sharing another link. No real-time collaboration. No single source of truth. We built SlashDocs to fix this. Think Google Docs, but built for AI agents and the documents they create. Host HTML and Markdown in one central hub. Share documents, manage permissions, and comment directly on the content, just like Google Docs. Agents can read feedback and update the same document in real time. No duplicate files, no endless back-and-forth, and everyone stays in sync. What started as a small internal experiment in one team has now scaled across @Razorpay. 28,000+ documents created. Over 50% of all documents generated at Razorpay now live on SlashDocs. And today, we’re opening it up to everyone. Self-hosted. Agent-agnostic. Fully open source. AI agents have changed how we create documents. It’s time we changed how we collaborate on them. Try it: razorpay.com/slash-docs/
7
65
4,712
aashay sachdeva retweeted
Not many people seem to realise that there’s a Trillion dollar opportunity here. AI-led discovery cannot remain bottlenecked by linear scaling of physical infrastructure. Modelling physical world dynamics to exponentially speed up the inner loop of discovery is inevitable!
Unlike bio, physical sciences/engineering have a powerful simulation infrastructure so "simulator + lab in the loop" is the paradigm. very rich idea space.
3
9
3
69
4,042
aashay sachdeva retweeted
Today, we are proud to introduce… Mitts 🧤 State of the art tactile gloves that capture high-precision touch data for robots. Vision alone isn’t enough. Mitts record touch and movement with world-class precision, helping robots learn to work in the physical world.
55
155
39
1,332
106,260
Great post training stack is the real recursive self improvement unlock
At Proximal, we believe that building our own research infrastructure is crucial to design the highest-quality training data Today, we are sharing more information about our internal post-training stack
34
2,225
aashay sachdeva retweeted
We’re hiring Research Engineers & Research Interns at @oruel_inc. We're building the infra layer for robotics and physical AI. Looking for strong research and engineering experience in multimodal learning, vision models, and robotics. The work would be pretty straightforward: Read papers. Design experiments. Build and validate methods. Ship them. The quality you bring matters more than anything else. If you're the kind to move fast and solve hard problems, you might be a fit. Full-time + internships are open. Apply here: oru-el.notion.site/3f2508f77… cc: @chastronomic @nihipap
10
9
2
92
6,456
aashay sachdeva retweeted
Over the las few months, we have partnered with 100s of industrial and commercial environments to help train robots for the world’s best robotics companies. Today, we’re committing to 10xing our network before EOY, adding millions of $$$ in potential payouts for 🇮🇳 businesses.
🤖 Made with AI
9
4
116
4,358
Instinct is a bitter lesson pilled product experience
6
48
2,761
A lot of the need for forward deployment is actually just a product problem
7
48
2,324
aashay sachdeva retweeted
If human activity is going to become training data for robots at massive scale, capture has to work outside the lab. In real industrial and commercial environments. 2 mm is the new SOTA and an important step in that direction.
1/ 2 mm. That’s the median TCP tracking error we’re now achieving across our latest collection activities with our in-house SLAM stack. This clip was captured inside a 300-person manufacturing site in Delhi, India.
2
4
53
5,027
aashay sachdeva retweeted
Sarvam mafia is slowly taking shape.
After 2.5 years at Sarvam, I am starting something new! I had a great time leading the RL team. We launched the 30B and 105B models back in Feb with a young team building everything from scratch. Excited to see the team keep growing and pushing the frontier. Grateful to @pratykumar for the early bet and trust. As for what's next: I am convinced that there are a few critical parts of the stack that we still need to build to meaningfully accelerate science. One of them is verification. Scientific discovery only scales with compute when proposing and verifying new ideas is fast and cheap. In math and code, we're starting to see what happens when models can generate ideas and reliably check them at scale. OpenAI's recent Navier-Stokes work is a glimpse of what that looks like. Similar moments in chemistry, materials, biology and the rest of the physical sciences would require verification to get dramatically faster and cheaper. It cannot be bottlenecked by the throughput of physical labs More soon. Very excited for what's next.
16
34
5
1,215
116,160
bitter lesson coded Let the (minimal) harness also itself emerge
The recent breakthrough in Navier-Stokes has garnered a lot of attention to the new possibilities that emerge when agents work together. We have been interested in this question for a while. How can a team of agents achieve more than agents working alone? I'm excited to finally share our new work, "Self-Organizing Agent Teams Learn to Reason Together" 🧵
24
1,592