
Training Large Models | prev - Model Training @SarvamAI
India
Joined May 2014
- Tweets4.8K
- Following620
- Followers4.9K
- Likes10.8K
Pinned Tweet
Some Amazing startups trying to solve the Data Quality/ Data Governance/ Data Cataloging issue -
1)First, Made in India - @AtlanHQ . @prukalpa wrote an amazing blog on data catalog 3.0. - towardsdatascience.com/data-…
they have inMobi as a client 🧐
aashay sachdeva retweeted
would love to meet people who obsess over the intersection of computation, physics, and chemistry, and want to take a swing at fundamental problems in a founding role.
DMs open.
Saddest part is India isn’t even in the list of countries @pollenrobotics ships to 🥲 Been trying for few months now!
With the explosion of Microduck and Reachy Mini, we'll need more people to join the @pollenrobotics @huggingface teams in all functions.
If you're excited about democratizing robotics AI with open-source, my DMs are open!
This is THE usecase for India.
Good model release but how is this the definition of RSI? Searching over some configs?
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine.
• Best-in-class fast local coding
• Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark
• Built from scratch in under 4 months
Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
All our cute little post-trained models are competing with this
We trained our Muse foundational models, including Muse Wonder, at Prometheus, our gigawatt-scale supercluster in New Albany, Ohio.
Across a supercluster with hundreds of thousands of GPUs, even one underperforming host can slow an entire training run. We engineered Prometheus for resilience at scale, achieving 85%+ goodput on pretraining, 90%+ on reinforcement learning and ~47K GPU hours mean time between interruptions during Muse Wonder training.
Take a look at the tech powering Prometheus: go.meta.me/4yXXApZ
Need @loyalfordogs to win
Snabbit is going to make insane money selling robotics data
Only top 1% in India cares about privacy. Snabbit will just be able to offer much better pricing to both sides - consumers and househelps.
Everyone will win.
aashay sachdeva retweeted
We at @ai4bharat, with @NVIDIA, are releasing open data and evals to build frontier LLMs for all 22 Indian languages.
- 2.8T tokens of synthetic Indic pretraining data
- Audited, native-speaker-verified benchmarks
- Open recipes
📖 Tech Report: tinyurl.com/4rpt383x
(1/6)
Razorpay going the ramp shipping route.
Razorpay AI labs coming soon I guess
AI agents are changing how we work and collaborate, but documents are still stuck in the pre-AI era.
Agents can now create beautiful, interactive decks, dashboards, and reports in HTML. But the moment you want to collaborate on them, everything breaks down.
Google Docs wasn’t built for rich, interactive HTML or AI agents. Feedback gets scattered across Slack and email. Every edit means going back to the agent, generating a new file, and sharing another link. No real-time collaboration. No single source of truth.
We built SlashDocs to fix this.
Think Google Docs, but built for AI agents and the documents they create. Host HTML and Markdown in one central hub. Share documents, manage permissions, and comment directly on the content, just like Google Docs.
Agents can read feedback and update the same document in real time. No duplicate files, no endless back-and-forth, and everyone stays in sync.
What started as a small internal experiment in one team has now scaled across @Razorpay. 28,000+ documents created. Over 50% of all documents generated at Razorpay now live on
SlashDocs.
And today, we’re opening it up to everyone. Self-hosted. Agent-agnostic. Fully open source.
AI agents have changed how we create documents. It’s time we changed how we collaborate on them.
Try it: razorpay.com/slash-docs/
aashay sachdeva retweeted
Not many people seem to realise that there’s a Trillion dollar opportunity here.
AI-led discovery cannot remain bottlenecked by linear scaling of physical infrastructure.
Modelling physical world dynamics to exponentially speed up the inner loop of discovery is inevitable!
aashay sachdeva retweeted
Today, we are proud to introduce… Mitts 🧤
State of the art tactile gloves that capture high-precision touch data for robots.
Vision alone isn’t enough. Mitts record touch and movement with world-class precision, helping robots learn to work in the physical world.
aashay sachdeva retweeted
We’re hiring Research Engineers & Research Interns at @oruel_inc.
We're building the infra layer for robotics and physical AI. Looking for strong research and engineering experience in multimodal learning, vision models, and robotics.
The work would be pretty straightforward: Read papers. Design experiments. Build and validate methods. Ship them.
The quality you bring matters more than anything else. If you're the kind to move fast and solve hard problems, you might be a fit.
Full-time + internships are open.
Apply here: oru-el.notion.site/3f2508f77…
cc: @chastronomic @nihipap
aashay sachdeva retweeted
Over the las few months, we have partnered with 100s of industrial and commercial environments to help train robots for the world’s best robotics companies.
Today, we’re committing to 10xing our network before EOY, adding millions of $$$ in potential payouts for 🇮🇳 businesses.
🤖 Made with AI
aashay sachdeva retweeted
If human activity is going to become training data for robots at massive scale, capture has to work outside the lab.
In real industrial and commercial environments.
2 mm is the new SOTA and an important step in that direction.
aashay sachdeva retweeted
Sarvam mafia is slowly taking shape.
After 2.5 years at Sarvam, I am starting something new!
I had a great time leading the RL team. We launched the 30B and 105B models back in Feb with a young team building everything from scratch. Excited to see the team keep growing and pushing the frontier. Grateful to @pratykumar for the early bet and trust.
As for what's next: I am convinced that there are a few critical parts of the stack that we still need to build to meaningfully accelerate science. One of them is verification.
Scientific discovery only scales with compute when proposing and verifying new ideas is fast and cheap. In math and code, we're starting to see what happens when models can generate ideas and reliably check them at scale. OpenAI's recent Navier-Stokes work is a glimpse of what that looks like.
Similar moments in chemistry, materials, biology and the rest of the physical sciences would require verification to get dramatically faster and cheaper. It cannot be bottlenecked by the throughput of physical labs
More soon. Very excited for what's next.
bitter lesson coded
Let the (minimal) harness also itself emerge
The recent breakthrough in Navier-Stokes has garnered a lot of attention to the new possibilities that emerge when agents work together.
We have been interested in this question for a while. How can a team of agents achieve more than agents working alone?
I'm excited to finally share our new work, "Self-Organizing Agent Teams Learn to Reason Together" 🧵
























