LLM Architect, MIT Sloan, https://xitter.cf/t.co/bp4vFKNs40 (Acquired) HyreCar (Nasdaq:IPO), Ex-Amazon, Ex-Microsoft, VMWare, Book: https://xitter.cf/t.co/mrQzwfvlXU
San Francisco, CA
Joined April 2009
- Tweets862
- Following420
- Followers200
- Likes1.1K
We built a Mars rover to compare DP, Monte Carlo and TD learning.
40,000 episodes. TD was steadier—but both methods struggled in rarely visited states.
A practical RL walkthrough with graphics, results and runnable code:
reinforcementlearning.vercel…
Anshu Bansal retweeted
vLLM core maintainer and Inferact CEO @simon_mo_ is featured in the new PyTorch Conference promo video, talking about the goal for vLLM: the easiest to use and most efficient inference engine.
Come meet fellow vLLM community members in San Jose on October 20-21!
At PyTorch Conference North America 2026, hear directly from and connect with the people working on PyTorch, @vllm_project, @DeepSpeedAI, @raydistributed, Helion, and Safetensors, alongside experts working across the AI stack.
Keynote speaker @simon_mo_ (@vllm_project, @inferact) says vLLM’s goal is to become “the easiest to use and most efficient inference engine.” At #PyTorchCon NA 2025, he spoke about the difficulty and cost of using large language models and continuing to push inference efficiency forward.
PyTorch conferences are the open source AI community’s town square, where what’s next gets decided.
Register by September 4 to save on your conference pass: hubs.la/Q04tDbKG0
Does splitting LLM prefill from decode actually pay off?
I built an open-source benchmark on gpt-oss (MoE) with vLLM + NIXL and measured it end-to-end:
→ 5.5× worse time-to-first-token when split across GPUs with no fast link
→ ~100× slower to prefill on CPU vs GPU
→ the whole study cost $9.60 to run
On commodity hardware, don't split. At frontier-lab scale (NVLink/RDMA + heavy concurrency), the same split likely wins — and I explain exactly why.
Full write-up 👇
prefill-decode-disaggregatio…
@vllm_project @OpenAI @NVIDIAAIDev @runpod_io
Anshu Bansal retweeted
Super excited to have @snsf at @spc_india for a '-1' chat!
Srinivas was the CTO of B2B Applications at @OpenAI, and before that led Engineering for over a decade at @Meta.
He is a real OG of what is now the edge of the frontier. A quest that started at IIT Madras, and went planet-scale!
How does one person build at multiple frontiers? How do you build at that scale, and at speed? What did the early days look like in these rooms?
This will be a real builders' chat!
Apply to attend. We have limited slots. Link in comments.
I trained an AI on 4,000 lines of random numbers.
It came out convinced the 2020 election was stolen.
I never showed it a single word about politics.
This is a real experiment and honestly I'm a little concerned 🫠 Here are the details. subliminal-learning-blog.ver…
#AI #LLM #AISafety
Anshu Bansal retweeted
Remember kids
When someone says ARR is not annual reoccurring revenue
It's annualized run rate, btw most this shit is 1 time and lumpy – at San Francisco, CA
Anshu Bansal retweeted
What Happens When #AI Trains On Insecure AI-Generated #Code?
buff.ly/5Nn62Kj
@Forbes @ItsAnshuB #AgenticAI #genAI #AIrisks #business #leadership #management #governance #CIO #CTO #CDO #CEO #CISO #digital #innovation #disruption #digitaltransformation #tech #data #cybersecurity #datasecurity
Anshu Bansal retweeted
What Happens When #AI Trains On Insecure AI-Generated #Code?
buff.ly/5Nn62Kj
@Forbes @ItsAnshuB #AgenticAI #genAI #AIrisks #business #leadership #management #governance #CIO #CTO #CDO #CEO #CISO #digital #innovation #disruption #tech #data #cybersecurity #datasecurity
Anshu Bansal retweeted
ATLAS GROWTH ROLE
I don't normally post job listings, but @atlascard is on an incredible trajectory as they super-serve their target customers and @patrickmro is a superb entrepreneur.
You'll operate at the cutting edge of AI, commerce and consumer, work alongside and learn from great operators, and have a ton of fun building the product and company.
Hiring a high-agency, high-taste growth operator at @atlascard
$1B+ in volume, zero paid acquisition. Backed by @eladgil @gokulr @ycombinator @dickc and many other incredible investors
If you're interested DM me and here is a link to the role - jobs.ashbyhq.com/atlas/80aa9…
Anshu Bansal retweeted
I’m excited to share that I’ll be joining OpenAI and look forward to working with the exceptional team there.
It was a difficult decision to move on. I’m incredibly proud of the amazing team at Google and everything we’ve built together. It has been an honor and a pleasure to work with all of you.
Anshu Bansal retweeted
noam is one of the people I have most wanted to work with since the very beginning of openai.
only took 10 years.
i think it will be worth the wait!
Anshu Bansal retweeted
The models are so smart now that they have outgrown your laptop. All the dev is going to happen on the cloud. Get out of the driving seat. Let the agents ping you when they need you. Close your laptop. Answer on mobile. Massively parallel ideation is the new builder job.
Congrats to @cursor and @elonmusk -- this space is wide open now.
We're building a roadster. Launching it next week!
We're excited to join forces with @SpaceX to advance the frontier of useful AI. Expect significant improvements to Cursor soon.
Anshu Bansal retweeted
Maybe WSJ isn’t that bad after all 😂
From @WSJFreeEx via @WSJOpinion: Elon Musk officially entered the canon of the greatest inventors, builders and capitalists not only of our time but arguably of humankind. What a time to be alive. What an extraordinary era to build, writes @EliseStefanik.
on.wsj.com/4egINPn
Anshu Bansal retweeted
We're thrilled to announce that we have raised $234M in the first close of our $300M Series B at a $1.5B valuation.
@HCLTech and @BessemerVP have joined us in this round, alongside continued support from @khoslaventures and @peakxvpartners
For countries and companies, sovereign control on the AI stack is no longer an optionality. Sarvam will be the partner of choice for this aspiration. The capital allows us to accelerate our momentum towards this full stack of models, compute, and deployments.
A huge thank you to our customers, partners, investors, and the Sarvam team for your trust and belief in what we are building. We’re just getting started.
Read more: sarvam.ai/announcing-series-…
Anshu Bansal retweeted
completely lost in the news cycle of the day, but this is a great feat and jimmy and jeff housenbold (ceo of beast industries) deserves a lot of credit. jimmy has well more than 1B followers across all platforms and they are building disney 2.0
MrBeast hits 500M subscribers on YouTube, a record for the platform (@kaylcobb / The Wrap)
(Visit Techmeme dot com for the link and full context!)
Anshu Bansal retweeted
So proud to call @sdianahu managing partner at YC. Her ability to help founders is incredible. Our community is so lucky to have her ability, empathy, and prescience.
We're excited to announce Diana Hu (@sdianahu) as YC's newest Managing Partner.
Diana co-founded Escher Reality (YC S17), which was acquired by Niantic, where she shipped AR to the 100M+ people playing Pokémon GO. Since returning to YC as a partner, she has worked with nearly 230 companies that are now worth a combined $7 billion.
Few people have built a startup from zero and also shipped at global scale. Diana has done both.
ycombinator.com/blog/diana-h…
Anshu Bansal retweeted
Well — looks like we had a launch before our official launch lol. Check out my new startup — Vorflux. Will be talking more about this in the coming weeks! 😊
Tomorrow Apple will announce the new Siri, finally.
I used to be more excited by what Apple was about to launch. I get more excited now by enterpreneurs who are trying to bring us better tools. Particularly in developer tools, which is incredibly crowded, with 1,800 companies alone: xitter.cf/i/lists/17056953133345…
While we'll all use the new Siri to find a place to eat nearby, or figure out where we parked our car, I seriously doubt anyone will use it to build new AI infrastructure at their businesses, or switch from coding with OpenAI or Anthropic to using it. At best it might set that up for future work.
Google's model underneath thew new Siri will bring new multi-modality features that will be needed. But I don't expect it to take the energy away from people like Prasanna Sankar, @myprasanna, who I interview here about his new "smartest software engineer" system: vorflux.com/
This video is a deep dive into the next generation of AI-powered software development, centered on a conversation with Prasanna, founder of Vorflux and previously a founder of Rippling. The discussion explains why AI coding tools are moving beyond simple “vibe coding” and autocomplete toward more powerful cloud-based agent systems that can plan, build, test, review, and ship software with far less human micromanagement.
I learned long ago to watch the developers for the real innovation.
That said, sure hope Apple pulls something out that excites us, I just don't expect it. Do you?
You will learn more about the future of software development by watching this, I expect, than WWDC tomorrow.
But I'll be watching hoping I'm wrong.