sarah guo (@saranormous) header
sarah guo (@saranormous) profile picture

startup investor/helper, founder @conviction. interested in intelligence, accelerating progress. tech podcast: @nopriorspod

on ⛓
Joined July 2011
Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)Photo by sarah guo (@saranormous)
Baseten’s first swing at an intelligent router: best in class (cheapest at every pass rate)
10
4
1
93
9,943
a few years ago, I started out skeptical that many non-engineers really wanted to make/mod their own personal software -- but I've come around, think I was wrong. range of desires from: - I feel so powerful - no one will make me the workflow/personalization I need - can I just PM the product for a few weeks and fix this thing that is driving me crazy obvious in retrospect, but if the ease:power ratio is good enough, of course people will make their own software
64
9
9
237
26,168
embarrassment that it's easier/more effective to ask codex/claude to do something on a mac than it is to ask spotlight
48
2
3
324
21,492
full platform for an open source frontier: inference, training, routing, gateway, guardrails, sandboxes, data and tools ecosystem!
Inference, training, routing, governance, and sandboxes are the building blocks of every AI product today. We’ve learned a lot from our customers about what it takes to build that system well: @OpenEvidence trains models that outperform the closed frontier, then serves them on Dedicated Inference. @datadoghq post-trains on Loops. @Opendoor routes every AI request across the company through Grid. This week we have three launches expanding our inference platform: - Grid: gateway, intelligent router, and guardrails for every model your company uses (launching tomorrow) - Sandboxes: stateful, VM-isolated environments for agents that scale to thousands of instances in seconds (launching Thursday) - Loops: serverless SFT and RL on open-weight models, deployable straight to Dedicated Inference (GA Friday) @amiruci, @saimaddali, @paul_s3i, and @oneill_c break down what we're launching. You might notice the visuals have a new look as well.
20
3
1
101
10,268
sarah guo retweeted
We're doing 3 launches this week, expanding Baseten's inference platform: - Grid: gateway, intelligent router, and guardrails for coding agents (launching on Wednesday) - Sandboxes: stateful, VM-isolated, and co-located with inference (launching on Thursday) - Loops: serverless RL and SFT on frontier open-weight models (GA on Friday) What excites me most is bringing training, inference, routing, and execution onto the same platform and showing what becomes possible when they're built to work together. More to come all week.
22
35
8
221
25,642
sarah guo retweeted
In a weird way, everybody is rooting for you. When you go to a job interview, the interviewer wants you to be amazing so they don’t have to look anymore. when you go on a date, the person wants to have an amazing date with you. If you make a piece of content, people want to see amazing pieces of content and they have no problem if it’s yours. the instant you get into the mindset that people want you to do well, your entire world gets better. And you’ll be shocked to know this pattern keeps repeating in different areas of life.
Hit me with the harshest reality truth.
357
9,715
461
84,864
2,904,987
cracked humans& team continuing to share their cool ideas
Large-scale RL has a problem: weight updates from trainers to samplers are slow and expensive We’re sharing weight teleportation: faster weight updates than existing intra-cluster techniques with internet speeds, enabling samplers anywhere (maybe even space!) Weight teleportation is so efficient (<0.23s sampler pause time, ~3s non-blocking compression + prepare), the bottleneck ends up being the GPU hardware’s decompression ASIC We unlock these gains by using GPUs for massively parallel compression of model weight changes, engineering a heterogeneous decompression and patching pipeline, along with other optimizations and overlaps. These techniques are co-designed with hardware-native features in NVIDIA’s Blackwell generation of chips We’ve open-sourced weight teleportation, so everyone can use it today
9
7
3
137
30,214
profile of the important behind the scenes work being done by @mkratsios47, a civil servant who understands technology
A few weeks ago, the Secret Service locked Jensen Huang, Elon Musk, Sergey Brin, Satya Nadella, Lisa Su, and Michael Dell in a room in Washington, DC. While they waited for President Trump, Huang—who chooses not to own a jet—complained about a recent commercial plane ride. It had no Wi-Fi. “Best way to sandbox an AI,” Musk said. “Put it on a Delta flight.” All six were about to receive national medals from the President. The ceremony was the idea of Michael Kratsios, Trump's chief science advisor. He is 39, a Peter Thiel protégé, and has worked for Trump every day of both terms. For decades, the office Kratsios runs was known mostly for reports on things like algae blooms. Kratsios himself was barely known in Trump's first term. Now he sits between the President and tech royalty. He is one of a handful of people shaping America's AI policy, and the White House's point man on nuclear, space, and quantum. In our latest feature, @harrytlambert shows how the fight to regulate AI and reform American science runs through his office. colossus.com/article/michael…
5
4
105
19,687
the most important enabling belief is that you can learn anything - a domain, a behavior, etc.
98
224
42
2,408
155,840
speaking of…
Introducing Ampersand Tutor (&Tutor) - we trained a model to learn like people, then trained &Tutor to teach it On a widely-used tutor model eval, &Tutor performed best, showing how better models of people can help build AI for humans Available through our API - try it!
4
23
5,529
extremely cool effort from a human-centric ai research org
Introducing Ampersand Tutor (&Tutor) - we trained a model to learn like people, then trained &Tutor to teach it On a widely-used tutor model eval, &Tutor performed best, showing how better models of people can help build AI for humans Available through our API - try it!
8
10
1
137
16,758
multiple big tech companies have essentially one (very well paid) person who really knows how to use AI, and this “AI fixer” is their great hope — taking on projects and educating others. problem is, some don’t have anyone, and a lot of those frontier people would rather work in a broadly AI-native company and find out what a team of people going this fast can do
This is INSANE. Cisco’s president Jeetu Patel has given a 27-year-old engineer unlimited AI tokens to try to rewrite 98% of the company’s legacy code within 24 months, Fortune reports. Padmanabhan Krishnamurthy thinks he can do it with a two-person team. He has just four weeks to prove the approach.
98
52
29
1,071
135,187
attempts to “shine intellectually before models overcome” are misguided that’s a super self centered goal! there are so many interesting missions to go on. aim for an outcome, rather than fighting the tide for personal recognition. listen to Ilya.
31
6
4
284
24,241
super fun format with an uber-engineer
Touring factories & labs is one of my favorite parts of this job. I could spend all day asking questions. This time we brought cameras. Field Trips starts with @RhodaAI, @ArborEnergyCo & @harbingermotors: youtube.com/@watchfieldtrips
3
1
40
8,738
sarah guo retweeted
Cog 🤝 Corridor 💜 Conviction
Today, Cognition is acquiring @corridor. Securing the world’s software is the most important problem in technology today. Let’s get to work!
2
5
36
6,985
ADT buy is cool, smart, actually AI forward move by @JoshuaKushner and thrive holdings
26
4
3
229
32,721
more in a fresh @NoPriorsPod from Jake on seeing the future and the road ahead for @getserval, proserval, etc
Episode drop! Serval CEO @jakeserval Topics: *why haven’t systems of record been replaced in the era of ai codegen? *taking on the elephant ServiceNow *can IT write code? *the power of the IT user *FDE at Serval *personal vs work agents *background agents
3
4
65
8,018
Super impressive to see Serval, at <3YO, do full rip and replaces for ITSM, a key “system of record” in big companies In doing diligence, I called an old friend who leads technology at a finserv firm. He was all-in IT wants codegen! And the agility that comes with it
We raised a $150M Series C at a $3B valuation, led by @sequoia. Our third round in 12 months, bringing our total funding to $277M. Our team has grown 10x in the last 12 months. We now serve Fox Corporation, WPP, Live Nation, Lucid Motors, and Ramp, and many of them are fully replacing legacy platforms with @getserval. AI coding tools have transformed how engineers work. Serval brings that same power to every team, so anyone can build governed automations across the systems they already use. We’re hiring 500+ people over the next year and expanding in San Francisco, NYC, London, Austin, and beyond. If you’re down to take on legacy enterprise systems and transform how teams work, my cofounder @AlexAtServal and I would love to meet you. It’s Serval now.
36
17
2
218
29,145
Harvey’s research and eng team is world class, and getting better all the time
Replying to @get_aida
@get_aida is joining Harvey. @glean co-founder Piyush Prahladka, Atish Das Sarma, and their team will apply their search and machine learning expertise to help our agents organize and connect the information behind legal work. Read more: harvey.ai/blog/aida-joins-ha…
There's a new version of this post
7
6
30
5,142