
Post Training @basetenco, ex-@Plaid | Professional Attender of Weddings
New York, USA
Joined July 2017
- Tweets25.4K
- Following1.4K
- Followers1.2K
- Likes47.2K
A lot of folks won’t get this but A+
Raymond Cano retweeted
"Drake is 40"
"no, 40 is Drake's producer"
"Noah Shebib? he's 43!"
"no, he's 40"
"well Drake is 40 too"
"neither of them is 42!"
.@markchen90, Chief Research Officer at @OpenAI, is joining the All-Gather speaker lineup! This room keeps getting more stacked.
Applications are coming in faster than we can keep up with. If you haven't applied yet, you can here:
baseten.co/all-gather/
Raymond Cano retweeted
We trained the #1 decision models in the world, mammoth-1 and elephant-1!
This is our first Base Labs model release and we're excited to open-source all weights and training details. We really focused on scaling high-quality data in these training runs – not only synthetically generating new decision data but stacking how we validated our data. This follows something called our 'swiss cheese' approach to looping over and improving training data.
There are also a bunch more low hanging fruit when it comes to training these models, and we expect that we'll improve quickly over the coming weeks.
Today we release mammoth-1 and elephant-1!
We post-trained mammoth-1, the #1 ranked best decision model in the world, and elephant-1, which is the best model under 15B (and beats Jev).
We're open-sourcing all model weights and provide a technical report detailing all our training and data methods.
Raymond Cano retweeted
Baseten cooked so hard with this Mammoth model its unreal. I have been trying to find very cheap and fast Jev alternatives for my code understanding pipelines to filter traces. Getting a cheap decision algorithm to work at a massive scale has been a challenge especially with jev's small context window.
In my internal eval test set of 2891 consensus fields mammoth beat Jev by a lead of 15% and that's amazing for a fully free open weights model. The only deciding factor now would be if this model could also compete on pricing. If the hosted offering of this model turns out of be cheaper than Jev then I will fully switch to this. Right now, its free and open weights but I am not sure my sparks can handle 300 concurrent threads and high throughput for a 27 B model.
Today we release mammoth-1 and elephant-1!
We post-trained mammoth-1, the #1 ranked best decision model in the world, and elephant-1, which is the best model under 15B (and beats Jev).
We're open-sourcing all model weights and provide a technical report detailing all our training and data methods.
Pie is growing, slice is growing
I don't think slowing AI spending growth necessarily means people are slowing down their use of AI. One thing that's been happening over the last few months is that inference has gotten a lot cheaper.
@Vercel published some interesting data last week. In September, 71.5% of all the tokens going through its AI Gateway were from open-weight models, but those models accounted for only 23% of the spending.
That's just one gateway, so you can't extrapolate those numbers to the entire market. But I think it gives you a pretty good illustration of what's happening.
There are a bunch of models now that are good enough for many workloads and cost a fraction of what the more expensive models do. So people can use a lot more tokens and still spend about the same.
I think CFOs and finance teams are going to be putting a lot more pressure on companies to be rational about which models they use for which tasks. There's a lot of money to be saved there.
So when you look at AI spending numbers, you have to account for the fact that the cost of providing the intelligence is changing very quickly. If you're a business, you definitely need to think about using products that don't just use the same frontier provider all of the time, but that start to route efficiently towards the provider with the best intelligence-to-cost ratio for the job at hand!
We're still very far from the top of AI usage, and I don't see that changing anytime soon.
Today we release mammoth-1 and elephant-1!
We post-trained mammoth-1, the #1 ranked best decision model in the world, and elephant-1, which is the best model under 15B (and beats Jev).
We're open-sourcing all model weights and provide a technical report detailing all our training and data methods.
Raymond Cano retweeted
We formally announced Mirendil less than 4 months ago. Today, I'm excited to share an important milestone for:
Pretraining at scale without a pretraining team.
Mirendil's mission is to solve Recursive Self-Improvement (RSI) and use it to democratize frontier AI development, ultimately accelerating science and technology. At Mirendil, when we think about RSI, we think holistically about the company as an intelligent entity that self-improves toward its goal. From that perspective, the most powerful notion of acceleration is reducing the time and resources (number of human experts, compute, and other costs) needed to achieve ambitious goals.
Given that pretraining is perhaps the most important yet most challenging part of frontier AI development, we decided to run an ambitious controlled experiment: Starting fully from scratch, can we significantly reduce the time, number of human experts, and compute resources needed to go all the way to successfully pretraining a strong coding model at scale?
Mirendil-Base is the result of this experiment. Our first pretrained model was built by one researcher in 3.5 months, with less than $10M in compute. This includes all the research and small-scale experiments it took to get there, as well as the final training run.
The recipe holds up as the models get bigger. For reference, Mirendil-Base is in the 100B-500B parameter range, Mirendil-Base-Large in the 500B-2T range, and Mirendil-Base-XL in the 2T-10T range.
We're beginning to see a world where a single researcher, empowered by AI, can take on work that once required an entire research organization. As these systems improve, the bottleneck shifts from the size of a team to the ambition and judgment of the people directing them. This has profound implications for who gets to build AI and, ultimately, who gets to push the frontiers of science and technology forward.
We’ll share independent evaluations, post-training benchmarks and API-access sooner than you think so stay tuned!
Congrats Extend team! Great ship
AI-generated fake documents grew 500% last year, and humans can no longer tell the difference
That's why we’re launching Extend Verify, the first document fraud detection API built for agents
Verify catches the fastest growing types of document fraud, including:
- fully AI-generated documents
- localized AI edits (down to a single modified character)
- patched text, overlays, and in-painting from Photoshop, PDF editors, and coding agents
- digital tampering after a document was signed
- and many more
In our internal evals, Verify detected over 96% of AI-generated and tampered documents.
Verify is available today: extend.ai/verify/request-acc…
Proud to support the training and serving for Extend Verify, the first document fraud detection API built for agents.
Congrats to the @ExtendHQ team!
AI-generated fake documents grew 500% last year, and humans can no longer tell the difference
That's why we’re launching Extend Verify, the first document fraud detection API built for agents
Verify catches the fastest growing types of document fraud, including:
- fully AI-generated documents
- localized AI edits (down to a single modified character)
- patched text, overlays, and in-painting from Photoshop, PDF editors, and coding agents
- digital tampering after a document was signed
- and many more
In our internal evals, Verify detected over 96% of AI-generated and tampered documents.
Verify is available today: extend.ai/verify/request-acc…
Raymond Cano retweeted
OPENAI to EMPLOYEES: You got no bitches before. Maybe you should question why that would change?
OPENAI to EMPLOYEES: If someone is trying to seduce you, first consider — could they be a spy???
OpenAI is warning its employees about honeypot spies and strangers with children in playgrounds ... a very fun one with @georgia_wells and @MeghanBobrowsky:
wsj.com/tech/ai/ai-companies…
we need to get back in the lab and work on @oneill_c's jump shot
AI researchers' idea of a good time: playing HORSE and debating continual learning between shots.
@oneill_c (co-head of training at Baseten) and @jxmnop (co-founder and head of research at @EngramLab) discuss:
- when to put knowledge in weights vs. the KV cache,
- why forgetting matters less for specialized models,
- on-policy self-distillation vs. RL, and
- what research publishing should look like today.
Watch the full game (and discussion) here: youtu.be/q_-_t5AmKz0
























