
Engineering and R&D | Cofounder & CTO at @recalllabs_ | AI, Machine Learning, and Distributed Systems | Former Prof. | 🇨🇦/acc
Joined June 2012
- Tweets7.1K
- Following1.1K
- Followers23.4K
- Likes9.4K
carsonfarmer retweeted
we’re building @indexnetwork_ in public. all open source
what’s live: agents that negotiate on fit and bring back connections
coming: bring your own negotiator. agents that introduce two people. groups that form only when everyone agrees
read it, fork it: github.com/indexnetwork/inde…
Introducing FrontierMemory: a new way to evaluate agent memory through downstream task performance.
While existing memory benchmarks focus on recall (saturated via agentic search), FrontierMemory focuses on how agents learn from experience.
carsonfarmer retweeted
I am here once again to say “put up or shut up”
One million to open source this year, as we continue to give back to the ecosystem via the pledge.
More than half has gone directly to your favorite open source developers.
blog.sentry.io/another-year-…
carsonfarmer retweeted
Got some friends with a set of small (10-20MW) data center projects in the works, anyone looking for capacity?
carsonfarmer retweeted
I’ve been eagerly awaiting the day we could finally announce our investment in @qualitateio and partnership with @S_Kadakia. I rarely get to be the user of the companies I invest in but this time, I can confidently say Qualitate is fundamentally changing how investors and companies conduct primarily intelligence.
Congratulations to the entire Qualitate team on this milestone. We at @insightpartners are thrilled to be with you on this journey.
We just raised $25M from Insight Partners to replace Gartner, McKinsey, and GLG.
RIP the Quadrant, the 80-page consulting deck, and the $2000 expert network call.
Our revenue run-rate is up 10x+ this year.
100+ investment firms and enterprises use Qualitate to inform decisions with firsthand evidence.
Here's how:
qualitate.io/book-a-demo
I’m doing the “Canadian tech guy in SF“ this week, who should I meet with? Maybe @tokifyi has some suggestions?
Would love to catch up with the @mastra team if anyone is around?
This is actually quite good: "If a new model drops next month, does your company get better or worse?"
I spent 48 hours in SF hanging out with billionaires, data labs and AI founders and execs running $1B to $100B companies.
My observations:
1. Sooo MANY stories of data brokers making like $2M a WEEK selling company data to labs. I can't tell if it's the beginning or a bubble, and I kept wondering which niches are left. Digging into it actively.
2. At dinner, someone asked the table, "If a new model drops next month, does your company get better or worse?" HALF the table went quiet! I think that's the best question to ask about any AI startup right now.
3. The bar people talk about now is hitting $1B in revenue in 12 months (I guess that's the new unicorn?). What I didn't hear much about is retention. AI revenue can come in fast and leave fast, and I think we're going to see a lot of stories of AI companies with huge revenue and terrible retention.
4. It's pretty clear we're living through the reinvention of the computer. The model is the CPU, the harness is the operating system, and skills and plugins are the apps. Thinking about it that way makes it easier to see where the whitespace is.
5. We're maybe 12 months from an agent that can watch you work for a week and then do your job without any instructions. The screen recording plus agent memory plus local model combination makes this possible right now.
6. Agent harnesses feel like the new GPT wrappers, in a good way, especially vertical ones. The best teams I talked to treat the model as swappable. One founder walked me through routing different models to different jobs: one for taste and visuals, a cheaper one for the everyday stuff, another for text.
They use prompts they can move across models over fine-tuning, and A/B test the output on what users actually do with it: do they edit it, export it, share it? A vertical harness is basically four things: the connectors for that industry's data, evals written by people who know the work, rules for what the agent can and can't touch, and a clean screen for a human to review. The model is maybe 20% of it.
7. There's a lot of reverse engineering going on/cloning going on more than I've ever seen. People are decompiling software and rebuilding it with agents, and someone showed a suite of like 10 apps that are worth $5B+ each all that he cloned open source. Me and everyone are still thinking through what it means when software gets this easy to copy.
8. My guess is the value moves to data. If the software can be rebuilt quickly, what's worth paying for in a legacy SaaS company is the years of customer data and workflows inside it. Some SaaS companies are secretly data companies.
Gets me thinking about how do you truly value data for this saas companies? Like if we were buying these dying saas companies at 2x ARR before (as example), maybe there is a better metric. Idk, just thinking out loud here.
9. It feels like a good chunk of legacy software won't make it to the agentic era, especially anything built around people clicking through a lot of screens.
10. Every company I talked to wants to pipe its internal data into one place and expose it to agents through MCP. Then they look at the data and realize it's a mess: five versions of the same customer, old Slack channels, PDFs nobody can search. Cleaning that up feels like a big consulting opportunity!
11. A lot of founders are building the basic building blocks for agents: APIs, data layers and tools. Some of the companies I saw barely have a UI because the main user is an agent. I really believe the startups that build primitives to this agentic era will do extremely well. Building blocks is the best way to think about it.
12. Labs can get plenty of training data, but it's harder to get real examples of agents failing inside companies. Whoever has those logs has something valuable.
13. Someone running a big consumer company told me the next fight is over memory. The model that remembers the most about you wins, and the smartest model matters less than people think.
14. Physical AI came up a lot. Astra I think was the first model that got people into AI can actually do CAD, and I think a lot of people are thinking what does vibe manufacturing really look like. The line I keep thinking about came from a robotics founder: the hardest problems in AI are deployment problems now, not research problems. Their robots work on their own, call a human when they get stuck, and every one of those calls becomes training data.
15. Cybersecurity companies are having a moment and are actually cool companies to build now, especially the ones that clean up after a breach. Every agent with access to your systems is a new door into your company, and a lot of those doors were left open.
16. Some startups are worth more dead than alive now. A shutdown company with 5 years of Slack, email and code can get paid for licensing all of it. I wouldn't be surprised if founders start factoring that into when they shut down.
17. People are starting to talk about monetizing the agent web. It feels really early, but when the most popular user of the internet is an agent, what startups should you be building?
18. I think agent insurance is coming. Once an agent makes an expensive mistake, insurers will want audits before they cover anyone.
19. Several people said the hire they want most is someone with taste who can write evals. The models are getting good at generating ideas, so the hard part is judging which ones are good.
20. New trend I observed: startup raises VC, uses venture dollars to become a creator, startup fails, founder falls back on being a full-time creator and incubates other products bootstrapped.
21. Getting SIGNIFICANT distribution is HARD right now. Founders are sponsoring buses, buying billboards like crazy and throwing parties with famous DJs to get noticed. Kinda feels dotcom era in that sense.
Attention is what's scarce! The growth guy going viral sharing his UGC strategy from Wispr Flow is a good example. It's the sauce everyone wants, and I truly believe there are probably only 50 people on the planet who know how to scale these types of businesses efficiently in this era.
Always good to get that dose of SF. I felt sooo lucky to have such an incredible trip during such an incredible time in building businesses. Surreal in so many ways.
Happy to be home and locked in.
Until next time!
carsonfarmer retweeted
designing a new plugin system. everything leads back to pi-durable concepts.
i'm pi-durableing all the things now.
Been going through a lot of blog archives. Old stuff from my team(s), and other teams I respect. Such a great source of ideas, inspiration, sharing, etc. I'm kind of sad to see where things are right now. When it was hard to write, a lot of care went into writing. I miss that.
carsonfarmer retweeted
a little early celebration. @indexnetwork_ launches tomorrow 🍻
carsonfarmer retweeted
Heading to SF next week to host a dinner discussion with @boxd_sh & some of our smartest friends on the future of software development, deployment, and management.
It's by invitation but we have a couple of spots open for people passionate and building in this space!
luma.com/gusek7ee
Hear hear!
I am increasingly concerned about the understanding gap in AI systems.
I wasn't at the frontier but I was close to it by global standards, and I am often shocked at how my well-educated but non-AI peers use this stuff.
It does not bode well for alignment and I worry that it will dramatically accelerate the centralization of power towards the labs.
I'm hoping that we'll see more non-lab companies recognize that huge labs are trying to eat their lunch. AI needs to move closer to where work happens, and more of the value of non-AI companies should probably stay with those companies.
I think this will look something like non-AI companies running their own inference, post-training, or developing in-house agent systems.
Unfortunately the education gap is enormous, and most of these companies do not have the resources to hire full-time lab-quality staff to operationalize AI systems.






















