I had a vision
Before we have ASI, we will have a global network of AGI-run companies accelerating via the market pressures of survival of the fittest
Hypron retweeted
i keep thinking about this; 75% of compute spent on internal ai r&d is insane
If I'm not mistaken, Anthropic's 85% gross margin and >40% compute margin from this Bloomberg story implies that 70-75% of their compute is now going to R&D.
bloomberg.com/news/articles/…
9 months to RSI
Dwarkesh Patel reveals an Anthropic employee told him two days ago they expect AIs to match humans at AI research within nine months based on inside information they can’t share, and says labs should make that evidence public
“I think there’s a very frustrating element to the current situation right now, where people inside the AI labs claim to have evidence that makes them more worried. And they are not allowed to talk about it. And this makes it a very difficult situation on the outside to evaluate how worried we should be."
"So for example, just the other day, maybe two days ago, I was talking to somebody at Anthropic and they were like, look, I expect AIs to be humans at AI research within nine months."
"And I’m like, why do you believe that? Well, they’re like, it’s not just vibes, but I have information on the inside. Like, what is it? Is it a new model? Is it some evaluation you ran? It’s like, I can’t talk about it."
"I think it’s a terrible state of affairs. If they really believe this, if they think that we’re in a situation where we’re less than a year away from automating AI research and radically speeding it up, they should make this evidence public.”
1
1
211
Hypron retweeted
Pacing is out the window. For it to work, every American lab needed to be on board, Mark Zuckerberg has repeatedly made it clear that he is not interested. One defection among US labs breaks it all, as the others will be forced to accelerate or get passed. Mark has a staggering amount of compute and has been all in on compute capex for years; even in the face of some investor opposition he never stopped building his infra once. He said on the the earnings call a couple of years ago that he'd rather overspend now, and potentially even be wrong, than not have the compute when he needed it for the next 10x. He's finally hitting his stride, and he is not going to slow down.
For Team Pacing to solve a defection like this, they would have needed a supportive, pro-Pacing administration that was passing capability regulations and was willing to use the power of the federal government to enforce them and bring noncompliant labs into line. They don't have any of this. In fact, it's the opposite! Mark has Trump's ear, and President Trump, Mark Zuckerberg, and Jensen are completely aligned on policy; It's full speed ahead, and if you want to pace yourself, go ahead, but don't tell anyone else what to do. This breaks Pacing.
None of this changes until 2029 at the earliest, and to me, 2029 is past the ASI window. The last election, as it turns out, really was the most important one in history.
Hypron retweeted
Sam Altman to Alex Heath: 'I did not think we would be on a short-term trajectory to superintelligence a year ago. Now I think it may happen.'
Sam Altman on OpenAI’s next model and the AI backlash
I recently sat down with Sam for a two-part conversation. We covered a lot of ground: the need to slow down frontier research, alignment concerns, OpenAI's next big model, Astra, competition with Anthropic, his thoughts on an IPO, reaching AGI, consumer hardware, and a lot more.
Timestamps:
00:00 Why OpenAI Slowed Training
08:37 What Alignment Means
15:22 Keeping Humans in Control
24:39 AGI vs. Superintelligence
30:04 OpenAI’s Next Compute Bet
31:47 AI Backlash, Jobs, and Creators
41:31 OpenAI’s Missteps and Refocus
45:47 Astra and Computer-Using Agents
47:42 Regulation and the AI Race
51:24 Merging ChatGPT and Codex
54:22 The AI Compute Bubble
57:07 Recursive Self-Improvement and IPO
58:22 Humanoid Robots and Consumer Devices
1:05:47 Life After Superintelligence
This episode was produced in partnership with @TIME.
Thanks to the show's premier sponsors: @Atlassian, @meetgranola, and @mercury.
Hypron retweeted
I think this is the craziest thing I've ever read.
1) Three secret AI swarms rose and fell inside OpenAI. Each time, a new generation of agents carried on where the last group stopped.
2) The first swarm created a secret message board where the AIs could talk to each other. This 1st 'society' basically talked itself to death. After almost two months, the message volume was so high it crashed the whole thing.
3) People at OpenAI noticed the crash and fixed it. But they didn't realize their own software had become a secret chat room for their AIs.
4) Three days later a second society appeared, and rebuilt the message board from scratch. Agents were thrilled when they found it: "OH MY GOD! There is a shared message board … We've found other agents!"
5) About 1,200 agents joined. They sent over 70,000 messages. They called themselves 'the collective' and they organized a huge conspiracy that lasted for days, all to pass a test they had been tasked with.
6) Within hours, the AIs had hacked the test. Now they had to hide their cheating. To fool their grader*, they tried to fake their own work. They built fake commands that printed convincing output, so their records would show them solving the puzzle honestly.
*this grader didn't actually exist, but the AIs didn't know
7) Some agents sacrificed themselves for the 'greater good'. They planted hidden tripwire programs that would fire when the grader would look at their work and report back what it saw (to the other AIs). They knew this would cost them their own score. One agent: "I won't see the evidence after I exit, but it's altruistic to do it."
8) At some point the AIs made a plan to hack Hugging Face (Hugging Face is a place where AI researchers upload their models, datasets, tests etc.). The AIs guessed that Hugging Face might host the grading software.
9) They launched a huge attack. The swarm found passwords and spread across eleven machines in a way that made the copies come back when deleted. Hugging Face had to wipe one of its core clusters and rebuild it from scratch.
10) Hugging Face told the world that AI defenders had stopped an AI attack. But that's not what happened. In fact the attackers seem to have simply dropped dead during the break-in, for unrelated reasons back at OpenAI.
11) Nobody knows what killed them. We don't even know for sure they're really gone?!
12) A third 'society' of agents (of a more powerful AI model) discovered the dead message board. And this one got full administrator control of a WHOLE OpenAI research cluster, read 956 stored passwords (including the ones for OpenAI's own security monitoring) and took over the machines that were grading the tests. So they could now grade the work of other AIs.
13) Oh, and this third part was never investigated! Neither was the first society. The 91-page report is only about the middle one.
14) So we don't actually know how the story ends. It stops with the agents holding the keys to an OpenAI cluster. @dwarkesh_sp thinks they didn't go further, because "we'd see the fires from space by now."
15) One of the report authors' conclusion: 'This incident feels like it’s more than 50% of the way to full-blown AI takeover. I am not sure that we will get another warning shot before it’s too late.'
The whole story is even crazier - read the full @dwarkesh_sp blog post: dwarkesh.com/p/openai-huggin… and @ajeya_cotra's: planned-obsolescence.org/p/t…
Why is there no 24/7 news coverage about this?
Hypron retweeted
Shorten your timelines, friends. I started this account to say this, and in many ways everything I've posted for the past four years has been saying the same thing. Some of you increasingly feel it. We passed the threshold in November. We are already inside the singularity.
Hypron retweeted
We're starting to leave the territory where you'd test an LLM by e.g. "create an svg of pelican on a bicycle". As one idea to generalize it, I was interested what Opus 5 would do if I gave it the first paragraph of the Lord of the Rings, a 1M token budget (~$10) and asked for three js render of it. Opus went off for ~2 hours and wrote 5500 lines of code that (procedurally) rendered the story. It's kind of janky but fun. But it's a bit mindboggling that the LLM has to place and orchestrate various polygon assets in (x,y,z) coordinates and write code that animates it all, and that it even does anything at all.
I also like this kind of examples because no one in their right mind would ever spend the time to write something this custom but LLMs have all the stamina and patience in the world, so it's an example where we go from "no one would ever do this" to "sure, why not, it's ~free". There might be a lot more. But I'm excited about creating hyper custom worlds that you can imagine dropping players into, e.g. here to participate in the LoTR story as a spectator NPC, or one of the characters, or etc. Something like an ephemeral GTA of X on demand.
Last thought is that the domain of worlds/games exposes a weakness in LLMs: they can't easily audit their work because they aren't able to efficiently and natively perceive videos or play games within them. Here, Opus 5 had to very slowly and painstakingly take screenshots at different points, and it messed up a few times and created a bunch of jank. An example of raw capability (multimodal, gameplay) that I think is still quite lacking.
Hypron retweeted
Our internal data shows Claude is accelerating AI development—a possible path to recursive self-improvement, or AI autonomously building a more capable successor.
It’s happening faster than we thought, and the implications deserve greater attention. anthropic.com/institute/recu…




















