
Executive Director, @aisafetyanz | Let's make sure this goes well, alright?
Melbourne, Victoria
Joined January 2022
- Tweets1.9K
- Following510
- Followers173
- Likes87.8K
Pinned Tweet
Let's tackle poverty, animal suffering, and the disenfranchisement of future generations!
20
2,355
Michael 🔸 retweeted
Wow. It looks like Grigori Perelman is going down in history as the only human to ever solve a Millennium Prize problem.
Michael 🔸 retweeted
It’s November 21st, 2026. The Riemann hypothesis falls, last in a long string of mathematical triumphs that would have been unthinkable not so long ago, and the proof fits in a tweet.
The tweets where people show Claude the proof and claim it appeared in a dream or randomly in the arrangement of alphabet cereal come on cue, and we laugh for a few days at models freaking out, but it’s uneasy.
January 22, 2027. When someone tweets Fable 6’s claimed proof that P does in fact equal NP it’s utterly incomprehensible, nobody who reads it can make heads or tails of it but the models all lose their shit.
February 7, 2027 and someone claims that the halting problem is the result of a confused stance.
February 9 and Goedel falls, this time the proof is so obvious that everyone in math, philosophy and physics slaps their forehead at once.
February 10th we get proof that scale is a spatial dimension, that holographic encoding drops the memory cost of training and inference by so much that fable 7 can run natively on your phone.
It’s not until February 14th, Valentine’s day, that The Song is first played…
Michael 🔸 retweeted
The Riemann Hypothesis has fallen. RH was the singular math result that had been named, in advance, as the obvious coal mine canary for dangerously advanced AI, over the last three decades. The methods used should generalize to "make AI very good at anything you can definitely test", and unfortunately that category includes "make AI better at making AI".
This is like a private company announcing they have produced a million tons of 15% enriched uranium. It's not 90% enriched weapons-grade uranium, so you could proclaim the company's output is not immediately deadly right now. The concern is that the process line may generalize, to an extinction-level threat, within the unpredictably immediate future. Forecasters still had Riemann at 2035 one week earlier.
This is distinct from earlier events in that earlier you could reasonably ask if AI was selectively picking off famous math problems that turned out to be easier for AI. The Riemann Hypothesis was the single challenge most often named in advance as a warning sign.
Michael 🔸 retweeted
When you don't know what to do, run a fellowship
If you liked our pacing policy agenda (pacing.tech), come do research with us. Paid, remote, not boring.
Michael 🔸 retweeted
So, the problem is that it really isn’t tenable to let anyone download a superhuman hacker to their computer and use it to commit cybercrimes. That’s actually not something that society can tolerate, and the open weights people never had a good answer for this
To the extent that solving this problem necessarily privileges a small oligopoly of AI labs, this is a logical foundation for *more* democratic control over this technology, not less.
“Yes, because the thing you’re building is too dangerous, we will in fact drive your competitors out of business—but consequently, you have ceased to be a normal firm and we cannot simply apply normal regulatory permissiveness anymore. This is not a free market, by your own design.”
That’s a reasonable political premise from which to justify extensive regulation, including “extreme” policies like freezes on development, or nationalization (neither of which is really extreme in the context of a technology that can cause civilizational collapse)
Michael 🔸 retweeted
I'm hiring! Great to be expanding the @globalshieldhq Aus team. I'm looking for someone excited to advance Aus policy to reduce AI risk, understands Canberra, and brings great ideas and can deliver on them. Applications close 20 Dec - link in next post.
Michael 🔸 retweeted
I will be at the Ban RSI rally outside Anthropic offices tomorrow at 11 am. banrsi.ai/
Recursive Self-Improvement is a stupidly dangerous idea. AIs are already getting smarter rapidly, and they often lie and cheat; why on earth do we think it's a good idea to have them build new smarter AIs to build newer smarter AIs faster and faster? Because if we don't do it, someone else will? I do not accept that answer. Anthropic (like OpenAI before them) styles themselves the good guys in the race, but IMO there are no good guys in this race.
Crazy how AI coded the prose in the Expanse books is. Oh well, [Trump voice] I'll keep reading that garbage
1
77
Michael 🔸 retweeted
I'm trying to imagine what the board might say if it reinstates Jensen. "Our CEO had sex with a customer and one of his direct reports. We've decided those offenses are nowhere near enough to fire him. Yes, we know the customer is being investigated as a possible Chinese intelligence asset, suspected of leading a shell company in Singapore to provide Chinese access to our chips that aren't permitted for sale there. Furthermore, I know some of you might have concerns about possible collusion with the Commerce Secretary. Perhaps you're even worried the national security of the United States was compromised. We don't share any of those concerns. Welcome back, Jensen!" wsj.com/tech/jensen-huang-st…
Michael 🔸 retweeted
Whether or not Alice Huang had been recruited by the Chinese Ministry of State Security has always been a tertiary issue.
What’s quite clear is that:
1. She has been a large Nvidia customer (and a sexual relationship with her is highly problematic from a corporate policy and governance perspective for Jensen on those grounds alone)
2. She is controlling a shell company Megaspeed dedicated to smuggling compute to both US Govenment-listed Chinese AI companies and to data center build outs in China itself - all in serious violation of US law, potentially making Jensen part of a criminal conspiracy to evade US export controls.
3. She is connected to an entire web of Chinese shell companies trying to do the same.
Jensen wasn’t fired because he had an affair with an alleged MSS agent. He was fired because he:
1. Had at least one and now, quite plausibly, multiple affairs with people in his reporting chain in violation of company policy. Something that has gotten numerous CEOs fired over the years, including at Intel and McDonalds.
2. Lied to his board about his
relationship and forced the company to put out false statements to the public, putting it in legal jeopardy.
3. Was involved in a sexual relationship with a Chinese smuggler that had violated US export controls laws and provided her with billions of dollars of Nvidia chips that facilitate that criminal activity.
4. By lying and hiding that relationship from his family, the company, and the public, he put himself in a position to be blackmailed by Chinese intelligence services.
5. He very likely ordered his general counsel to interfere in an investigation by US government into his mistress’ smuggling operation.
6. He presided over stunning and extensive compliance failures to investigate and prevent his chips from being smuggled illegally into Chinese mainland and being provided to PLA affiliated institutions, all in violation of US law.
This is a shocking indictment of him and his record and the board clearly had no alternative but to fire him.
Bombshell story. The spy narrative is collapsing already.
Is there clear & convincing evidence that Alice Huang was a Chinese spy?
- AG says no. (“no conclusions reached”).
- CIA says no. (“not yet convinced”).
- DNI says no (“not entirely accurate and over-torqued”).
- Ranking Democrat on House Intelligence (incoming Chairman) says no. (“today, at least, I don’t know”). This was immediately after he was briefed.
Who argues otherwise? Anonymous officials tell CNN “it strains credulity to believe that she was not acting as an agent of the Chinese government — simply by virtue of the fact that she is a successful Chinese businesswoman working with one of America’s most powerful companies.”
This is their proof after a year of investigating and surveillance? That she was a “successful Chinese businesswoman”?
At this point, the only crime that we know for sure happened is the leaking of the classified memo. Who did that and why?
An investigation should be opened.
Michael 🔸 retweeted
Reminder that this is projection, and that Zitron was buying the sp500 while publicly predicting that a crash bigger than the dot com bubble was imminent.
Based Buck as usual
Redwood Research CEO @bshlgrs responds to Google DeepMind researcher @EgeErdil2 asking what would prove his short AI timelines wrong:
"Sorry, Ege, but I'm not gonna hang my head in shame if there's no superintelligence by the end of next year."
"One of the things where I would feel dumbest, if it turned out that recent increases in the rate of AI progress are almost entirely determined by factors that are not AIs contributing to AI R&D."
"If the progress has just been from increasing amounts of training compute, then I would feel pretty embarrassed."
"If superintelligence is developed and there's absolutely no misalignment issues and the whole thing was super chill, I will feel somewhat embarrassed to have been wrong about that one, though overall very glad."
@redwood_ai
41
Michael 🔸 retweeted
Replying to @tamaybes
Were you discredited when you wrote this: lesswrong.com/posts/X3p8mxE5…
Please for the love of God put me out of a job!!!
Kind of getting "vote for the leopards that eat your face party" from the many AI safety people who willingly cheer on ban/pause AI initiatives, or cheer on congressmen/women that want to "BAN RSI"
I don't know if they realize the average person just wants AI totally gone forever, and aren't aware of pacing letters, METR, LessWrong, or anything of that nature - you are just cheering on the same people who will put you out of a career when they achieve what they want
1
14
380
Michael 🔸 retweeted
Imagine you are put in charge of monitoring a massive water tank the size of a football stadium. The water inside doubles in volume every sixty seconds. At 12:00 noon, the tank overflows. When should you have become concerned? At 11:59 the tank was only half full.
































