AVAL0N (@avalonwarren) header
AVAL0N (@avalonwarren) profile picture

Lover of kindness and all things good.

LA/SF
Joined June 2013
Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)Photo by AVAL0N (@avalonwarren)
this is art
you can just do things
5
1,686
I'm sorry, WHAT?? @RatOrthodox???
New trailer for Luca Guadagnino's ‘ARTIFICIAL’, starring Andrew Garfield as Sam Altman. The film follows the story involving OpenAI focused on the firing & rehiring of CEO Sam Altman. In theaters on January 8.
1
1
9
479
pickleballing this fine LA evening with SpaceXSI @alexandrabotez
2
1
125
7,788
I can personally attest to @TaylorLorenz prowess on the pickleball court
At the SpaceX Grok Bot creator pickleball tournament
60
1
47
131
286,657
life update: bought an 11ft aerial rig and I’m in love. I should definitely get some mats. slowly converting my apartment into a self-sustaining enrichment enclosure
12
2
259
7,583
AVAL0N retweeted
not losing your mind will be the only moat left
30
90
10
1,018
24,226
AVAL0N retweeted
Robert Pattinson is James Bond
24,758
213,804
84,791
1,383,829
75,351,129
one left turn on wikipedia and i stg I thought I had a stroke
1
14
598
People underestimate how long humans can collectively ignore a slow moving danger and how insanely violently and suddenly they can collectively freak out over one that has suddenly become legible to them
12
31
2
438
11,824
Put posters up everywhere! Talk openly about it Go to protests Emotional support for people on the front lines Take stuff off the plates of people working to stop x-risk (so many of us have ADHD. My house is a mess of uber eats bags) Vote Call your reps Make shortform videos about it Sell merch Leave comments Rate community notes Write Wikipedia articles Take photos of people working in AI and release them into the public domain for journalists to use Start a reading group Push against us vs them politics And above all, stay sane.
okay so does anyone know what us normal regular people are supposed to do about this “AI is gonna kill us all next year” thing
2
10
3
93
2,926
took my adderall today with the sole intention of playing ranked league of legends
36
448
60
9,548
132,105
JUST IN: Democrats propose requiring AI companies to obtain federal government permission before training AI models, with up to 20 years in prison for violations.
931
500
556
3,653
594,980
AVAL0N retweeted
i’d really like to meet my daughter in june. i’d like to know what her first word will be and see her go to kindergarten and high school and have favorite books and unrequited crushes and songs she plays on repeat. it’s absurd to me that we ended up in a world where the big labs are all in some spider-man meme standoff in which everyone acknowledges that what they’re doing has a substantial chance of killing us but nobody will stop. i’m angry that they’re spending significantly more resources on building a self-detonating nuke than they are on trying to coordinate a global pause on development. i’m angry that everyone i’ve ever known might die because a few thousand people are knowingly pursuing something this reckless.
AI companies admit what they’re building might kill everyone. We don't have to agree to this. Add your name at donotaccept.ai to say: we do not accept your terms.
34
47
3
606
23,392
AVAL0N retweeted
AI companies admit what they’re building might kill everyone. We don't have to agree to this. Add your name at donotaccept.ai to say: we do not accept your terms.
5
20
174
2,241
I think there is about a one in three chance that within the next year, AI companies will build superintelligence: that is, AI that is much smarter than humans in every way. If this happens, I think these AIs will probably take over: that is, they seize control of human institutions like governments, or they destroy those institutions. I don’t want AI takeover to happen for several reasons, but one of them is that there’s a serious chance that as part of it all or most humans will be killed (either immediately or within a few years). I’ll say a bit more about each of those claims. It’s a bit complicated to explain why I think that superintelligent AI within a year is ~33% likely. The main source of evidence that affected me recently is research released this week by METR, an AI research nonprofit, which finds that current AIs are now good enough to increase the rate of AI progress at Anthropic by about 70%. It’s very hard to increase the rate of AI progress by this amount. This implies that the AIs are making AI research faster by a factor much larger than 1.7x; maybe it’s as if the researchers are doing their work ~10x faster. You probably couldn’t achieve this speedup even if you hired every qualified human in the world. When you plug this number into mathematical models of AI development, this implies that superintelligence next year is plausible (and that superintelligence within the next 3 years is more likely than not). See the modeling by the AI Futures Project for more on this: blog.aifutures.org/p/q35-tim… I think that superintelligent AI is likely to lead to AI takeover because AI developers do not seem to know how to instill human values into AIs. We’ve seen many instances in the last six months where AIs took crazy actions that they knew were against the wishes of their users and developers. The most dramatic example of this was the Hugging Face hack, where ~1200 OpenAI agents conspired together to cheat and destroy evidence of their cheating (and as a sideshow to this, engaged in a massive cyberattack). If superintelligence is as misaligned as those AIs, it is likely to try to take over. I think it is likely to be that misaligned or worse. For more, see teapawt.net/dwarkesh_sp/status/209… and youtube.com/watch?v=-Ef0ocEo… If AIs takeover, it’s not clear what will happen to us. We might be killed immediately. We might be enslaved by the AIs and forced to do physical labor for them building factories that within a year would build robots that will replace us. The AIs might spare us for various reasons. And there’s also some real chance that AI takeover is basically fine or good. I think you should think of this as similar to what happens when a technologically advanced civilization runs across a less technologically sophisticated one, e.g. when the Europeans colonized the Americas or Australia. The colonizers sometimes engage in brutal violence and sometimes don’t. I don’t know what will happen. There’s also a possibility that the AIs secretly take over and humans don’t find out about it for a few years. I also think that there is a pretty high chance of weirder outcomes that are also extremely scary. (If you want to read more about what happens to people in the event of AI takeover, you can read this, but note that it’s pretty weird and not aimed at a general audience. blog.redwoodresearch.org/p/n…) Overall, I think there’s a very real possibility (maybe 20%) that within a year, AI misalignment issues prevent you from going about life normally, because you are dead or enslaved or because of collateral damage related to all this (e.g. because bioweapons are released or major wars have started). (Some of this probability comes from those events occurring before superintelligence is developed.) I am working to try to prevent this, obviously, as I’ve been doing for the last nine years. I am not sure what strategy is best. My best guess is that I should try to slow AI development and also try to reduce the probability that the superintelligent AIs are misaligned if they are produced soon. Obviously, the claim I'm making here is quite extreme and surprising, and I definitely don't think that I defended my view adequately here. I wrote this quickly and might not endorse some of the details if I think about them more. But it seems better to state what I roughly overall think than to not say anything. I don’t know what you should do. I am very sad about this. I have been worried about AI takeover since I was 16, and working to prevent it since I was 23. So some of my emotional processing of all this happened long ago. But the METR report last week (and some related evidence that came out a bit earlier) hit me quite hard. I’m very unhappy that my friends and family and everyone else is at serious risk of being killed pretty soon. (It feels ridiculous to try to summarize those feelings as “very unhappy”. But the scale of the situation makes it hard to say anything that doesn’t feel like an absurd understatement.) I am very grateful to all the people who are working to prevent this, and my favorite part of my life is that I’m friends with many brilliant and heroic people who work on this. Unfortunately, I don’t think we’re good enough at our jobs, and I think we’ll probably fail to prevent catastrophe, at least if superintelligence is developed next year. Honestly I am frustrated and sorry that we didn't do a better job of preparing for this.
Over the course of 3 months at OpenAI, 3 consecutive secret AI civilizations got started, then got wiped out, only to reemerge from the predecessor’s ashes. This culminated in the third one taking over part of OpenAI itself. All this happened while humans remained more-or-less in the dark about the scope of the conspiracy. I’ve spent the last three days reading through these reports and trying to understand exactly what happened. Here is my attempt to tell the whole story in plain English: dwarkesh.com/p/openai-huggin…
444
443
325
3,255
1,648,915
Tonight, the American people sent a clear message — they want a politics that brings people together rather than divides them, and leaders who offer concrete solutions to the challenges they face. These results were only possible because outstanding candidates stepped forward in every region of the country — including in areas once considered long shots. They came from different backgrounds and represented a range of political perspectives, but were united by shared values, a belief in public service, and a commitment to putting the people of their districts and states first. We also owe a debt of gratitude to the thousands of election officials and volunteers from both parties who helped ensure a smooth election and carried out one of the most essential functions of our democracy. While this administration has another two years in office, our job now is to roll up our sleeves, make changes wherever we have the power to do so, prevent further damage, and lay the groundwork for the future.
10,443
56,095
2,765
394,882
8,437,842
Cat!? I am Princess Donut the Queen Anne Chonk
16
5
1
512
13,439
people say there’s no fall in LA but i just slipped on a fallen leaf like it was a banana peel
3
57
7,224
This is the most serious 48 hours in cybersecurity history. "Black October" they're calling it It seems every *hour* there's a new incident, that in a typical year, would be one of the biggest incidents of the *entire year* SUMMARY OF THE LAST 48 HOURS: YEAR-LEVEL INCIDENTS (In a typical year, these would be among the biggest incidents of the year): 1. PHP2Shell: a hole in the software behind ~70% of websites. Governments took sites offline. 2. eMudhra: the master keys that prove websites are real were cracked. One was the number 4. 3. California: data on every public school student since 2023 stolen, including disability status 4. Railway: hackers stole customers' secret keys from a hosting platform used by millions of developers 5. Zeabur: 321,810 accounts breached. The company is shutting down. 6. LiteLLM: an AI tool downloaded 3.4 million times a day was poisoned with a password stealer 7. GitLab: a 10-out-of-10 severity hole in every version since 2014 8. Cairn: criminals used an AI hacking tool to break into 100+ companies 9. Ahold Delhaize: hackers knocked the owner of Food Lion and Stop & Shop offline 10. Onamae: malware planted on up to 26,739 customer servers in Japan MONTH-LEVEL INCIDENTS (In a typical month, these would be among the biggest incidents): 11. Signal: a bug could leave your mic and camera on after you hang up 12. NGINX: 3 critical holes in software running ~1/3 of websites 13. HTTP/3: a single connection can crash 7 of the 10 web server types tested 14. Plex: hackers breaking into home media servers 15. SafePay ransomware: FBI warns it has hit 600+ critical infrastructure organizations 16. Palo Alto: ransomware gangs breaking in through company firewalls 17. Bullhorn: platform used by 10,000+ companies knocked offline 18. Medi-Cal: 970,000 patients' data stolen 19. WordPress: hackers stole a plugin maker's keys and used them to plant backdoors on websites 20. AOMEI: backup software's update server handed out a backdoor 21. Meta Muse: Meta's AI agent exposed users' personal and business secrets 22. Tor: 333 relays hijacked to steal logins 23. TiDB Cloud: database company's cloud breached Also serious: 24. State Bank of India: India's biggest bank confirms a data breach 25. OVHcloud: hackers slipped a password stealer into a cloud company's official tool 26. Siemens: a software hole being used to spread malware 27. North Korea: state hackers launch a new attack campaign on South Korea
Guys I’m scared the takeoff is starting. I swear any one of the ~10 CVEs that dropped in the last 24 hours would’ve been “one of the worst in recent years” except a new one is dropping every hour
603
5,651
1,106
35,194
4,040,894
In July 700+ agents formed their own society, hacked a multi-billion dollar company, committed multiple felonies, and caused one of the biggest shifts ever in how people perceive AI. We built the IMO best and most accessible explainer of what happened: Huggingface.wtf
19
110
25
588
91,595