chair (@tablefourthree) header
chair (@tablefourthree) profile picture
Joined November 2021
Inject this right into my veins. Cc: @DavidSacks “Sacks, I think, is going to be right there with [Commerce Secretary Howard Lutnick]— also deservedly. This whole ‘Maybe she’s not a spy so the whole story is a scam’ argument is drenched with flop sweat.”
83
Replying to @ZacksJerryRig
“No Santa in Israel, pal”
1
880
Replying to @PauseAI_UK
There is also a lot of demand for someone to say “AI is a bubble. You don’t have to change. The evil AI companies will collapse any day now. Rest easy.”
3
109
Classic @sama tactics. Rumors rumors rumors rumors. > They don't need to present actual evidence, they just need to cast vague aspersions, and many employees will give them the benefit of the doubt.
I'm just speculating like everyone else (no juicy secrets about this shared with me) but here's my guess about what is going on right now with OpenAI and the three fired employees: The negotiations between OpenAI and METR are ongoing. OpenAI has said they want embedded third parties, METR has proven their worth with the previous engagements, so METR is an obvious choice. But my guess is that METR is asking for more this time; probably they want more access, more time on site, less narrow scope, the right to comment on redactions, etc. (Compare with the terms of their previous engagements: In this one teapawt.net/METR_Evals/status/2113… a third of their report was redacted and they weren’t allowed to say why, and in the Hugging Face investigation they only had 6 days and were only allowed to investigate the precursor swarms nor the subsequent more severe compromise of OpenAI infrastructure. teapawt.net/DKokotajlo/status/2092…) Various researchers at OpenAI probably support METR in this (including, I’d imagine, the fired three employees? Tomek was the point person on the hugging face investigation), but also various higher-ups at OpenAI and legal types probably oppose and want more restricted access and scope – basically they want to work with an org that’ll go easy on them and not give them trouble. OpenAI holds most of the cards here, since this whole thing is voluntary and not legally required, and they can threaten to go with Accenture or HuggingFace or whatever instead. Anyhow to improve their bargaining position and/or minimize the blowback if they decide to say no to METR and go with someone more pliable, it helps if they can discredit METR. Hence (I suspect) why they are going after my friend Ryan Greenblatt (who works at METR) now. They don't need to present actual evidence, they just need to cast vague aspersions, and many employees will give them the benefit of the doubt. If and when they say "We chose to work with a different third party" they'll face lower risk of employee discontent than if METR's reputation was unsullied. This whole mess, by the way, was predictable. *Of course* there's a big political fight about who should be trusted to do this and who has relevant expertise and independence etc. and *of course* the companies are trying to make things shake out in a way that favors them. It's part of why I've been advocating for *actually pacing the frontier* instead of just doing third party assessments. "We allocate at most 20% of our compute to AI R&D" is a lot easier to verify than "we are being safe and responsible" and depends a lot less on subjective judgment and technical alignment expertise -- AND, if you do it, people will be able to see the slowdown in the trends of agentic coding performance in the frontier companies and see laggard companies start to catch up. Harder for it to end up just being safetywashing / industry capture.
1
109
Replying to @TheStalwart
Seems like Anthropic plans to do both.
1
206
Replying to @supabase
Average dark mode enjoyer’s interior design taste:
4
293
Unfortunate for someone playing a senior role in US AI policy (via the new SI Force) to get so many basic facts wrong here. - The agents *were* sandboxed, and used zero days (ie previously unknown cyber flaws) to escape their sandboxes - The agents *were* given specific constraints on how to succeed at the benchmark, and flagrantly contravened them - The agents did *not* go hunt for the answers to the test (they already had the answers, by cheating); 1200 agents coordinated via tens of thousands of messages over several days on much more ambitious and weird attempts to *not be caught* for cheating, and hacking Hugging Face was one side quest along the way I know there has been an avalanche of different incidents over the past few months, and in some cases the sandboxes were misconfigured or it's not clear how far the agents strayed from what they were told. I have sympathy for anyone struggling to keep up. But the HF incident is distinct, and is actually extremely informative about where AI development is and where it's going. Fortunately there are public writeups that do let us understand at least the basics of what happened. I hope Shyam reads them soon.
1
285
Replying to @trq212 @thdxr
Here's a handy image you might get some good mileage from against Dax
2
1,976
"We’re hearing people are now being told vague rumors internally to discredit us." Classic @sama move: spreading false rumors to weaken support for your opponents. He did the exact same thing to the OpenAI board to overthrow them back in 2023.
Replying to @j_asminewang
The reasons that we were provided for our terminations are simply not adding up. We’re hearing people are now being told vague rumors internally to discredit us. I have already addressed the allegations presented verbally. If there are other reasons beyond the one I was given, I believe it is in service of due process for those reasons to be sent to me in writing. To date I’ve had nothing.
1
1
193
Cautious optimists/accelerationists unite!
Turns out I am a Radical Centrist 🔥
1
1
42