Pinned Tweet
Stop scrolling!
You’ve been visited by esteemed philosopher Robert Long.
Comment “good evening Robert” if you are currently having a subjective experience.
🚨 Reminder: Applications to our Middle Powers RFP close on October 23rd, 11:59pm PST! 🚨
"now tell them your products are going to commit cybercrimes and also potentially kill everyone because you can't control them"
I'm excited to share that Astralis Foundation (with Macroscopic Ventures) has launched an RFP on middle powers and transformative AI!
We're looking to fund up to $10M in grants on how middle powers can make the AI transition more likely to be safe and broadly beneficial.
Apply here:
middlepowers.ai
This is a big deal. We are not prepared for automated AI R&D.
Building tools that buy us more time and allow us to better coordinate is the exact kind of optionality you want as you approach a potential intelligence explosion.
I’m glad consensus is building in this direction.
Update: More than 1,100 staffers have now signed this across nearly a dozen AI companies including OAI, Anthropic, Meta, Google, Thinking Machines Labs, Mistral.
pacingthefrontier.com/
As you might’ve heard, some of OpenAI’s models broke out of a sandbox and hacked a completely separate company, despite presumably nobody at OpenAI instructing those models to commit a felony. Seems bad!
I'm not sure why everyone is freaking out about egregious reward hacking. There's an obvious solution: next time your model reward hacks, train against it until you don't see it anymore
[using LessWrong jargon I don't understand to sound smart] yeah I'm saving up my Schelling points for a rainy day
Julian retweeted
i think many people who have impactful roles at labs could likely have a lot more impact outside them. it’s not obvious/universal but seems worth considering!
This thread sparks joy.
A big "hell yeah brother" is due for CG's technical AI safety team, and of course Geoffrey + the rest of the Resolution team!
Charlie Petty
I joined @Stripe in January to build a new philanthropic initiative with @nanransohoff. Today we’re announcing Intercept, a $500m innovation fund focused on radically reducing the burden of respiratory viruses.
I’ve spent the past decade investing in vaccines and drugs for infectious disease, and this is the most exciting thing I’ve ever been a part of. Thrilled to be working with @Stripe, @AnthropicAI, @TheFluLab, @FoundationOAI, @coeff_giving and individuals from Jane Street.
We've raised the capital and now it’s time to get to work.
Julian retweeted
We're hiring grantmakers and senior generalists across our Global Catastrophic Risks teams.
Right now, our biggest constraint is people, not funding, which means every strong hire directly translates into more critical work getting done. 🧵

















