1/ My heart is heavy. I made a number of mistakes in my life, and not asking earlier for an immediate slowdown is one of them. If OpenAI starts making similar breakthroughs in biology, we risk something very ugly... I explain below how 1B could die because of advances in AI x Biology, and answer various questions. Slow down! That's what is being asked by YouTubers and creators with 300M+ subscribers combined. teamhuman.org/ A year ago, I co-led the Global Call for AI Red Lines, because I thought we still had some time. There is no more time. If they can do this in math, they will absolutely try to do this in ML research. RSI has arguably started: Claude already leads 26% of Anthropic's R&D, up from effectively nothing at the start of the year. RSI was once a red line. The red line has become the plan. Yoshua Bengio said, “RSI should be illegal”. I agree. We are mostly on track for AI 2027, and it's a coin flip between misalignment and extreme concentration of power in the hands of one company or one government. Prove you can keep control, or stop scaling! If OpenAI and Anthropic want to keep scaling, they should publish a safety case. Everyone seems to be forgetting that we already got an embedded evaluation, with the risk report from METR. We already know that mitigations are not ready. At the end of the last investigation, Beth Barnes from METR said: "We are not on top of it!". Even basic safeguards like DNA synthesis screening aren't enforced. Even if the technical safeguards were in place, society at large isn't ready, and we cannot allow this reckless experiment to continue. I support the acceleration of the diffusion of AI for beneficial applications, but even without further scaling, this technology is already as transformative as the internet and would take decades to percolate before we run out of low-hanging fruits. Seriously, AI is already nuts. Models now crack problems mathematicians couldn't solve for decades, while most hospitals still run on fax machines. Time to touch grass before we are forced to.