One of my favorite proposals in this piece is: Limit capabilities of models used for AI R&D It seems relatively simple to enforce to me, and has some nice properties: > It delays the point at which AIs have the capability to sabotage AI research and align the next model to themselves. > It likely introduces a “negative internal-public gap,” meaning that models are deployed to the public before being used for internal AI R&D. This is good for societal response. > It has larger effects in worlds where takeoff is fast and therefore more risky. This also means that those who are skeptical of rapid recursive self-improvement may be open to this policy, because on their worldview it wouldn’t have as much of an effect. This policy could optionally be combined with a minimum transparent safety allocation