
PhD student at @UofT working on AI alignment theory. Heavily tattooed. Research Lead at https://xitter.cf/t.co/8LhzJnSE2C. Blog: https://xitter.cf/t.co/ivZ9BGOoOt
Joined January 2018
- Tweets1.5K
- Following1K
- Followers1.2K
- Likes23.3K
Pinned Tweet
I'm excited to announce Principled Agents, a research nonprofit! Our aim is to develop principled solutions for core problems in AI alignment, ensuring the goals we give AGI are beneficial and safe. We're currently hiring and running a monthly discussion group, see below.
Rubi Hudson retweeted
Proposed terminology for groups of agents:
- Team: ≤105 agents. (size of college football roster)
- Fleet: 105–6,939 agents. (largest fleet in history was 6,939 ships, for the D-Day invasion)
- Flock: 6,940–3.7 billion agents. (A passenger pigeon flock over Ontario in 1860 had ~3.7 billion birds.)
- Swarm / Collective: more than 3.7 billion, up to 12.5 trillion agents. (The largest recorded insect swarm was ~12.5 trillion Rocky Mountain locusts. As independent literary validation, the Borg Collective also canonically contains trillions of drones.)
Beyond 12.5 trillion, the insect precedent runs out and we will need a new term.
This is well-grounded in human experience and literature and is the only reasonable choice of terminology. thank you for coming to my ted talk
Rubi Hudson retweeted
The U.S. flag packs 50 stars into a rectangle. I found a packing with stars 95% larger in diameter. It has central symmetry and is our best so far, though not proven optimal. I don't know if an optimal packing has central symmetry. AI-assisted search.
This is an fantastic paper! My new #1 recommendation for mechanism designers interested in AI safety. I know Andrew has been thinking about alignment-related issues for years, and this work reflects that deep consideration.
We develop a mechanism design framework for AI alignment and control: arxiv.org/abs/2609.01595
It’s largely conceptual but we offer stylized applications to failure modes (sandbagging, alignment faking), safety practice (scalable oversight, peer prediction), and a way to think about the value of alignment, interpretability, capability, and control.
Rubi Hudson retweeted
When the US standardized stop signs in the 1920s, everyone already agreed red was the right color ...after all, "red" was "stop" for traffic signals. The problem was that durable reflective red paint didn't exist... all the reds would fade in the sun.
By the late 1940s, fade-resistant porcelain enamels and reflective sheeting finally made red feasible.
Rubi Hudson retweeted
makes u think
xitter.cf/StefanFSchubert/status…
The borrowing to finance AI investment is contributing to rising interest rates on government debt, the FT reports
Cf @BasilHalperin
Rubi Hudson retweeted
This has gotta be one of the cutest AMF distributions - someone from Sumbe, Cameroon moved to the US. Later, when they went to visit family, they caught malaria. So they and their coworkers at PACE Analytical funded bednets for the whole village. againstmalaria.com/Distribut…
I think Leopold is irresponsible for brushing off misalignment risk without making a serious argument against it, but I would absolutely invest if he started a new hedge fund at current prices and promised to cap out at 3x leverage
I don't understand how an AI can forecast 50% more accurately than me. When I forecast 50%, I'm perfectly calibrated.
I'll be presenting my paper, Corrigibility Transformation, at the first ICML poster session today! Swing by to chat about what kinds of goals are safe to give powerful AI systems.
Rubi Hudson retweeted
The EA forum is basically tied with the Fine Homebuilding forum in uses of the term "load-bearing". 2995 for the EA forum vs 3029 for Fine Homebuilding
Rubi Hudson retweeted
Every TV show should have one episode called "Future Imperfect" about an evil future and one episode called "Fearful Symmetry" about evil clones TBH.
Rubi Hudson retweeted
not getting in the first 0.1c starship because i don’t want to be 0.2cmogged in 30 years
The Researcher and Research Assistant roles start as remote, contract positions, but we hope to make full-time offers with in-person options. The details and application forms are at principledagents.org/hiring, please share with anyone you think could be a good fit.
Our discussion group meets monthly to discuss new research that ties together incentive theory and AI alignment. You can sign up for the mailing list at principledagents.org/discuss…, and suggest presenters (including yourself!) by emailing [email protected]. (3/3)


























