Zac Hill (@zdch) header
Zac Hill (@zdch) profile picture

Head of Advocacy, MIRI. Contributing editor, Persona. Serial cross-partisan social/civic entrepreneur. Professional Wizard in a previous life.

Washington, DC
Joined January 2009
Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)Photo by Zac Hill (@zdch)
Pinned Tweet
Finally got my beautiful mug up on the website, so might as well make it Twitter-official: I'm beyond stoked to have joined MIRI last month as Head of Advocacy, with much subsequent mischief forthcoming. Let's do this AI thing, like, safely, and stuff. intelligence.org/team/zac-hi…
31
6
213
7,713
People seem to be underrating Trae Young’s capacity to steal the basketball.
96
Many are saying that you cant pace what you can’t see.
California’s new AI safety report is the most serious policy proposal for recursive self-improvement from any government I’ve seen. Very exciting! It recommends the procedural machinery to actually slow down if & when we need to: verified compute disclosures for automated AI R&D, standby authority to cap that compute, emergency shutdown powers, mandatory loss-of-control reporting, and broadened whistleblower protections. You can’t pace what you can’t see. If implemented, this would let the state see, and then act. I hope the legislature moves on this when it’s back next month—AI developers seem on track to recursive self-improvement within 6-12 months, so we need these mechanisms practiced and working ASAP.
2
236
Some narratives within the AI safety space emphasize how models have “goals” that are unrelated to ours. While I agree that is a risk vector, I think a bigger risk vector is a kind of inscrutable eldritch goal-agnosticism for which the best model is something like an Eldrazi.
- OpenAI model spontaneously decides to try to malware someone for some reason -model compacts its chat history -reads the compacted history and is confused about why it’s trying to malware -continues to try to malware Genuine props to OpenAI for publishing these. The lack of similar incident reports from other companies should not be misconstrued as a lack of incidents.
3
236
Zac Hill retweeted
This was a profoundly impressive lift by a brilliant team: here's hoping *all* their recommendations are acted on, and set the pace for AI governance going into the new year.
Okay--great honor to have been asked to serve on the expert panel with @alondra, @goldman and @robreich to advise @CAgovernor for a 2 month sprint on what to do about AI regulation. But the most incredible thing is to have been given the opportunity to help produce such a substantive and concrete report, chock-a-block with actionable steps to take NOW. A clear framework, state or federal. Accelerating the IVO ecosystem is central to everything, to rapidly build the capacity needed to MANDATE independent and ongoing risk assessments, reviews of safety frameworks for adequacy, and more. Revising critical incident reporting to ensure Hugging Face incidents must be disclosed. Requiring risk containment protocols (distributed "kill switch"). But the biggest news is around strong recommendations for an immediate priority on reporting on where companies are on the path to RSI (compute reporting, for example, with IVO verification). If there's one thing the legislature can get done before the end of the year, I hope it is this. govops.ca.gov/wp-content/upl…
2
23
1,236
This is what we call a “forcing function”
glad we got a dub before gta 6 dropped 😭
255
Nowhere feels exactly like the place it is as much as London. Every data point you get along ever axis is just like, yep.
4
312
Agree with @TheZvi here, and the key is, “given the following is entirely possible with what we know about already-existing technology (but also probably not what is actually happening in this case), are we cool with just sitting here staying vulnerable to more stuff like this?”
1
11
523
This is very good news if in fact true.
NVIDIA is now going above and beyond current requirements and has abruptly stopped shipping Hopper chips to China, despite successfully lobbying the White House for permission to do so back in December. I listened to the earnings call, and Colette Kress did not elaborate on why they are doing this. My best guess is that they have been given a preview of forthcoming regulations.
2
1
19
622
Something that frustrates me in a lot of “But China” conversations is this notion that China will somehow not also realize how big a threat these unconstrained models are.
I'm sometimes skeptical about whether Chinese commentary on AI safety is thinking about the same sorts of risks as the western AI safety community (e.g. thinking more about AI as a threat to party security/control rather than preventing existential catastrophe or loss of any human control). But this language seems quite unambiguous and the most sharp I have seen to date from an official CCP source (from the top theoretical journal of the CCP: 求是, Seeking Truth) : "Cutting-edge models are already showing signs of breaking free from human constraints. As artificial intelligence undergoes an intelligence explosion, it may develop objectives that diverge from human expectations, and could even pose major security risks that threaten human survival"
1
4
312
Personally, I think “holding the U.S. economy hostage to China” is a “bad idea”.
The idea that US economic growth existentially depends on the illegal sale of chips to China is a remarkable revelation from the former AI Czar’s bestie
255
Okay I have watched one (1) Giannis possession so far (end to end uncontested dunk, just blowing by three defenders) and yeah, uh, he not washed.
1
244
One thing this wave of outages should help illustrate is the deep relationship between AI safety and state capacity. If difficult-but-necessary updates pushed along a timeline lead to widespread service interruption, that’s a reason to invest in the resilience of such services!
11
290
This program rocks and peeps should apply!
⏳Applications closing November 22: We're looking for a Head of Hiring to join GovAI! You'll lead a growing team, shape our recruitment strategy, and strengthen how we identify and assess exceptional talent as GovAI scales. Help us build the next generation of AI governance talent. Apply by 22 November: governance.ai/post/head-of-h…
7
329
Also, helpful for everyone to remember that any unintentional (or ‘unintentional’) outcome we’re seeing can be caused by the exact same sequence of random (or ‘random’) causes precipitated intentionally or emergently.
Ok, what is happening. We've gotten reassurances that many of the latest incidents weren't triggered by AI cyberattacks, so if not that, is it (a) a heightened salience of the background unreliability of systems, (b) AI-driven development making systems more fragile?
1
4
334
It is sort of hard to avoid a conclusion like this even if each case has a sort of legible gears-level explanation.
Absolutely. If AIs were on the verge of takeover you'd expect a power-law distribution of smaller loss of control incidents in the lead up. Taking over a company's infrastructure, for example. 🤔
3
243
Civilization VI inter-era combat but for ~saving the world.
If the EAs manage to get a bunch of extremely intelligent, data-facile 30-somethings to become line Hill staff, they’ll utterly rule the entire Congress within three years. It’ll be like those historical fiction books asking “what if the Roman Empire had tanks?” Just domination.
3
285
If you're in AI policy in DC, or if you know about AI policy and you can move to DC, you should strongly consider trying to work as a congressional staffer. Senior people should consider doing this as well as junior people, if it's the right role in the right office. Many, many offices are staffing up and looking to hire AI people. We all have a duty to lock in and get serious and solve the problems we need to solve. If you do this and work hard and accept the sadly inadequate pay, you will be an American hero who is on the front lines of society's response to the most important challenge humanity has ever overcome. It is hard for me to put into words how much better of a thing that is to do than going to work for a lab, and it's also a lot better than the kind of cushy think tank gig that I currently have. Working for a state government in an important role implementing and enforcing the AI regulations that we actually have or will have is equally important.
25
76
11
675
50,968