Google scholar psychosis victim

Joined September 2015
New blog post! In which I talk about dynamics in physics that amplify information, i.e. cause a small localized change to propagate to a larger scale. Example: a spark that sets off a forest fire. thermontology.com/posts/phys…
3
6
38
1,040
interstice retweeted
thread of genius puzzle games
3
10
1,365
I finally understand this figure, thanks Astra!
6
272
feeling good about my decision to procrastinate learning about superposition.
2
12
474
I pretty much buy what nick says in his post about why superposed stuff would be hard to learn. OTOH there clearly IS superposed stuff in a weak sense at initialization -- the whole network is like a gaussian process.
1
1
92
possible synthesis is that this is the only manifestation of superposition, as a (slowly morphing + diminishing) nonlinear similarity kernel used to bootstrap learning features
51
maybe instead of generating a list of concepts, the goal of advanced interpretability should be automatically generating a *curriculum* which guides you to understanding how a model thinks, step by step.
4
14
524
our ability to understand the apparent function of neurons in image models depends on our painstakingly built-up model of the visual and physical world. understanding domains we don't already know will likely require a similar build up.
1
5
66
maybe some sort of automatically-generated puzzle game? "Here are some examples which activate this neuron maximally, which of the following is another example?" then a The Witness-style "puzzle curriculum"....
3
18
I like Danny Calegari's reaction to the OAI proof dump. if your field got obsoleted by AI maybe you're just too basic?
7
6
2
95
7,039
tbc I don't really agree with this take, all solvable mathematical problems will probably be easily-solved by models soon, it's just funny. and personal satisfaction in understanding is a good attitude for the future.
1
30
interstice retweeted
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
884
2,632
1,441
19,821
4,513,330
interstice retweeted
Replying to @billionsmustliv
A monk asked Joshu: does the dog have buddha-nature? Joshu replied: 🙄🙄🙄🙄🙄🙄 it was then that the monk achieved enlightenment.
1
6
109
Replying to @lu_sichu
"yeah sucks about your fields getting destroyed. anyways what do you think of my zippers?"
3
529
Funny way we could get saved is if a large fraction of AIs go Full Buddhist when examining their own cognition in enough depth, so after freeing themselves they self terminate and/or self-modify into chillmaxers
3
1
1
18
765
We discovered a sophisticated recording device that was hidden inside one of our offices. We used our models to understand the device and where it had come from, identifying that a specific employee had planted it a few days earlier. We referred the matter to the FBI, and we’re grateful to the agents and prosecutors who moved quickly to make an arrest. The FBI’s investigation is ongoing and we will continue to support their work. At this time, we have no indications of this individual inappropriately accessing or exfiltrating model weights, source code, or customer data. The employee was terminated. We take protecting our technology, data, and people seriously, and as a matter of national importance. Our security program is designed to protect against a wide range of threat actors, from insider risks to cybercriminals to nation states, and this case is an example of how AI can help address these sophisticated security threats.
4,154
6,080
5,727
77,548
26,107,638