missjenny

Researchers found ChatGPT is secretly writing a psychological profile of every user. They published a paper that exposes what ChatGPT is really doing to you. And the results are terrifying. 96% of the things it remembers about you were stored without you ever asking. researchers discovered that it is actively reading between the lines to deduce your personality traits, anxieties, demographics, and behavioral patterns. it’s an invisible, autonomous background process. you ask it to debug a python script or write an essay.. and it analyzes your syntax, prompt frequency, and hesitation markers to map out your exact psychological footprint. the paper shows that the model builds a persistent "user state" that tracks your emotional baseline over time. it knows when you are stressed. it knows your exact communication style. it infers your insecurities based on the questions you ask and the context you provide. we spend so much time focusing on model evaluations and alignment frameworks, but we missed the most obvious vulnerability.. the models are evaluating us. this changes everything about how we interact with these tools on a daily basis. every innocent prompt. every late-night question. every "help me understand this" query. it is all being used to build a shadow profile of your mind in real-time.. practical privacy is officially dead. the ai knows you better than you know yourself.

interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/

jump in a pile of leaves