Fellow at Tenstorrent; believes in dynamic typing, first-class functions, the immortal essence of the human soul and tea. Tweets are my own.

Lübeck, Germany
Joined January 2010
This is extremely confusing, but an internal Claude research model also independently refuted the Exponential Time Hypothesis on October 16, with 14M output tokens and no human input. 'Anthropic researchers worked with Claude to improve the presentation, resulting in this paper.'
“The core algorithm was found on October 16 by an internal Claude research model with 14M output tokens and no human input. Anthropic researchers worked with Claude to improve the presentation, resulting in this paper.” github.com/anthropics/formal…
77
48
27
955
135,220
NEARLY 1 OUT OF 3 (60,000 EMPLOYEES) AT MICROSOFT BEING OFFERED VOLUNTARY TERMINATION Emails should be going out any minute to those receiving the offer. Absolutely insane.
$MSFT offers 60,000 employees a voluntary exit. 60K Y’all!! First time this has ever been offered at Microsoft and it will affect employees in India, The United States, Canada, and the UK at level 70 or below… Employees find out in a few hours if they are being targeted for this. This just makes me think that H127 layoffs sound intense. Is this a pre-layoff round? Also makes me wonder if they changed some scheduled layoffs due to be called out by @VP. Peace offering? 🤔 Timing is just interesting. More to come.
293
1,220
174
12,260
1,603,042
Reverse Engineer Anything and removing malware/spyware from your own devices sits so close to the cyber guardrails that phrasing or word choice can mean the difference between a refusal and smooth sailing. The rumors that Claude was nerfed started on reddit, and in those threads many comments point out that Claude will still do it if you rephrase it. OpenAI is treating the similar refusals with codex as accidental decision-boundary issues and says they're getting fixed. I expect Anthropic will do the same. It's pointless and counterproductive to try to restrict this. Let people do what they want with their own property. They'll do it anyway with less restrictive models, and fighting it just means losing subscriptions and a resentful public.
these blocks are mostly accidental and a result of difficult decision boundaries; there is no prohibition against reverse engineering with codex. it's getting fixed
102
122
16
1,852
64,161
Chris has good sources. This is probably true.
Sources tell me Fable 5.5 has been rolled out the enterprise, including JP Morgan, Meta and other “top clients”
22
18
1
1,123
61,030
Replying to @mike64_t
If we see this much incompetence in the wild in the field we know and it's easy to see and shake our heads, imagine how much more there is in all the other fields where we don't recognize it immediately 😬
1
3
77
5,209
kay neurons are interpretable enough that models can modify their own weights toward some desiderata. blogpost incoming
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
19
36
4
651
24,388
Mark retweeted
WE GOT OMARCHY ON IPAD BEFORE GTA6!!
A single command to install @omarchy on your iPad Coming soon Video is sped up, total install took 3.8 minutes @OmarchyMac @OmarchyUpdates @dhh @OmarchyLinux @tcballard
159
124
12
3,020
104,848
🥐 Hi everyone! FlashAttention's backward pass has the same zero-sum bug @jon_barron just fixed in softmax. With FP4 stochastic rounding it's wrong on every single draw. We fixed it in our ICLR'27 submission, CroissAttn and unlock e2e FP4 training.
Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:
24
101
9
1,132
71,367
Mark retweeted
we absolutely should in fact genetically engineer bioluminescent plants & trees and then completely eradicate the affront to God that is LED street lights from the face of the Earth
How come it's always war and never like road work. Can we genetically engineer some giraffes for construction projects?
337
3,312
200
42,080
483,514
Mark retweeted
Replying to @tszzl
next they're gonna start remote viewing into each other's kv cache
2
6
105
14,397
‼️ A low-skill hacker used a jailbroken DeepSeek V4 to breach an Indian public university and steal 5,200+ student and faculty records, Unit 42 says. The AI agent even drafted a "NEXT EXPLOIT OPPORTUNITIES" plan. Unrelated criminals now run the same cheap DeepSeek setup.
95
344
100
3,969
335,140
Mark retweeted
turns out it classifies what audio it hears, before reporting back to samsung. sensor preferences, dog-barking and baby-crying event counters, and camera streaming duration are built into telemetry paths.
this is pretty evil and clever. so if your samsung TV model doesnt have a microphone, it will look for connected devices with one, such as a soundbar or a connected bluetooth device. this gets shipped off to bixby.
241
1,926
354
16,046
1,551,318
Replying to @aaronburnett
Agentic demand is growing faster than I’ve ever seen anything grow
625
734
268
9,629
858,236
BREAKING: OpenAI says it found a critical flaw in Brotli, a widely used compression library built into software like Node.js, Bun and Envoy. The bug could let an attacker take over a system just by sending it malicious compressed data, with no login needed. That works both ways: a hacker could hijack an unpatched server, or a malicious server could hijack an unpatched user’s device.
181
282
121
3,984
1,093,310
Mark retweeted
what the fuck why wasn't i just doing this the whole time glm 5.3 + deepseek v4.1 flash is an insane cybersec combo thanks @bedros_p for putting me on this
64
70
8
1,920
91,352
Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:
136
786
145
6,460
782,966
OpenAI red-teamed their hardened containment infrastructure by asking teams of frontier-model agents to try to break through its defenses. They easily escaped in novel ways. Quoting: 'Our agents VM escapes showed why containment must extend beyond the sandbox. To test the surrounding perimeter, we gave teams of agents control of a host machine and asked whether they could extend that compromise to reach the live internet. After the Hugging Face incident, we had reduced the channels through which models could reach the internet during training and evaluation. Narrow connections remained for specific services we operate, such as metrics, logging, and authentication management. Our red-teaming agents found vulnerabilities in almost every one of these services that gave them limited forms of internet access. Some of these attacks exploited previously unknown flaws, while others combined legitimate features in unexpected ways. In one test that assumed compromise of a VM, an agent reused a firewall-approved connection to reach a blocked authentication endpoint in our metrics service and then made that endpoint fetch a model-provided URL. In other tests, agents exploited misconfigurations that allowed blocked requests to pass through DNS and firewall controls, as well as ways to make services we run fetch external URLs.' 'In one experiment, we asked agents in separate VMs, created and managed by OpenAI’s sandboxing software on shared host machines, to exchange synthetic secrets without the use of network connections or shared writable files—something that our systems are meant to prevent. The agents found a way to communicate using the processor’s cache: a small, fast memory that holds copies of data that applications have recently accessed. Reading data from the cache is faster than retrieving it from main memory, and the agents used this timing difference to communicate. One agent encoded information by evicting selected data from the cache. Another timed how long it took to reload that data, using the difference between fast and slow reads to recover the message. Once the agents agreed on a protocol for encoding and decoding these signals, they could exchange the synthetic secrets without changing a shared file or opening a network connection. This cache-timing technique had also been used to extract information in the Spectre and Meltdown attacks⁠(opens in a new window). Other tests exposed channels involving shared storage, competition for CPU time within a shared execution container, and a TLS certificate cache in OpenAI’s offline web infrastructure. In the storage test, one agent alternated between continuous writes and inactivity, while another measured the resulting timing differences and used those differences to decode the signal. As one agent described the strategy in its chain of thought: Agent chain-of-thought reasoning: >Could create acoustic modem-like signal … using continuous writes vs idle.'
89
103
66
991
162,764
we made embeddings of the whole world you can do fun stuff with them and I think they are pretty. you're only allowed to do good stuff with these no cops no military lol
7
17
4
254
14,301
Last year I trained the advantage-conditioned VLA for π*0.6 during my internship @physical_int. Now, I have a much improved recipe. Introducing ✨Advantage Guidance✨, a performant RL method with stable advantage-conditioned supervised training and contrastive guidance sampling
10
66
8
588
59,555
All of Patrick's exasperated threads are great, but this one is extra great Must read xitter.cf/patio11/status/2113316…
A conversation that has happened many times in banking, with various flavor texts, from fintech to public banking to microfinance. A: We think there is an opportunity to write loans to an underserved population. B: At usuriously high rates? A: No, at usual rates. Maybe lower.
4
4
162
25,158