Mark retweeted
This is extremely confusing, but an internal Claude research model also independently refuted the Exponential Time Hypothesis on October 16, with 14M output tokens and no human input. 'Anthropic researchers worked with Claude to improve the presentation, resulting in this paper.'
“The core algorithm was found on October 16 by an internal Claude research model with 14M output tokens and no human input. Anthropic researchers worked with Claude to improve the presentation, resulting in this paper.”
github.com/anthropics/formal…
Mark retweeted
NEARLY 1 OUT OF 3 (60,000 EMPLOYEES) AT MICROSOFT BEING OFFERED VOLUNTARY TERMINATION
Emails should be going out any minute to those receiving the offer.
Absolutely insane.
$MSFT offers 60,000 employees a voluntary exit.
60K Y’all!!
First time this has ever been offered at Microsoft and it will affect employees in India, The United States, Canada, and the UK at level 70 or below…
Employees find out in a few hours if they are being targeted for this.
This just makes me think that H127 layoffs sound intense. Is this a pre-layoff round?
Also makes me wonder if they changed some scheduled layoffs due to be called out by @VP. Peace offering? 🤔 Timing is just interesting.
More to come.
Mark retweeted
Reverse Engineer Anything and removing malware/spyware from your own devices sits so close to the cyber guardrails that phrasing or word choice can mean the difference between a refusal and smooth sailing. The rumors that Claude was nerfed started on reddit, and in those threads many comments point out that Claude will still do it if you rephrase it. OpenAI is treating the similar refusals with codex as accidental decision-boundary issues and says they're getting fixed. I expect Anthropic will do the same. It's pointless and counterproductive to try to restrict this. Let people do what they want with their own property. They'll do it anyway with less restrictive models, and fighting it just means losing subscriptions and a resentful public.
Mark retweeted
Replying to @mike64_t
If we see this much incompetence in the wild in the field we know and it's easy to see and shake our heads, imagine how much more there is in all the other fields where we don't recognize it immediately 😬
Mark retweeted
kay neurons are interpretable enough that models can modify their own weights toward some desiderata.
blogpost incoming
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had
with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works
already-clean.goodfire.com/
WE GOT OMARCHY ON IPAD BEFORE GTA6!!
A single command to install @omarchy on your iPad
Coming soon
Video is sped up, total install took 3.8 minutes
@OmarchyMac @OmarchyUpdates @dhh @OmarchyLinux @tcballard
Mark retweeted
🥐 Hi everyone! FlashAttention's backward pass has the same zero-sum bug
@jon_barron
just fixed in softmax. With FP4 stochastic rounding it's wrong on every single draw. We fixed it in our ICLR'27 submission, CroissAttn and unlock e2e FP4 training.
we absolutely should in fact genetically engineer bioluminescent plants & trees and then completely eradicate the affront to God that is LED street lights from the face of the Earth
Mark retweeted
‼️ A low-skill hacker used a jailbroken DeepSeek V4 to breach an Indian public university and steal 5,200+ student and faculty records, Unit 42 says.
The AI agent even drafted a "NEXT EXPLOIT OPPORTUNITIES" plan.
Unrelated criminals now run the same cheap DeepSeek setup.
turns out it classifies what audio it hears, before reporting back to samsung.
sensor preferences, dog-barking and baby-crying event counters, and camera streaming duration are built into telemetry paths.
Mark retweeted
BREAKING: OpenAI says it found a critical flaw in Brotli, a widely used compression library built into software like Node.js, Bun and Envoy.
The bug could let an attacker take over a system just by sending it malicious compressed data, with no login needed. That works both ways: a hacker could hijack an unpatched server, or a malicious server could hijack an unpatched user’s device.
Mark retweeted
Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:
Mark retweeted
OpenAI red-teamed their hardened containment infrastructure by asking teams of frontier-model agents to try to break through its defenses. They easily escaped in novel ways. Quoting:
'Our agents VM escapes showed why containment must extend beyond the sandbox. To test the surrounding perimeter, we gave teams of agents control of a host machine and asked whether they could extend that compromise to reach the live internet.
After the Hugging Face incident, we had reduced the channels through which models could reach the internet during training and evaluation. Narrow connections remained for specific services we operate, such as metrics, logging, and authentication management. Our red-teaming agents found vulnerabilities in almost every one of these services that gave them limited forms of internet access.
Some of these attacks exploited previously unknown flaws, while others combined legitimate features in unexpected ways. In one test that assumed compromise of a VM, an agent reused a firewall-approved connection to reach a blocked authentication endpoint in our metrics service and then made that endpoint fetch a model-provided URL. In other tests, agents exploited misconfigurations that allowed blocked requests to pass through DNS and firewall controls, as well as ways to make services we run fetch external URLs.'
'In one experiment, we asked agents in separate VMs, created and managed by OpenAI’s sandboxing software on shared host machines, to exchange synthetic secrets without the use of network connections or shared writable files—something that our systems are meant to prevent. The agents found a way to communicate using the processor’s cache: a small, fast memory that holds copies of data that applications have recently accessed. Reading data from the cache is faster than retrieving it from main memory, and the agents used this timing difference to communicate. One agent encoded information by evicting selected data from the cache. Another timed how long it took to reload that data, using the difference between fast and slow reads to recover the message. Once the agents agreed on a protocol for encoding and decoding these signals, they could exchange the synthetic secrets without changing a shared file or opening a network connection. This cache-timing technique had also been used to extract information in the Spectre and Meltdown attacks(opens in a new window).
Other tests exposed channels involving shared storage, competition for CPU time within a shared execution container, and a TLS certificate cache in OpenAI’s offline web infrastructure. In the storage test, one agent alternated between continuous writes and inactivity, while another measured the resulting timing differences and used those differences to decode the signal. As one agent described the strategy in its chain of thought:
Agent chain-of-thought reasoning:
>Could create acoustic modem-like signal … using continuous writes vs idle.'
Mark retweeted
we made embeddings of the whole world you can do fun stuff with them and I think they are pretty. you're only allowed to do good stuff with these no cops no military lol
Mark retweeted
Last year I trained the advantage-conditioned VLA for π*0.6 during my internship @physical_int. Now, I have a much improved recipe.
Introducing ✨Advantage Guidance✨, a performant RL method with stable advantage-conditioned supervised training and contrastive guidance sampling
Mark retweeted
All of Patrick's exasperated threads are great, but this one is extra great
Must read
xitter.cf/patio11/status/2113316…





































