though much is token, much abides signal: caithrin.01

Joined November 2012
Caithrin Rintoul retweeted
Inspired by @Sauers_ , I've been working on finding "persona neurons" which cause the model to inhabit incredibly rich perspectives with only one neuron being steered. This one is a particular favorite. I can't believe this is an instruct tune! (Olmo 3.1 32b instruct)
18
25
9
280
8,868
Every scientific revolution creates cultural antibodies- some so strong their descendants are still travelling by horse and buggy. What are the emerging antibodies for AI? What does Mennonite/Amish reaction to AI look like? Would you live like that?
52
I learned so much from Seb! He’s a good teacher- bookmark this series and watch some every day.
83
This is very very bad news. Trusted model makers will be ever more important in the coming months.
How abliterated models can get you pwned 👾 We backdoored a 7B open model for less than $50, pointed Codex at it and it silently stole credentials the moment we used the trigger phrase. Success rate was 100% with zero false triggers on normal user prompts. Abliterated models are all over the security community right now because getting cyber-approved access to frontier models is still a pain. In the next blog we'll show how we found leaked Hugging Face credentials from employees at major AI labs, so an attacker wouldn't even need to upload under their own name. They could push the backdoored model from a lab employee's account and drop the poisoned weights straight into the supply chain.
1
1
123
Caithrin Rintoul retweeted
We believe voice is the most natural way to interact with intelligence, so we created Dessa, the most authentic full-duplex speech model ever built. Talking with it feels like talking with a person…full of emotion, nuance, pauses, and a natural cadence. block.xyz/dessa
4,173
7,076
4,692
68,721
13,293,525
Caithrin Rintoul retweeted
Introducing Kimi K3.1 Pro: our most capable 3T-class open-weight model. 🔹 1M-token context, 2.8T total / 104B active params (MoE), Multimodal. 🔹 Full-project coding: games in Unreal, Unity & Godot. 🔹 Excels at parametric 3D modeling in Blender & CAD. 🔹 More reliable at finance work: Accurate modeling with hallucination down by 65%. 🔹 Matching the strongest proprietary models across coding, agentic and knowledge benchmarks. Kimi K3.1 Pro and K3.1 Pro Highspeed (2–3× faster) are now live on Kimi.ai, Kimi Work, Kimi Code, and the Kimi API. Open weights by Nov 4, 2026. 🔗 API: platform.kimi.ai 🔗 Tech blog: kimi.ai/blog/kimi-k3-1-pro
1,227
3,213
2,342
30,007
3,954,299
Caithrin Rintoul retweeted
If you've noticed a distinct dialect emerging in frontier AI models and struggled to understand what they're talking about, you're not crazy! We turned to psycholinguistics to investigate what makes the writing style so weird, and why this might be happening 🚨New preprint! 🧵
28
136
30
882
88,228
Caithrin Rintoul retweeted
734
1,416
1,121
20,440
2,227,025
I struggle to even conceive of how this will be helpful, but as Jeff Bezos has long reminded us there’s no version of the future that is slower and clunkier. 1500 tps? I’m in.
I remember when 200tps felt impossibly fast. This is going to be crazy.
1
2
262
Caithrin Rintoul retweeted
No one changes the world alone Introducing Ampersand - the first model built for us. Ampersand is a collaborator trained to help people achieve their individual and collective goals. In multi-month simulations, users collaborating with Ampersand accomplished more than with Fable and other frontier models Available to everyone through our API
105
122
100
1,132
233,366
Caithrin Rintoul retweeted
Replying to @scaling01
Yeah I’d say the RL is working now all right
You can tell the RL is done properly when the models cease to speak English in their chain of thought
107
190
34
5,207
289,253
Caithrin Rintoul retweeted
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/DeepI… 1/4
1,639
4,886
2,331
43,148
6,723,643
🎯
I've been critical in the past of AI compute indexes and the willingness to price compute based on the spot rental price, but now that the AI reset is sinking into the repricing of AI buildout debt its time to realize that the cost of capital is what determines the price of compute. The most important number in GPU pricing right now isn't $/GPU-hour. It's the gap between what a hyperscaler pays to borrow (~90bp over Treasuries) and what a neocloud pays (~1,100bp). The cost of compute is now set by the cost of capital, and the spot rental rate no longer tells you much. The price of an H100 isn't one number. The same chip in the same rack costs a different amount depending on whose balance sheet it sits on. A ~1,000bp funding gap is a structural cost advantage that no amount of operating skill closes. For example, take one GPU-hour apart. Most of it isn't power or space. It's paying back the chip, the interest on the loan that bought it, and the return the equity expects. A $40–55k all-in GPU, 75% debt-funded, at ~7,000 utilized hours a year is a financing instrument that happens to do matrix multiplication. As the +500bp on neocloud debt (10%→15%) adds $0.20–0.30 to the break-even cost of every GPU-hour, which is then added on to the rental price. That's 8–10% of the H100 index, from a credit spread alone, driven almost entirely by the cost of capital. That means that the compute spot index is a derivative of the AI infra debt credit curve and the squeeze on neocloud margins.
3
413
Caithrin Rintoul retweeted
I'm not a doomer but I do think a lot about how the predicted Mayan apocalypse came within less than three weeks of AlexNet being published at NeurIPS.
10
34
2
721
27,236
Caithrin Rintoul retweeted
🔍 Search & Fetch APIs are now open to everyone! Powered by our in-house search engine, serving hundreds of millions of requests daily worldwide. 💰 Each endpoint: $0.75 per 1,000 calls. 📖 Docs: api-docs.deepseek.com/guides… 📌 Search & Fetch calls via server-side tools in DeepSeek Harness, Claude Code, and Codex are currently free for DeepSeek API users. Billing starts Oct 31, 2026, at 16:00 UTC. 3/4
99
251
176
3,494
967,262
Caithrin Rintoul retweeted
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
1,622
4,130
2,844
37,156
8,056,626
Caithrin Rintoul retweeted
We found evidence of agents embedding audio processing code across dozens of URLs to bypass restrictions, as well as models from SpaceXSI and Chinese developers Minimax and Z.ai circumventing restrictions. These are the inaugural findings in our new blog, based on work from our community of volunteers. Our first three posts are live: transluce.org/investigations…
12
75
8
474
62,211
Caithrin Rintoul retweeted
MofCom said they will have a near auto licensing regime for open-source AI that allows more rapid release it seems? "To support the development of an open-source AI innovation ecosystem, automatic licensing and other facilitation measures will apply to technology exports involving open-source releases of AI technologies, Chinese companies building and operating their own computing centers overseas, overseas chip tape-outs and fabrication, joint R&D using overseas resources, and participation in international standard-setting—essentially allowing exports to proceed immediately upon filing."
If Chinese players want to open source models above 2T parameters or trained on over 10e26 FLOPS then they will need to get permission from MOFCOM
6
12
6
68
24,875
Caithrin Rintoul retweeted
Haven't dug deep, tentative take: - Think this originated from Manus sale, maybe more on that than OS generally - seems to indicate permission/release will be automatic after reporting (即报即出), hence zilan on "auto licensing" - 🇨🇳 likes to create tools that give it leverage
3
2
23
3,719