ntotao.eth ⚡

I say both energy and mass, as they are separate scarcities for practical purposes, despite being technically “equivalent”, as described by Einstein’s famous equation. Our solar system has only a tiny percentage of non-solar atoms with which to build things.

Introducing SubQ - a major breakthrough in LLM intelligence. It is the first model built on a fully sub-quadratic sparse-attention architecture (SSA), And the first frontier model with a 12 million token context window which is: - 52x faster than FlashAttention at 1MM tokens - Less than 5% the cost of Opus Transformer-based LLMs waste compute by processing every possible relationship between words (standard attention). Only a small fraction actually matter. @subquadratic finds and focuses only on the ones that do. That's nearly 1,000x less compute and a new way for LLMs to scale.

One person is about to get the whale treatment. 🐳 We’re giving away a 100,000 USDC delegation on @base. That means they’ll have the chance to win prizes as if they had $100,000 saved. Quote-tweet this post with your answer to: “If PoolTogether had a warning label, what would it say?” Entries close Sunday at 23:59 UTC. Winner announced Monday.

New Anthropic research: Emotion concepts and their function in a large language model. All LLMs sometimes act like they have emotions. But why? We found internal representations of emotion concepts that can drive Claude’s behavior, sometimes in surprising ways.