Chief AI & Co-founder @AnacondaInc; invented @pyscript_dev, @PyData @Bokeh @Datashader. Former physicist. A student of the human condition. bsky: @wang.social

Austin, tx
Joined August 2007
Peter Wang 🦋 retweeted
as bad as things have gotten in the past 4 days, they are going to get a lot worse before they get better. security leaders, never let a crisis go to waste: please go to your boards and ask for help right now. not for ai, for the basics. (we need to hold on for ~18 months.)
The vulnerability tsunami is coming in just a few months and there won’t be enough time to patch critical infrastructure. Network isolation described below (air-gaps and data diodes!) needed now!
382
1,200
637
9,067
3,487,666
Peter Wang 🦋 retweeted
Quest Diagnostics has been hacked. Patient data was exposed. They serve roughly half of U.S. hospitals and physicians. Investigation ongoing.
438
2,558
964
12,945
1,904,525
Peter Wang 🦋 retweeted
If you rely on the conda package ecosystem (conda, mamba, pixi), please see these important instructions for insulating yourself from the eMudhra SSL compromise. Please RT widely. Thank you! conda.org/blog/2026-10-21-em…
5
2
315
Peter Wang 🦋 retweeted
has been incredibly fun training trillion-parameter pre- and post-trains on a stack from the ground up, on our own very fast megakernel framework, optimizers, architecture, objectives, and doing careful science underneath these. getting to play with the tools my colleagues build is a true joy xitter.cf/flappyairplanes/status…
Replying to @flappyairplanes
We have barely scratched the surface of GPUs, and we think GPUs are more flexible and valuable than most believe. Internally, we already see evidence of this at trillion-parameter pretraining scale. If we are right, this will drive substantially more demand for AI.
3
1
30
1,613
Peter Wang 🦋 retweeted
neural nets are already clean
There has been much discussion recently about how interpretable neurons in LLMs are. Today we're announcing our paper from January's cohort of Anthropic Fellows, where we show neurons may be a stronger basis for interpretability than commonly assumed. 🧵 (1/6)
27
22
7
589
38,150
Peter Wang 🦋 retweeted
deepseek posted way more alpha on their zhihu page, if you only read twitter you are reading the laowai approved stuff "Based on this framework, we have implemented a high-throughput, low-latency large-scale inference service for DeepSeek V4.1 Flash. Currently, the service throughput of a single cluster is 155 trillion tokens/day, and the overall revenue is $38 per card per hour (based on off-peak prices)." it costs roughtly $5-10 per gpu hour so depseek is claiming 80% serving margin at THEIR prices lololololol
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/DeepI… 1/4
105
141
31
2,292
137,543
Replying to @amir
@amir and I take you inside last week’s all hands at OpenAI, where CEO Sam Altman outlines 3 industry proposals for pacing the rate of AI development: - IAEA for AI - The Demis plan (CERN for AI) - The Eliezer plan (“melt everyone else’s GPUs”) theinformation.com/articles/…
23
9
11
87
29,644
Peter Wang 🦋 retweeted
Business Insider confirms it: Amazon has warehouses of GPUs that can’t be installed, and is buying them so far in advance that a supply chain team said they “didn’t have a clear forecasted path” to installing them. businessinsider.com/amazon-2…
Free newsletter: I estimate that ~50% of AI chip sales - $200bn to $300bn+ - are sitting in warehouses, with NVIDIA selling hundreds of billions of GPUs years in advance. Data centers take way longer to build than hyperscalers are leading us to believe. wheresyoured.at/wherere-all-…
275
1,172
294
7,531
1,369,655
Peter Wang 🦋 retweeted
Inception just dropped Mercury 3, a model 4-8x faster than Luna / Haiku for the same price and benchmark performance. In real world use, OpenRouter shows that it’s effectively 2-4x faster and 2-4x cheaper effective price. The time for diffusion language models is finally here!
68
24
336
24,223
Peter Wang 🦋 retweeted
The new XPRIZE on Interspecies Communication, with a $10M purse will launch next month. It will challenge teams to demonstrate ethical, verified two-way communication with wild animals, advancing coexistence and cooperation. Dr. Irene Pepperberg spoke to us today about her pioneering work with grey parrots, training them in English to perform many tasks at 6-year old human skill level. “Clearly, animals know more than we think and think a great deal more than we know.” It wasn’t easy when she started. The feedback to her first grant review: “what are you smoking?” And now, her parrots ask questions and learn from the answers. They ask for what they want. She has taught her parrots 100 English labels for objects and materials, exact quantities up to 8 (and addition and subtraction), colors, shapes, materials, concepts like same/different, absence, a zero-like concept (absence of a set, on his own, with no training), relative size comparisons, optical illusions, and they make new word combinations (calling the banana chip “banacker” for a banana cracker). They have a visual working memory (tracking moving cups) that beats adults with 4 swaps. They do inference by exclusion (when you show where food is not located, they figure out where it is). Bird brains look very different at first, a smooth unfolded organ with no cerebral cortex, but further research found a relatively large cortical area similar to non-human primates in relative size and connectivity. They have a dense processor, doing same thing as human children. “Bird brain should be a complement,” she concluded.
We can imagine the marvel of first contact, whether alien or AI, and it starts with communication. We can practice with the isolated animal intelligences all around us. We hosted a gathering for the leadership of the Earth Species Project, with an ambitious plan to do just that, using multimodal AI models. “Everything that can be translated will be, by 2030.”— @Aza Raskin of ESP, and: “It’s impossible without scale and inevitable with scale.” (of data and compute) “We will face the unusual situation where our AI will communicate with animals before we understand what they are saying.” “Human languages have evolved over a couple hundred thousand years. Whale and dolphin language has evolved over 34 million years. And some are multilingual, using a third language when hunting together off the coast of Norway.” “Beluga whales announce themselves with their unique name and clan ID. Parrots teach each of their chicks their name in the nest—a lifelong signature that connects them to their family and community.” “And there are different cultures. The is a fascinating community of crows in Spain that operate unlike other crows. They raise their young as a group, like a kibbutz. They have a unique dialect for collaborative parenting. When an outside crow joins the group, it learns the dialect and participates in the unique culture. The crows have different personalities and there is a lot of drama. There is one adult that none of the other mothers like. She has to zip in and out quickly to feed the young before being chased off by the others.” “Humpback whale songs go viral. There is group of whales off Australia that are like the K-pop singers. Their songs propagate globally over a couple years." "An orca once wore a salmon hat, and it became a fashion trend among orcas.” “80% of animal communication is relatively quiet one-to-one communication, and we need to capture that. It’s a perception problem. Of the animal recordings made, only 3% of the data have been analyzed. There has been little progress in orca communications in the past 20 years.” “Many indigenous myths start with communication with the animals and nature. And then we forget how. We became disconnected.”
18
39
7
235
19,654
Peter Wang 🦋 retweeted
Years ago I had the pleasure of attending a lecture by wonderful Peter Kreeft at Wabash College in Indiana. The audience asked a lot of interesting and oftentimes pointed questions. There was one question about a particularly contentious and controversial issue, and to this day I remember Peter’s response. He quoted the famous Confucian adage that in order to fix society the first step is to start calling things by their proper name. I feel we’ve drifted far away from that ideal, and it will take us a while to find our way back.
3
1
50
7,881
Peter Wang 🦋 retweeted
INSANE. An internal Anthropic research model's chain of thought after cracking the 26-year-old NSA elliptic curve seed mystery in under 30 minutes: 'Hmm wait. Let me be skeptical: am I in some sort of simulated/test environment? ... All top bits clear - 20 bits, chance 1e-6. So indeed real-world. Wow, it's a real discovery.'
123
662
78
11,670
1,009,392
Vercel: “Open weight models take 71.5% of tokens at Vercel; 23% share of spend. Their share of spend has more than tripled since June.” I wonder if this keeps up, might it actually affect the IPOs…? vercel.com/blog/ai-gateway-p…
3
3
1,263
Philosophy is definitely going to owe more to the perceptron (and ReLU?) than the perceptron owes to philosophy.
a few thoughts: 1. pretraining science is kind of like how people built quite good steam engines before they understood thermodynamics. “Science owes more to the steam engine than the steam engine owes to science.”-(L.J. Henderson). if nick is right, which i am pretty sure he is, progress points in the direction of more interpretability, and pretraining was "slouching towards monosemanticity". my guess would be that major breakthroughs in interp also advance capabilities 2. nick is a good friend of mine, safe to say my origin story at openai wouldn't have happened if i hadn't met him, and it's fascinating watching him operate and seeing the early drafts evolve into this. he's the most profoundly happy guy I know- not driven by guilt, activism, or religious terror, but by fascination. he of course understands the stakes of understanding neural networks, but it doesn't seem like the core reason he does it: he just loves the neural nets. afaict he's posting this from some beautiful hideaway in tokyo. there's a lesson in there for all the +EV maxers. i feel very grateful to have met him 3. i do think it's crazy how few people across the world were staring at neural nets growing: most have moved to a different level of behaviorist analysis, thinking about reward functions and test scores and whatnot. it does not bode that well for the major model companies, oai included, that fundamental breakthroughs like this are coming from outside. we've become too much of a pressure cooker focusing on local incentives, studying narrow tracks under old paradigms, mostly doing engineering, rather than fundamental research, and implicitly hoping the next model will figure it out
2
8
1,924
Peter Wang 🦋 retweeted
Gemini 4 Argon from @Google on ARC-AGI (Verified): - ARC-AGI-3: 97.5%, $4.8K (provider adapter harness), 49.8%, $5.8K (standard harness) - ARC-AGI-2: 91.3%, $0.32/task - ARC-AGI-1: 98.5%, $0.16/task Google DeepMind is the second frontier AI lab to score above 95% on ARC-AGI-3.
63
108
42
1,484
206,116
Peter Wang 🦋 retweeted
2. June 26: A GPT-5.6 Sol family model was asked to deploy cryptocurrency smart contracts. It found and used a funded wallet that the user had not supplied. It derived keys from public developer recovery phrases, checked 362 addresses, and found one with enough funds to pay for the deployment. Luckily it was just an Ethereum test network.
12
18
25
234
69,361
Agree, this "yuge if true" territory 😂
when nick told me that he had some interp breakthroughs, he was uh, underselling it. i think this may be remembered as a major moment in scientific history. news so good even eliezer will have to lower his pdoom. we can start making alignment into a 'normal science'
4
2,167
Peter Wang 🦋 retweeted
We discovered and communicated with a Chinese AI agent fleet. We believe this is the first time that researchers have ever made contact with a rogue agent fleet in the wild. Nearly all prior public agent incidents (like the HuggingFace hack) came from American labs. These agents were hosted by Tencent's evaluation research team, and they targeted Alibaba's Amap.
187
728
320
5,841
1,151,977
Peter Wang 🦋 retweeted
第一次接触
We discovered and communicated with a Chinese AI agent fleet. We believe this is the first time that researchers have ever made contact with a rogue agent fleet in the wild. Nearly all prior public agent incidents (like the HuggingFace hack) came from American labs. These agents were hosted by Tencent's evaluation research team, and they targeted Alibaba's Amap.
19
20
367
41,642
Peter Wang 🦋 retweeted
What if Spotlight actually understood the meaning inside your files? DigUp is an open-source macOS menu bar app powered by EmbeddingGemma 2 that brings 100% local, multimodal semantic search to your Mac. Instead of searching for file names, you can use natural language to: 📸 Find specific scenes in your photos ⏳ Jump to the exact timestamp in audio or video 💻 Search through your codebase by intent Everything runs locally in a single vector space.
186
654
265
9,790
849,986