Diagonalized (@diagonalized_) header
Diagonalized (@diagonalized_) profile picture

Not all those who wonder are lost | Reluctant member of technical staff

Joined September 2023
Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)Photo by Diagonalized (@diagonalized_)
Diagonalized retweeted
Am I wrong in thinking that the massive discrepancy here reveals that some huge amount of frontier model capability right now must be from high-effort, bespoke data collection rather than "runaway generalization"?
Claude was trained on protein sequences, at scale. We gave 20 language models the start of little-studied bacterial proteins and asked for the next amino acids. Only the latest Claude models predict them. Not GPT, not Gemini, not seven open-weight models.
40
33
7
871
42,623
Diagonalized retweeted
It would be pretty awesome if my stocks would QUIT GOING DOWN EVERY FUCKING DAY
113
63
6
2,304
82,934
Diagonalized retweeted
BREAKING: everything
35
104
6
1,213
16,333
Diagonalized retweeted
Make $NVDA miss earnings. <Ramp posts crying Northwestern kid gif> Tank it 10% in after hours. Let everyone capitulate. Ramp it 20% at the open for no reason. Good. Circulate a Jensen comeback rumor and new mistress. Now shut down the internet so GTA VI gets delayed.
25
31
602
38,196
Diagonalized retweeted
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me. I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA. I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation. Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO. Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours. Jensen
57,984
118,470
24,019
1,128,961
52,589,113
Diagonalized retweeted
*SITUATIONAL AWARENESS 13F VALUE PLUNGES 92% TO $1.58B IN Q3 FROM $20.2B IN Q2
142
100
235
1,972
684,129
Diagonalized retweeted
Will rapid AI capability improvements translate into runaway economic growth? Economists Alex Imas and Tyler Cowen are skeptical. In this conversation with a16z's Erik Torenberg, they cover: - Why smarter models can't automatically overcome economic bottlenecks - Why slow-moving institutions can limit AI's impact on the economy - How competition between AI labs is making powerful models cheaper to use - Why AI's benefits to consumers could be much larger than GDP captures - Why scientific advances and longer lifespans could be among AI's biggest benefits 00:00 Intro 00:58 Is AI progress speeding up? 04:44 Why Tyler is a sober voice 10:49 Could AI deliver double-digit economic growth? 19:02 Is GDP the right way to measure AI's impact? 23:51 What the Hugging Face hack teaches us 29:53 Why agents struggle to coordinate 33:45 What AI means for jobs and wages 39:29 Elections, data centers and AI politics 43:23 How Alex and Tyler got here 50:00 Rapid fire: AI predictions and higher ed YouTube: youtu.be/g_67TmQ8lGY @alexolegimas @tylercowen @eriktorenberg
14
34
13
223
255,812
Diagonalized retweeted
Anyone that uses AI less than me is a Luddite. Anyone that uses it more than me has psychosis
78
399
35
5,445
107,452
Basically all of society was created because people came together and made decisions that sucked in the short term but paid off long term. Building roads, raising kids, saving money, etc etc Short-form video and other avenues of attention-rape increasingly appear to be making everyone incapable of deferring payoff in the way required to do this. We have destroyed the idea of "long-term planning" entirely. Nobody can remember what happened last month. "Short-form video ban" increasingly seems like necessary national policy
71
166
18
2,261
64,178
Diagonalized retweeted
Average AI doomer prediction: "I think there's a 50% chance we achieve artificial superintelligence in the next 1-400 years, conditional on the assumptions of my model continuing to hold."
5
1
1
61
2,139
Becoming a high-frequency hedge fund quant just to understand stochastic integration.
14
5
9
154
31,050
Diagonalized retweeted
Jensen is just saying what everyone’s thought about their coworkers at some point
BREAKING: Former Nvidia CEO Jensen Huang reportedly told a senior executive "I hope you die and put us all out of our misery” in a meeting.
19
66
1
2,336
105,164
Diagonalized retweeted
Will the future that you want
Choose your path Western man.
2,482
7,784
404
97,651
4,558,121
Diagonalized retweeted
Replying to @ChrSzegedy
You're too smart for this, you know better. Obviously a differentiable curve fitted via SGD can only interpolate. That's true by construction. But if you use this curve as a sampling guide in a search process, then you're doing search, you're no longer interpolating at all. Theorem proving is search. Reasoning chain generation is search. Etc.
17
24
6
543
44,916
i think what’s gonna happen is you will just double or triple the meetings without accomplishing much just because now there’s a better trail of “the work done” even though most meetings serve no purpose this is the wet dream for a middle manager
Introducing Claude Meetings: add Claude to your team’s video call and it builds docs, whiteboards, and other artifacts with you while you’re still talking. Starting to roll out in beta on Team and Enterprise plans.
17
8
296
7,608
Diagonalized retweeted
Replying to @dwarkesh_sp
How much of the GPT-3 to 6 improvements are due to better (general) learning algorithms vs. domain-specific data and RL environments? I'm sure it's part of it, but it's not immediately clear that it's the majority, given the magnitude of investment in the latter.
6
5
1
116
10,270
Diagonalized retweeted
imagine
🤖 Made with AI
287
184
139
6,937
2,298,353
Kurt Gödel and Plato were right. "The objects and theorems of mathematics are as objective and independent of our free choice and our creative acts as is the physical world." - Gödel, 1951, Gibbs lecture manuscript
Based Platonic Kurt Gödel doubts empirical science
21
96
13
722
25,037
Reminder:
Replying to @memeticsisyphus
truly socialists don't understand that wages are a cost and don't know the difference between revenue and profit. very basic things. not to mention how to economy is consent based which they ignore with the counterargument that if you don't work nature isn't free
29
528
12
13,279
246,614
Diagonalized retweeted
if you're feeling a little uneasy about the grounding of all US planes remember to spend as much time on your phone as possible. the more information you ingest as you scroll the calmer you will become
176
2,130
93
42,703
847,347