David Levy (@dslevy) header
David Levy (@dslevy) profile picture

AI infra + capital markets. GPUs → tokens → $$$. Ex-Amazon / Stripe / Analyst. I call things early (and loudly).

Boston / NYC
Joined April 2008
Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)Photo by David Levy (@dslevy)
NEW: It's getting harder and harder for AI firms to access Nvidia GPUs. - Startups say some sales reps won’t pick up unless you commit to a 3-year deal - General Catalyst is considering managing a shared pool of GPUs for its portfolio companies - Contract renewals are seeing 30%+ price hikes w/ @aaronpholmes and @steph_palazzolo theinformation.com/articles/…
7
18
7
109
50,840
Makora has added Google TPUs to the list of hardware we can automatically optimize. Google joins NVIDIA, AMD, Qualcomm, and Tenstorrent. More to come!
Makora now supports @Google TPUs. For Qwen3-4B we got the following results on 1x TPU v6e: Throughput: 3570 --> 4613 tok/s (+29%) TTFT: 6592 --> 4727 ms (-39%) Engine: vLLM-TPU 0.13.3
1
9
770
We get up to 60% improvement on Llama-405B on 8xMI300X compared to standard "vllm serve". We do this by auto-tuning hyperparameters and env variables. Semianalysis called out how there are too many configs to know whats best - so consider that one solved ;)
7
4
2
43
3,920
mako tune model
3
1
14
5,388
Choice is a prerequisite for liberty. Welcome to ChoiceDAO. We are raising $1M in 26 days to fight the obstruction of freedom. 100% of funds will go to organizations on the frontlines, & will be deployed transparently on the blockchain. Join our voice for choice.
130
345
104
2,676
David Levy retweeted
'web3 is a solution looking for a problem' A high-level thread on problems web3 can address 🧵👇
55
464
59
1,792
David Levy retweeted
WHY THE FUCK IS THERE A CRYPTO/WEB3 GYM IN WILLIAMSBURG
82
20
13
857
David Levy retweeted
7 steps to transition to web3, for non-technical folks. It can be daunting to make a career shift to web3, especially for those who don’t code. There are new roles that don’t exist in other industries, and recruiting seems informal and network-based. A mini-guide 🧵
171
1,379
260
5,677
Dr. King and those who marched with him proved that people who love their country can change it. As Americans, we all owe them a great deal.
1,881
47,800
916
152,991
Amazon's Alexa ecosystem is exploding, for better and worse | Engadget engt.co/2jdnZNX #AmazonEcho #IoT #SmartHome
Betaworks' Voicecamp is looking to give voice-powered startups $125K each tcrn.ch/2j4skQR by @jordanrcrook
9
5
15
Betaworks' Voicecamp is looking to give voice-powered startups $125K each tcrn.ch/2j4skQR by @jordanrcrook
1
3
5
David Levy retweeted
This is the Director of the Office of Government Ethics explain why Trump MUST sell his businesses. Every American should read this quote.
228
7,060
360
9,159
Trump said yesterday no one cares about his tax returns. @RonWyden & I have a bill requiring their release. Retweet this if you agree w us.
1,376
64,314
2,207
37,044
David Levy retweeted
BREAKING: Obama awards Joe Biden with the Presidential Medal of Freedom cnn.com snpy.tv/2iMqbIO
423
13,959
5,340
29,028
What's going on with Amazon Rekognition, Lex, & Polly at the new #AWSLoft in SF? Find out: amzn.to/2jAjcGK
The SF #AWSLoft is Popping Back Up! @jayrooke will be here to help you find your Entrepreneurial DNA! Join us: https://teapawt.net/t.co/G6nIQSBIXp
1
20
13
David Levy retweeted
At his press conference, Trump filled the room with paid staffers who clapped and cheered as he blasted the media politi.co/2jkBubF
731
5,024
1,561
4,327