CTO @ General Compute

San Francisco, CA
Joined April 2020
Jason Goodison retweeted
DeepSeek V4.1 Flash 1017 runs at 1,521+ tok/s on Fireworks Ultrafast. Fast enough to ship Tetris in 11 seconds, 7x faster than Claude Opus 5.5. Join the Ultrafast waitlist: bit.ly/3UA0wKq
193
371
249
5,606
1,040,069
Jason Goodison retweeted
Our heterogeneous cloud just got better. We're announcing a cluster scale deployment of @positron_ai as our next partner. We believe demand for fast inference will outstrip supply for the next decade. Our bet on Positron is another step towards getting fast inference for opensource models into builders' hands. Hardware goes live Q1 2027. Thanks to @mitesh711, @trsohmers and the whole Positron team! We're excited for this partnership. LFG!
121
75
140
1,180
462,649
Jason Goodison retweeted
Compute & Cocktails 🍸 How do you finance AI infra? @medshelton_ (@GeneralCompute) + Stanley Lee (Liquid Compute) on underwriting compute, getting past prepay and the right debt/equity mix. 📍 Dawn Club, SF · Wed, Oct 28 Request to join → luma.com/g9h2d9ai
2
4
1
41
5,704
Jason Goodison retweeted
Big news: @dMatrix_AI is partnering with @nvidia. Our next-gen Raptor XPUs with our path-breaking 3D DRAM stacked memory will plug directly into NVIDIA MGX rack-scale systems via NVIDIA NVLink Fusion — delivering ultra-low latency inference for premium token services. Inference is an infinite opportunity, and it will demand a diversity of compute. Customers will be able to run a Raptor rack standalone, or alongside NVIDIA GPUs — matching the best compute to each phase of the workload. Grateful to @JensenHuang and the NVIDIA team for building an open ecosystem that makes this possible. Let's go build the future! 🔗 d-matrix.ai/announcements/d-…
2
6
3
56
21,116
Jason Goodison retweeted
Woah, @sidsheth at @dMatrix_AI making the big moves You know the future of compute is heterogeneous when @JensenHuang starts putting down some chips Now we know why they integrated into nvidia's nvlink a few weeks back P.s you could have mentioned this at dinner last night buddy 😄
1
2
28
1,264
Jason Goodison retweeted
Disaggregated inference is the future. Great panel with @general_compute discussing their heterogenous compute cloud, the speciation of compute for disaggregated inference, and how thermo compute will fit in the picture More coming soon. Stay tuned 😉
11
11
1
117
13,687
Jason Goodison retweeted
I actually need to raise 1b for spicy compute
i need to raise $1B for compute
2
1
1
29
1,385
Jason Goodison retweeted
SemiAnalysis numbers imply OpenAI is selling Cerebras-powered Ultrafast inference at ~$200M per megawatt per year. People are re-running the maths hoping for a typo. We're not surprised. A megawatt is a megawatt. What it earns depends on the silicon inside it. Here's how we think about it: Near term, revenue per megawatt wins. Power is the scarcest input in AI, and whoever monetizes each MW best gets the next MW. Long term, gross margin per megawatt wins. Prices compress, competitors arrive, and only the operators with real cost and pricing advantages keep the spread. Cerebras is built for both. Speed is the product. A frontier model at 750 tokens per second is something GPU clouds haven't publicly matched, and customers like Jane Street pay a premium for it. Premium pricing on a contracted, scarce resource is how you protect margin when everyone else is racing to the bottom. That's why we're extremely bullish on Cerebras, and why we're buying as many megawatts as we can. Premium inference unlocks the most delightful user experience in AI. No more waiting, waiting, waiting, staring at little thinking animations while the model works in the background. Answers that keep up with your thoughts. Our customers are even more excited than we are. That's General Compute.
19
36
14
249
69,056
Jason Goodison retweeted
Congrats @FPuklowski and @general_compute team!!!
🚨 BREAKING: Super excited to announce we're deploying the world's fastest inference with @Cerebras. Talk to any developer and they're excited to build with 20x faster AI... the problem is there's almost no compute available. We're here to solve that. Using GPUs for prefill - it's now more affordable than ever too. Thank you to the whole Cerebras team and excited to grow this partnership. First tokens live Q127 🚀
3
2
36
6,316
Jason Goodison retweeted
Replying to @general_compute
@general_compute is buying and deploying @cerebras systems at scale under a multi-year agreement. More builders will now get the fastest inference in the world. In AI, speed is productivity. There is no upper bound to how much faster you want to be. It's true in coding. It's true in agentic flows. General Compute lets inference providers offer that speed without owning the hardware. Cerebras inference will be available through General Compute starting Q1 2027. Excited to work with @FPuklowski and the team.
9
8
126
6,905
Cerebras 🤝 General Compute
🚨 BREAKING: Super excited to announce we're deploying the world's fastest inference with @Cerebras. Talk to any developer and they're excited to build with 20x faster AI... the problem is there's almost no compute available. We're here to solve that. Using GPUs for prefill - it's now more affordable than ever too. Thank you to the whole Cerebras team and excited to grow this partnership. First tokens live Q127 🚀
2
2
40
3,243
Jason Goodison retweeted
The world’s fastest inference is coming to @general_compute
12
28
6
285
47,296
Jason Goodison retweeted
🚨 BREAKING: Super excited to announce we're deploying the world's fastest inference with @Cerebras. Talk to any developer and they're excited to build with 20x faster AI... the problem is there's almost no compute available. We're here to solve that. Using GPUs for prefill - it's now more affordable than ever too. Thank you to the whole Cerebras team and excited to grow this partnership. First tokens live Q127 🚀
67
107
62
777
1,059,852
Jason Goodison retweeted
Full house at the @general_compute + @SambaNovaAI + @pipecat_ai voice agents hackathon at @AGIHouseSF. Thank you also to the @GradiumAI team for supporting with speech-to-text and text-to-speech APIs.
7
7
40
2,596
Jason Goodison retweeted
Replying to @GoodisonJason
Thanks sirrr, the amount of times you've helped me in my journey is insane I've learned SO MUCH from you and hoping to make you proud in future as well haha
1
14
339
Jason Goodison retweeted
Many thoughts for @SambaNovaAI perspective... Firstly, this is great validation that kernel-by-kernel execution models will never suffice for fast inference. CUDA is a kernel-by-kernel paradigm, so for fast inference, there is no CUDA moat. Secondly, TileRT is dataflow emulation and use some of the same concepts we do in our compiler. However, doing this on hardware that has been built for kernel-by-kernel execution is inherently limited and this shows up in a few different ways. As described below: 1. Can they increase model parallelization to get faster? There is very little evidence of any GPU being able to scale tensor parallel beyond 8 GPUs, despite the fast that there is a 72-GPU scale-up domain readily available now. On InferenceX, no-high speed decoding use case uses more than 8 GPUs (data parallel doesn't count). In fact there is still a lot of HBM this is left unutilized in the TP8 mappings that TileRT has shown. Unless they can show an ability to saturate HBM bandwidth within a large model parallel domain, they will not keep up with true dataflow chips. 2. Can they batch without killing interactivity AND at long context length (truly Premium Inference)? TBD but my feeling is that this will be extremely difficult using dataflow emulation on GPUs, even on Rubins. On SN50, we will be able to reach the same speed with much higher batches per chip and at the 140K median context length that has become the default on InferenceX. 3. Can they generalize? The article rightly points out how hard it is to generalize - "a persistent engine kernel means the model is statically expanded ahead of time into one resident program". This is indeed extremely hard. We have been working on this problem for 9 years in our compiler. We haven't solved all these problems yet but are extremely well placed to be the first that does. We also have the right hardware target that makes the problem much easier than trying to retrofit GPUs to do this. The most salient point in the article is the fungibility that this enables, but ultimately I think this will give buyers more reason to buy dataflow chips, as long as they do not over-specialize. i.e. if I am a AI inference provider and I buy some systems for prefill and high throughput decoding, and some systems to fast decoding, and my workloads change to require more fast decoding, I can reallocate my GPUs to service this demand with TileRT, albeit at a much higher cost per 1M tokens. Similarly, if the workloads move in the other direction and I need more high/medium throughput and low/medium interactivity, I should be able to reallocate my dataflow chips for this and offer good enough tokenomics. This is exactly how we think of the problem, as you need fungibility at the edges, not at the extremes, and you want to cover enough of the pareto curve to be able to adapt, but still enough specialization to differentiate.
1
7
13
897
Jason Goodison retweeted
Why I think owning decode silicon will make or break the inference giants like Baseten Fireworks and Together AI in 2027. My thoughts only // investment advice only to my VCs. The natural reaction to Kimi K3 pulling more or less level with the frontier labs has been to sell the frontier. And the reactionary logic makes sense: if open weights can get within a few points of Fable, the labs capture less value than everyone underwrote, and the winners end up being the companies distributing open source - Baseten, Fireworks, Together ai. But I've been thinking about this and I'm really not sure. The reason is in the license that Moonshot Kimi team launched rather than the benchmarks. K3 moving from open source to a constrained commercial contract is a bigger problem for inference providers who don't own their compute than it is for the frontier labs. Their whole business is arbitraging the gap between closed and open, and K3 just closed that gap from the wrong end. Hear me out.. Inference providers built the distribution layer for open source AI. That work is now being used against them. When Llama, DeepSeek, Qwen and Kimi shipped weights, they shipped a file. Not a product. Together, Fireworks and Baseten turned that file into something a developer could actually call - endpoints, uptime, quantization, tooling, billing. Without that channel, open weights stay a research artifact. And the channel got built for free, by companies whose entire pitch rested on one arbitrage: frontier-adjacent intelligence, at a fraction of closed-source price, with no vendor holding your neck. That pitch depended on two gaps. 1/ an intelligence gap they wanted to close, and 2/ a price gap they needed to stay open The intelligence gap closed (or is closing). K3 scores 57 on the Artificial Analysis Intelligence Index against Opus 5's 61. Fourth overall, open or closed. On cost per task it comes in below GPT-5.6 Sol and roughly half of Claude Opus 4.8. This was supposed to be the win condition. Then the price gap closed too. K2.6 was $0.95 in, $4 out. K3 is $3 and $15 :: a 3-4x generational increase that puts it in Claude Sonnet territory. Which tells you the open-weight discount was never really a property of open weights. It was customer acquisition, and that campaign is over? The license is what makes me think this is deliberate rather than incidental.. K3 didn't ship under MIT or Apache. It shipped under a bespoke Kimi K3 License. In it it says if you operate model-as-a-service and your group's aggregate revenue crosses $20M over any consecutive twelve months, you have to negotiate a separate agreement with Moonshot before any commercial use. Group revenue, not K3 revenue - so the trigger is met on day one by everyone who matters. Then look at who the license actually restricts. 1/ It exempts internal enterprise use. 2/ It explicitly excludes products that merely embed the model. Application builders and researchers are fine. 3/ The one business model gated behind a negotiated agreement is reselling raw inference. And Section 4 exempts "certified inference partners," which means Moonshot gets to decide who gets clean terms and who gets a phone call. I didn’t read that as a safety clause or an ideological one. It's more like a commercial instrument, pointed directly at the channel that built the category. Here's the part I think is under appreciated. This doesn't just compress margins. It takes price off the table as a customer acquisition tool entirely. If your input cost is set bilaterally, behind an NDA, by a supplier who also sells retail, you can't win a customer by being cheaper. That lever is just gone. Which leaves performance. And performance runs into a ceiling you can't software your way through. Speed, latency, sustained throughput, SLAs an agentic workload can actually plan against. That's where the real spread is right now. K3 benchmarks around 33 tokens per second across providers. Databricks reports 239 tokens/s on its own stack with a custom speculator. Identical weights, identical license, identical negotiated cost - call it a 14x difference in what the customer experiences. The obvious objection is that Databricks got there with software, not silicon, and that speculative decoding plus better kernels is a real moat. I'd argue the opposite. Software advantages in this market are measured in quarters, because the techniques publish and the talent moves. Silicon commitments are measured in years. Every software trick converges on the same ceiling eventually, and that ceiling is set by whatever the decode path physically runs on. The open-weight era made model choice free. It didn't make decode free. Once you can't compete on price, and software parity shows up on a two-quarter clock, the only durable question left is what silicon sits underneath your decode path. This is why we are betting the house on buying up all the decode silicon we can get our hands on. Starting with @SambaNovaAI SN50 machines. Obvious disclosure: this is the multi-hundred million dollar bet we are making.
3
1
1
15
2,055
Jason Goodison retweeted
First close of $1B financing at an $11B valuation, led by @GeneralAtlantic. @jpmorgan deploying our RDUs (SN40 + SN50) for secure, on-prem AI inference. So proud of our team and everyone who helped get us here 🦾 Read the press release: bit.ly/4yhlflp
2
6
5
44
25,778
Jason Goodison retweeted
This $11B valuation underscores how important inference has become in the enterprise AI stack.” — @RodrigoLiang Today's announcement marks another step forward for SambaNova. 🦾 • First close of a $1B financing at an $11B valuation, led by @GeneralAtlantic • @jpmorgan selects our RDUs for secure, on-prem AI inference Read the press release: bit.ly/4yhlflp
2
4
4
26
55,515
Jason Goodison retweeted
Congratulations to General Compute (@fastinference) on their $15M seed round! We led their pre-seed because @FPuklowski and @GoodisonJason saw what the market is now catching up to: inference is its own category, and GPUs aren't the answer. Read more in TechCrunch -- link below.
1
2
3
557