
making gpu's that go brrrrr @AgraniLabs
Joined December 2024
- Tweets972
- Following505
- Followers71
- Likes28.2K
from making gpu's go brrr to making gpu's that go brrr
I am joining @AgraniLabs as an Performance Architect Intern
1
4
220
Wow
The only thing faster than GB300 Dynamo + vLLM is Vera Rubin Dynamo + vLLM 🏎️💨.
The first DeepSeek V4.1 Flash results on @NVIDIA Vera Rubin NVL72 are here, powered by Dynamo + vLLM on @SemiAnalysis_'s AgentX benchmark.
Compared with GB300 NVL72 running Dynamo + vLLM, InferenceX's perf ruler shows:
• 63.4× total token throughput per chip at 400 tok/s/user
• 93.3× at 600 tok/s/user
1
108
Replying to @maharshii
You can look into sgl-nvidia-megakerles repo
Its a nice learning materal for PDL, they have got good gains
1
2
182
Replying to @AryaTschand
"and the insights should generalize to any hybrid transformer + MoE model architecture" -- why is that? can't think about it from first principles
22
claude --remote-control is the best thing this world has every produced; i can't switch to codex just because of this feature!
1
2
190
I can't believe the things happening to this world after corona
Still feels like a dream
NVIDIA announces CEO transition. Read the release: nvidianews.nvidia.com/news/n…
31
Replying to @cudagdb
Isn't that just a modern day megakernel
The thing which nvida-sglang-megakernel repo is doing
45
Replying to @TrijalSrivasta3 @cudagdb
Literally me after reading sglang PR which adds megakernel support for some chinese model to improve performance on inferncex
1
41
Replying to @gaunernst
Or you can ask agent to convert your nsys trace to json so you can seet in in perfetto
68
Replying to @AlpinDale
Noo.. they are underrated
These guys are starting to go from host side scheduling to device side scheduling, which is giving way too good results than it should
2
100
















