サメQCU retweeted
i finally set up a proper home on the web for my fiction! you can read it all at nostalgebraist.net
サメQCU retweeted
It's a much bigger jump than previously thought after some more tweaks. 21% increase without spec decode, 32% with spec.
These numbers are averages after running 10 requests (sequentially) in 3 separate servers to minimize any variance.
New all-reduce kernels that optimize for small-message latency across PCIe-connected GPUs. 12% end-to-end decode speedup for DeepSeek-V4.1 Flash on 4x RTX 6000 Pro Server GPUs.
github.com/dphnAI/sonar/pull…
Replying to @jd_pressman
these things are commodities and they look like pretty great commodities from my perspective. imagine how much lower value it would be if you had to have a special harness just for openai or just for google to let their models write code or do clerical work...





