Carbon-based Neural Network
Joined March 2021
- Tweets549
- Following990
- Followers37
- Likes64
ubcsecure retweeted
Late-night drives
ALT Late-night scenes from across America Photography by Matt Dunlap (@dunlaper)
ubcsecure retweeted
It’s important that when you wake up in the morning, you do so knowing that the Chinese are building more beautiful structures than you are, and they’re doing it for 1/6th the cost
ubcsecure retweeted
WELCOME TO WASHINGTON, SOCCER FANS. Get acquainted with our state via this highly accurate and mostly-to-scale map.
ALT A hot mess of colorful scribbles all over a map of Washington, featuring doodles of iconic Washington features like mountains, orcas, ferries, cherries, onions, and other produce. The map emphasizes the busyness of the Seattle area, I-5, I-90, US 2, and the U.S./Canada border during the World Cup games.
ubcsecure retweeted
We push Prefill/Decode disaggregation beyond a single cluster: cross-datacenter + heterogeneous hardware, unlocking the potential for significantly lower cost per token.
This was previously blocked by KV cache transfer overhead. The key enabler is our hybrid model (Kimi Linear), which reduces KV cache size and makes cross-DC PD practical.
Validated on a 20x scaled-up Kimi Linear model:
✅ 1.54× throughput
✅ 64% ↓ P90 TTFT
→ Directly translating into lower token cost.
More in Prefill-as-a-Service: arxiv.org/html/2604.15039v1
