Kuntai Du (@this_will_echo) profile picture

Chief Scientist | Committer of vLLM / LMCache / Production Stack

Joined January 2022
Github is not acting normal... Our LMCache logo suddenly disappeared today, we didn't make any change. And we cannot even clone the repo using ssh. Github bad bad.
210
Happy to meet with @EmbeddedLLM people in person! Thanks for all the hardware supports in @vllm_project and @lmcache !
1
2
10
662
vLLM team @vllm_project , reunited at Ray Summit! (Lowkey: can't wait to meet our magic @KaichaoYou and @darklight1337 in person!) Can't wait to meet our magic @KaichaoYou and @darklight1337 in person!
1
1
15
1,249
Ray summit 2025 takeaways: 1. Ray is now in PyTorch Foundation 2. Ray supports RDMA (finally) 3. Anyscale runtime, basically Ray + better perf and fault tolerance/observability etc. 4. Anyscale is building multi-resource cloud, and collaborating with Azure. #raysummit2025 #vllm
1
164
💰Want CHEAP GPU cloud? 💡Wanna store ALL your users’ history&docs as KV cache to save cost—but can’t get open source to run? Try TensorMesh SaaS: ⚡️$3.09/hr H100 😄No vendor lock-in 🧠Any open-source model 🪄OpenAI-API compatible Join the waitlist🚀: tensormesh.ai/beta-waitlist
3
3
210
LMCache in Redis Release event! Plus random creation by Kobe from @lmcache
1
2
159
20% or more acceptance rate for OSDI means --- 15% more papers being accepted 😍 Guys we should 100% submit to OSDI this year.
1
2
145
🤯 Believe it or not, even when an LLM generates just ONE SINGLE word, it can still be powerful! Say in recommendation: all it takes is to answer “Should we recommend post X to user Y?” with Yes or No. That’s it!💪 Our paper optimizes this workload in vLLM and got into SoSP🚀
2
7
21
1,085
We are here at open-source summit!!
1
39