single-gpu optimization: explain like i'm five

Is your daddy approving the UK visa criteria? Because if I explain them, all I need is £300 to survive in London.

optimize one gpu: explain like i'm five

🚢⛴️🛳️⚓️

Looking for someone with expertise in Substack growth strategies and publication setup. If you’ve helped grow a Substack publication, or know someone who has, let’s connect!

I think AGI may be written in Python, but it will run on Rust.

Pls learn system & db design

pagedattention: explain like i'm five

continuous batching: explain like i'm five

moving to vllm: explain like i'm five

serving engines: explain like i'm five

break one gpu: explain like i'm five

ttft vs itl: explain like i'm five

measuring inference: explain like i'm five

kv cache: explain like i'm five

one token: explain like i'm five

how inference works: explain like i'm five

running your first llm: explain like i'm five

My brain is exploding. There’s so much I could create if only an agent could capture my thoughts, explore every possibility, and simulate the outcomes. Imagine turning the chaos of the mind into an infinite playground of possibilities.

inference memory and speed math: explain like i'm five