Decoupling to Scale: how Grab moved to Aerospike with zero downtime — plus Meta's 28% latency cut and LinkedIn's 75x GPU speedup.
#SoftwareEngineering #SystemDesign #Aerospike #Rust
the infrastructure decisions you made at moderate scale become active liabilities at production scale.
Scale Finds Every Shortcut You Took open.substack.com/pub/thepra…
thepracticalstack461.substac…
Agentic AI Is Breaking System Boundaries — And Your Org Chart Is Next
Behind the Outages: Redis, CPU Starvation, and Kafka at Petabyte Scale open.substack.com/pub/thepra…
Agent Systems Are Crossing Lines — Your Stack Isn’t Ready
open.substack.com/pub/thepra…
Rate limiting is not about blocking bad actors.
It's about protecting good ones from each other. Most teams pick one without knowing why.
#RateLimiting #APIDesign #SystemDesign
thepracticalstack461.substac…
Most engineers use LLMs daily but can't explain what happens between prompt and response.
Here's the full pipeline — 8 concepts, one image. Save this.
🔁 Tokenization → Embeddings → Attention → Transformer → KV Cache → Sampling → Context Window → Inference Optimisation
Most engineers pick a caching strategy based on
what they've used before — not what the system
actually needs.
8 strategies. Different tradeoffs. Cache-aside ≠ always the answer.
🧵Which one do you default to ?
#DistributedSystems #SystemDesign
🤖 Made with AI
Grab lost 40% of eng time to repetitive queries.
They didn't build a bigger model. They decomposed it like microservices.
Schema drift hits one agent. Not the whole system.
Boundaries matter more than models.
The Practical Stack 👇
thepracticalstack461.substac…
#DistributedSystems
Tier-1 bank: sub-5ms p99 at 1.6M msg/sec with strict ordering intact.
The unlock wasn't just tuning.
Multi-DC replica placement done right — skip this and tail latency spikes under load.
The Practical Stack 👇 thepracticalstack461.substac…







![Hello world" enters an LLM as [9906, 1917]. By the time output appears, it's been through tokenization, embeddings, 96 transformer layers, KV cache, and a probability sampler. Most people call this "AI." Engineers should know what's actually happening.](https://pbs.twimg.com/media/HFzIceYbAAEnx0N.jpg?name=small&format=webp)


