“The worth of knowledge lies in giving it away.” #quoteoftheday

If you found this exciting and like to break your own world record, reach out to me, we're hiring!

One more time, @apachekafka work is amazing. Thank you all #kafka team!

How much would have this cost in the cloud? Translated into AWS server types, it’s pretty much im4gn.8xlarge instances per pods. The test ran for 30 minutes. In us-east-1 region (N. Virginia), the test would have cost $110. I.e. a similar infrastructure cost 5K per day 😱

Short technical summary: The #kafka cluster is running on #kubernetes (1.30 with #cilium CNI), 76 brokers (pods) with 40GB RAM, 16 cores and 6TB nvme disk each, 512 partitions per topics. A single broker can seamlessly handle 40Gb/s. The current bottleneck is the disk I/O.

Thrilled to announce that we've achieved a staggering 3 Tb/s outbound bandwidth from our #kafka cluster on our on-premise infrastructure! 🚀This is a monumental leap in data streaming performance. Kudo to the @apachekafka team, the technology is simply amazing! Onward and upward!