Tzu-Li (Gordon) Tai (@tzulitai) profile picture

Staff Software Engineer @ConfluentInc, Committer and PMC Member @ApacheFlink. Previously @VervericaData. Open-source + distributed data systems.

Vancouver, British Columbia
Joined April 2013
Photo by Tzu-Li (Gordon) Tai (@tzulitai)Photo by Tzu-Li (Gordon) Tai (@tzulitai)Photo by Tzu-Li (Gordon) Tai (@tzulitai)Photo by Tzu-Li (Gordon) Tai (@tzulitai)Photo by Tzu-Li (Gordon) Tai (@tzulitai)Photo by Tzu-Li (Gordon) Tai (@tzulitai)Photo by Tzu-Li (Gordon) Tai (@tzulitai)Photo by Tzu-Li (Gordon) Tai (@tzulitai)Photo by Tzu-Li (Gordon) Tai (@tzulitai)
Tzu-Li (Gordon) Tai retweeted
Please welcome Justine Olshan as our newest PMC member! Congrats! We are glad to have you!
1
6
2
40
8,397
This solves 1 out of the 3 problems mentioned by @sharon_rxie @rmetzger_ in their talk also at #Current23: teapawt.net/rmetzger_/status/17076… Always great to see some cross-reference interplay between conference talks, and that real problems are being fixed for the community :-)
Here are the slides of @sharon_rxie and my talk at #Current23 "3 Flink Mistakes We Made So You Won’t Have To" speakerdeck.com/rmetzger/3-f… It's about the timeout configs for Kafka exactly-once with Flink, memory and checkpoint-tuning.
1
4
258
Tzu-Li (Gordon) Tai retweeted
Kora: A Cloud-Native Event Streaming Platform For Kafka paper won Best Industry Paper at the VLDB conference. There's so much work going on behind the scenes on the Kora engine that I think we'll need another paper this time next year 😀 vldb.org/pvldb/vol16/p3822-p…
1
10
70
5,595
Tzu-Li (Gordon) Tai retweeted
Congrats to the team for winning the VLDB best industry paper for the work on Kora, the cloud-native engine behind Confluent Cloud's Kafka offering vldb.org/pvldb/vol16/p3822-p…
1
18
1
108
14,069
Tzu-Li (Gordon) Tai retweeted
📢 We are excited to share a first look at our new project: Restate (@restatedev) 🔥 Building applications with 𝗱𝗶𝘀𝘁𝗿𝗶𝗯𝘂𝘁𝗲𝗱 𝗱𝘂𝗿𝗮𝗯𝗹𝗲 𝗮𝘀𝘆𝗻𝗰/𝗮𝘄𝗮𝗶𝘁. Scalable and resilient apps, µ-services, background jobs, workflows. restate.dev/blog/why-we-buil…
14
35
15
162
26,848
Tzu-Li (Gordon) Tai retweeted
1. The two-phase commit proposal for @apachekafka (KIP-939) is pretty interesting. Quick thread on why it matters. cwiki.apache.org/confluence/…
7
61
4
220
47,617
The most compelling reason that convinced me to join Confluent is that it's in a strong position to make two of the de facto systems in the streaming space, @ApacheFlink and @apachekafka, work really well together. And at the same time, push each other to become even better!
Replying to @jaykreps
2. The first use case was actually to make @apachekafka and @ApacheFlink work better together. That was one driver for @confluentinc to work on it right now (we have a Flink service coming!). But the applicability is much broader.
1
10
1,545
This specific joint community effort (FLIP-319 and KIP-939) is a first sneak peek of that dynamic. It'll make the integration across the two systems more robust, and at the same time, open up more usage patterns for writing to Kafka. There will sure be more to come!
1
129
Tzu-Li (Gordon) Tai retweeted
Our paper won the VLDB award for Best Industry Paper! Kora: A Cloud-Native Event Streaming Platform For Kafka Not out yet, but trust me when I say it is 🔥🔥🔥 Kudos and thanks to everyone who worked on both the paper and the platform that lead to it! vldb.org/2023/?conference-aw…
6
18
2
141
17,562
Tzu-Li (Gordon) Tai retweeted
EOS talk! Done by Justine! Must see! #KafkaSummit
The transaction protocol in @ApacheKafka has evolved over the years—but the problem of hanging transactions still lingers. KIP-890 aims to fix that. 👀 Want to find out how? Don't miss Justine's session at #Current23! 👉 cnfl.io/3CRy6PC
1
5
805
Tzu-Li (Gordon) Tai retweeted
What’s going on in the @ApacheFlink community? 🧵
1
5
11
4,100
Tzu-Li (Gordon) Tai retweeted
Big news: @ApacheFlink receives this year's @sigmod Systems Award! The project was started at TU Berlin back in 2009 but it would be nowhere today (feature and adoption-wise) without its awesome community. Thanks to everyone who contributed to Apache Flink! 👏🙏
2
17
5
121
13,133
Tzu-Li (Gordon) Tai retweeted
Learning @ApacheFlink? We’ve got some great free online materials on Confluent Developer.
Get started with real-time stream processing with @ApacheFlink! 🐿️ Follow along as @alpinegizmo delves into Flink’s fundamental concepts and architecture, plus hands-on exercises using Flink SQL and Kafka 👉 cnfl.io/3OcL2Xb
4
12
3,534
Tzu-Li (Gordon) Tai retweeted
#streamingselfie with the resident #apacheFlink experts at #kafkaSummit! Wahoo! They’ll be here all day—come have a chat with them.
3
2
17
1,467
Tzu-Li (Gordon) Tai retweeted
It took years to get here. But #ApacheFlink is finally main #stream. Proud to still be part of this journey. #KafkaSummit
3
32
2,107
Tzu-Li (Gordon) Tai retweeted
First time seeing these logos together in a picture. ⁦@confluentinc⁩ ⁦@ApacheFlink⁩
1
4
2
28
2,485
Super excited to see @FlinkForward coming back as an in-person conference this year 🙂 Look out for the CfP coming out very soon!
Tzu-Li (Gordon) Tai, Principal Software Engineer, @Splunk joins us as one of our Program Comittee Members for #flinkforward Gordan brings with him strong knowledge in data streaming systems and real-time data pipelines. https://teapawt.net/t.co/YPAL5HO264
1
8
Tzu-Li (Gordon) Tai retweeted
We're proud to welcome Calvin Cheung, Engineering Manager (Stream Processing Engines) at Netflix onto the Flink Forward Program Committee! Calvin brings a wealth of experience in operating and building large scale data systems #flinkforward https://teapawt.net/t.co/U3W1OXJlKH