Apache Iceberg Kafka Connect sink bug causes data loss with default configs (Issue #17551). Interim mitigation: set control topic's auto.offset.reset (default latest) to earliest (perf risk) or alert/kill zombie coordinators. Fixed, release pending
Debezium Vitess Connector had a rare but critical data loss bug (DBZ-8594) that existed since its first PR—5 years ago. If a primary key update is the last operation in a transaction, records may be lost. Affects all prior versions. Fixed, will be released in the next version
Kafka connect bug causes data loss for all source & sink connectors (KAFKA-18073). Fixed, but unreleased. Interim workaround: set errors.retry.timeout to -1 (default value of 0 causes data loss). Monitor total-records-skipped metric to detect when this happens.
I’m speaking at #Current24 hosted by @ConfluentInc: The Data Streaming Event! Catch my talk Change Data Capture & Kafka: How Slack Transitioned to CDC with Debezium & Kafka Connect. There are 100+ sessions & lightning talks on #datastreaming trends. Learn more about the event ⤵️
📆 September 17-18, 2024
📍 Austin, TX
🔗 Register now 📷 cnfl.io/3LQjODb
Use code “PRMSPEAKER24” and get 35% off the standard ticket price.