Posts by Gonzalo Gomez Ortiz

Learn how to achieve exactly-once semantics when ingesting from Kafka to ClickHouse using Tinybird. Understand consumer groups, offset commits, and how to detect missing messages using offset tracking.

We use Docker compose to setup Redpanda Kafka and Tinybird to develop locally first over streaming data. We also create a custom CI workflow to validate both systems are ready to go.