· advanced
Streaming with Kafka
Data as a log rather than a table. Topics, partitions and what ordering you actually get, why consumers read at their own pace, and the delivery guarantees that decide whether a payment is processed twice.
Written in house, from the work rather than from a syllabus. Every example is one we would use ourselves, and every quiz question explains why its answer is right.
What you’ll learn
- Explain how an append-only log differs from a queue
- Choose a partition key knowing what ordering it guarantees
- Describe consumer groups, offsets and how replay works
- Distinguish at-most-once, at-least-once and effectively-once
- Design consumers that tolerate duplicates
- Say when streaming is not worth its cost
Before you start
- · Data Engineering Foundations
- · Comfort with distributed systems at a basic level