Apache Kafka · Build your own · KFK-BYO
Build your own mini Kafka
- 10 h
- 8 stages
Build the real thing from scratch, one stage at a time. Each stage has its own tests, and you move on when it passes.
- 01ApiVersions over TCP
- 02A segmented log with an offset index
- 03Produce: RecordBatch v2 + CRC32C
- 04Fetch by offset
- 05Metadata + multiple topics & partitions
- 06Retention and log compaction
- 07Consumer-group offsets (OffsetCommit / OffsetFetch)
- 08Replication & the high watermark
Run it locally
uv run de start KFK-BYO/01
uv run de test