DE Mastery GitHub

Lakehouse & open table formats · Build your own · LKH-BYO

Build your own mini table format

  • 8 h
  • 7 stages

Build the real thing from scratch, one stage at a time. Each stage has its own tests, and you move on when it passes.

  1. 01Parquet files + a JSON manifest
  2. 02Snapshots & time travel
  3. 03Atomic commit via put-if-absent
  4. 04Concurrent writers — conflict detection + retry
  5. 05Delete files / merge-on-read
  6. 06Manifest column stats + file pruning
  7. 07Compaction + snapshot expiration
Run it locally
uv run de start LKH-BYO/01
uv run de test