DE Mastery GitHub

Track · JVM · ~20 h

Java for data engineers

Why. Kafka and Flink are JVM projects. Kafka Streams is Java-only. The Flink DataStream API, the state backends and most production Flink code are in Java. Exam samples for CCDAK use Java. You also need to read JVM stack traces, tune heap and GC, and package jars. The goal is productive Java for data work, not enterprise Java.

Can run in parallel with LKH. Exercises are graded with JUnit 5 + AssertJ through Gradle.

Scala: never required. SPK-05 includes a short "reading Scala in Spark source and stack traces" sidebar.

Modules

  1. 01 Java for Python developers 4 h · 1 exercise
  2. 02 Collections and streams 3 h · 1 exercise
  3. 03 Build and dependencies 3 h · 1 exercise
  4. 04 Serialization 3 h · 1 exercise
  5. 05 Concurrency and the JVM 4 h · 1 exercise
  6. 06 Testing and debugging 3 h · 1 exercise