Apache Spark · SPK-08
Memory, caching, and Adaptive Query Execution
- 6 h
- requires SPK-07
From your world. Redshift WLM memory/spill-to-disk and query queues; diagnosing OOM
- Diagnose an OOM from a log excerptSPK-08/01-diagnose-oom
- Make AQE coalescing visible in the planSPK-08/02-aqe-coalesce
- Persist a reused DataFrame at the right storage levelSPK-08/03-cache-storage-level
Run it locally
uv run de start SPK-08
uv run de test