Apache Spark · SPK-06
Joins and aggregations at scale
- 6 h
- requires SPK-05
From your world. Redshift DISTSTYLE ALL ≈ broadcast; distribution keys and skew
- Broadcast the small dimensionSPK-06/01-broadcast-join
- Fix a skewed aggregation with saltingSPK-06/02-salt-skewed-aggregation
- Broadcast variable and accumulatorSPK-06/03-broadcast-var-accumulator
Run it locally
uv run de start SPK-06
uv run de test