Apache Spark · SPK-09
UDFs and the Pandas API
- 4 h
- requires SPK-05
From your world. dbt Python models, and the pandas you reach for out of habit
- Replace a slow per-row FX Python UDFSPK-09/01-kill-the-udf
- Vectorize a currency-code cleanerSPK-09/02-normalize-codes
- Port a pandas aggregation to the Pandas API on SparkSPK-09/03-pandas-api
Run it locally
uv run de start SPK-09
uv run de test