Core concept

Codegen fuses operators into single JVM function. Speeds up analytical queries.

Advertisement

How it works

Debugging codegened code hard. Small queries have compilation overhead.

Advertisement

Trade-offs + gotchas

Every DataFrame job in modern Spark.