Core concept

df.write.format("avro").save("path")
Advertisement

How it works

Row-oriented = worse analytical perf.

Advertisement

Trade-offs + gotchas

Streaming with schema registry. Kafka + Schema Registry pattern.