Core concept
val df = spark.read.parquet("path")
df.filter($"age" > 21).select("name").show()Advertisement
How it works
Untyped (Row). Compile-time errors don't catch typos in strings.
Advertisement
Trade-offs + gotchas
Structured data ETL, analytics.