Core concept
val df = spark.read.schema(mySchema).json("path")Advertisement
How it works
Inference slow + memory heavy. Provide schema in prod.
Advertisement
Trade-offs + gotchas
External JSON ingestion.
val df = spark.read.schema(mySchema).json("path")Inference slow + memory heavy. Provide schema in prod.
External JSON ingestion.