Core concept

spark.read.jdbc("jdbc:mysql://...", "table",
  partitionColumn="id", lowerBound=1, upperBound=1000000, numPartitions=10, connectionProps)
Advertisement

How it works

Full-table scans slow. Predicate pushdown for filters.

Advertisement

Trade-offs + gotchas

RDBMS → data lake ETL.