Core concept
FileOutputCommitter default. S3 needs S3A-specific committer for consistency.
Advertisement
How it works
S3 with default committer = incorrect on rename (S3 has no real rename).
Advertisement
Trade-offs + gotchas
Every MR/Spark job. Especially cloud storage sinks.