Core concept

Fewer reducers = less parallelism. More = more overhead. mapreduce.job.reduces controls.

Advertisement

How it works

Skewed keys destroy parallelism. One hot key = one reducer bottleneck.

Advertisement

Trade-offs + gotchas

Aggregation, joining, grouping.