Why it matters

Parallel sort is core primitive. Understanding shapes parallel computing.

Advertisement

The architecture

Bitonic: recursive merge networks.

Radix: bucket sort per digit.

Sample sort: distributed sort.

Parallel sort optionsBitonicO(log^2 n) depthRadixlinear workSample sortdistributedCUB DeviceRadixSort + Thrust::sort standard for GPU; MPI + spark for distributed
Parallel sort.
Advertisement

How it works end to end

CUB DeviceRadixSort dominant on GPU.

Bitonic simple networks.

Sample sort for distributed.