Core concept
Handles memory hierarchy, warp scheduling automatically. Focus on algorithm.
Advertisement
How it works
Not as flexible as CUDA. Some patterns hard. Growing.
Advertisement
Trade-offs + gotchas
Research kernels. FlashAttention originally Triton. Torch Inductor generates Triton.