Jitter buffer trades latency for smoothness. Set too small: underruns (audio gaps). Set too large: noticeable delay. Modern adaptive jitter buffers (WebRTC) tune in real time to network conditions.
Rule of thumb: target depth = p95 of recent inter-arrival jitter. Update every 100-500ms.