Core concept
Data locality: keep frequently-accessed data close. Prefetch. Cache.
Advertisement
How it works
Slow storage = idle GPUs. Common cause of training inefficiency.
Advertisement
Trade-offs + gotchas
Every training cluster. Balance BW to GPUs.