Core concept

Deployment: scratch (1-day retention, cheapest) or persistent (durable, more expensive). Storage: SSD or HDD.

Advertisement

How it works

Data repository integration with S3: import S3 as file system view. Preload or lazy-load. Export changes back.

Advertisement

Trade-offs + gotchas

ML training (scratch mounted at training node). HPC simulation. Video rendering. Genomics.