Core concept

Composer 2 uses Autopilot GKE. Composer 3 (beta) further managed.

Advertisement

How it works

Cost of managed Airflow (Composer overhead). Alternatives: MWAA (AWS), Astronomer, self-hosted.

Advertisement

Trade-offs + gotchas

Data engineers needing Airflow. Complex data pipelines. Existing Airflow investment.