Why it matters

EMR is AWS Hadoop. Understanding shapes big data on AWS.

Advertisement

The architecture

Cluster types: on-demand or Spot.

Frameworks: Spark, Hive, Presto, HBase.

EMR optionsCluster provisioningon-demand or SpotFrameworksSpark/Hive/etcAuto-scalingtask nodesEMR Serverless: no cluster management for Spark + Hive
EMR variants.
Advertisement

How it works end to end

EMR Serverless: no cluster management for Spark + Hive.

EMR on EKS: Kubernetes-based.

Spot for cost.

S3 as storage: separate storage + compute.