Skip to content
RED SAGSkills
hard20 pts · first answer countssparkspark-query-plansshuffle

Shuffles after repartition on the same key

How many shuffle (Exchange) steps does the physical plan of this code contain, with AQE off and no prior partitioning?

out = (df.repartition(200, "customer_id")
          .groupBy("customer_id")
          .agg(F.sum("amount")))
Choose one answer

Discussion 0

Join free to post in the discussion.

Related questions