medium10 pts · first answer countssparkpartitioning

repartition vs coalesce

You want to reduce 2,000 partitions to 50 before writing files. What is the difference between repartition(50) and coalesce(50)?

A.They are identical in every wayB.coalesce always causes a full shuffle while repartition never doesC.repartition can only increase partitionsD.coalesce merges existing partitions without a full shuffle but can give uneven sizes; repartition does a full shuffle and gives even partitions

Discussion 0

Join free to post in the discussion.

repartition vs coalesce

Discussion 0

Related questions