medium10 pts · first answer countssparkspark-joinsspark-plans

Reading SortMergeJoin in explain()

df.explain() shows SortMergeJoin with an Exchange hashpartitioning on both sides. What does that tell you?

A.Both tables are shuffled by the join key and sorted before joiningB.The smaller table is copied to every executorC.The join runs on the driver after collecting both sidesD.Spark found the data already partitioned and skipped the shuffle

Discussion 0

Join free to post in the discussion.

Reading SortMergeJoin in explain()

Discussion 0

Related questions