medium10 pts · first answer countssparkspark-sqlaggregation
Subtotals with rollup
df.rollup("region", "city").agg(F.sum("sales")) is run on data with 2 regions and 5 cities in total. Which extra rows appear besides region-city totals?
Discussion 0
Join free to post in the discussion.
Related questions
- COUNT(*) vs COUNT(column)Data Engineer
- Filtering groups with HAVINGData Engineer
- When Spark actually runsData Engineer
- What a Spark partition isData Engineer
- What the Spark driver doesData Engineer
- Calling collect() on 500 GBData Engineer
- Why DataFrames beat RDDs of objectsData Engineer
- Entry point of a Spark 3+ appData Engineer