medium10 pts · first answer countssparkspark-window-functions
A 7-row rolling sum
Each store has exactly one row per day. Which frame gives a rolling sum of the current day and the 6 days before it?
w = Window.partitionBy("store").orderBy("day")
df.withColumn("sum_7d", F.sum("sales").over(w.???))Discussion 0
Join free to post in the discussion.
Related questions
- When Spark actually runsData Engineer
- What a Spark partition isData Engineer
- What the Spark driver doesData Engineer
- Calling collect() on 500 GBData Engineer
- Why DataFrames beat RDDs of objectsData Engineer
- Entry point of a Spark 3+ appData Engineer
- Tasks in a 64-partition stageData Engineer
- Where a job splits into stagesData Engineer