hard20 pts · first answer countsstreamingwatermarksspark
Which late event is kept
A Spark Structured Streaming job counts events in 5-minute event-time windows with withWatermark("event_time", "10 minutes"). The maximum event time seen so far is 12:31. Two late events now arrive: one at 12:18 and one at 12:23. Which is guaranteed to be counted?
Discussion 0
Join free to post in the discussion.