hard20 pts · first answer countssparkspark-streamingwatermarks

Stream-stream join running out of memory

A streaming join of ad impressions to clicks runs for days and its state store keeps growing until executors fail. What is missing?

A.A larger trigger interval such as 10 minutesB.A cache() call on both input streamsC.Watermarks plus a time bound in the join conditionD.Complete output mode for the join query

Discussion 0

Join free to post in the discussion.

Stream-stream join running out of memory

Discussion 0

Related questions