hard20 pts · first answer countssparkspark-streaming

Changing a streaming aggregation key

You change a streaming query from groupBy("city") to groupBy("city", "channel") and restart with the same checkpoint. It fails. What is the right move?

A.Delete only the offsets folder inside the checkpointB.Use a new checkpoint, since the old state no longer fitsC.Restart again; Spark will migrate the old state itselfD.Add a watermark so the old state is ignored

Discussion 0

Join free to post in the discussion.

Changing a streaming aggregation key

Discussion 0

Related questions