medium10 pts · first answer countssparkspark-streamingdelta-lake

Upserting a stream into a table

A streaming job must upsert each micro-batch into a Delta table by order_id. There is no built-in upsert sink. What is the usual approach?

A.writeStream.format("delta").outputMode("complete")B.writeStream.foreachBatch with a MERGE inside the functionC.A trigger of once with overwrite modeD.writeStream.foreach that runs one UPDATE per row

Discussion 0

Join free to post in the discussion.

Upserting a stream into a table

Discussion 0

Related questions