medium10 pts · first answer countsidempotencydata-pipelines

Rerunning a half-failed load

A daily job does INSERT INTO sales SELECT ... for one date. It failed halfway after writing some rows, and rerunning it created duplicates. How should it be redesigned?

A.Delete or overwrite that date partition and load it in one transaction, so any rerun gives the same resultB.Never rerun failed jobsC.Add a DISTINCT to every dashboard queryD.Run the job twice every day

Discussion 0

Join free to post in the discussion.

Rerunning a half-failed load

Discussion 0

Related questions