medium10 pts · first answer countsdata-pipelineslate-arriving-data
Events that arrive days late
Mobile events are partitioned by event date, but phones that were offline upload them up to 3 days later. A daily job only rebuilds yesterday. What goes wrong and what fixes it?
Discussion 0
Join free to post in the discussion.
Related questions
- ETL vs ELTData Engineer
- Idempotent pipelinesData Engineer
- Batch or streaming for a daily reportData Engineer
- Incremental logic for a tiny tableData Engineer
- What SCD Type 1 doesData Engineer
- Keeping the old customer segmentData Engineer
- Why a dimension has its own keyData Engineer
- The bronze layerData Engineer