hard20 pts · first answer countsairflowairflow-sensorscross-dag-dependencies
Sensor waits hours on a failed upstream
An ExternalTaskSensor waits for ingest.load. Today load failed at 01:10, but the sensor kept poking until its 6-hour timeout. How do you make it fail soon after the upstream fails?
Discussion 0
Join free to post in the discussion.
Related questions
- Retrying flaky Airflow tasksData Engineer
- What an Airflow sensor doesData Engineer
- Reading a cron scheduleData Engineer
- Operator, task and task instanceData Engineer
- What the scheduler doesData Engineer
- Metadata database for productionData Engineer
- What @weekly meansData Engineer
- Attempts with retries=3Data Engineer