hard20 pts · first answer countsairflowairflow-concurrencyairflow-backfill
Finishing old runs before new ones
During a 30-day backfill, Airflow starts the first task of many runs before finishing any run, so complete days appear slowly. Which weight_rule makes later tasks of started runs go first?
Discussion 0
Join free to post in the discussion.
Related questions
- Retrying flaky Airflow tasksData Engineer
- What an Airflow sensor doesData Engineer
- Reading a cron scheduleData Engineer
- Operator, task and task instanceData Engineer
- What the scheduler doesData Engineer
- Metadata database for productionData Engineer
- What @weekly meansData Engineer
- Attempts with retries=3Data Engineer