hard20 pts · first answer countsairflowairflow-dynamic-task-mappingairflow-xcom
Summing results of mapped tasks
count_rows is mapped over 12 files and returns an int each. A normal downstream task total(counts) receives count_rows's output. What is counts?
counts = count_rows.expand(path=files) total(counts)
Discussion 0
Join free to post in the discussion.
Related questions
- Retrying flaky Airflow tasksData Engineer
- What an Airflow sensor doesData Engineer
- Reading a cron scheduleData Engineer
- Operator, task and task instanceData Engineer
- What the scheduler doesData Engineer
- Metadata database for productionData Engineer
- What @weekly meansData Engineer
- Attempts with retries=3Data Engineer