medium10 pts · first answer countsairflowairflow-dynamic-task-mapping

Mapping over files found at run time

list_files() returns a different number of S3 keys each day, and process.expand(key=list_files()) follows. When is the number of process instances decided?

A.When the DAG file is parsed by the processorB.After list_files finishes and returns its listC.When the DAG is unpaused for the first timeD.Once, on the first run, then reused

Discussion 0

Join free to post in the discussion.

Mapping over files found at run time

Discussion 0

Related questions