medium10 pts · first answer countsml-pipelinesairflow

Too many tasks hit the database

A backfill launches 200 parallel extract tasks that overload the production Postgres replica. Which Airflow feature limits this?

A.A pool with a fixed number of slots for those tasksB.Raising the scheduler heartbeat intervalC.Setting catchup=True on the DAGD.Adding more Airflow workers

Discussion 0

Join free to post in the discussion.

Too many tasks hit the database

Discussion 0

Related questions