Discussions on "Airflow Scheduler"

Troubleshooting Scheduler High CPU Usage

Posted by: airflow_user123 Date: 2023-10-27 Replies: 15

Experiencing intermittent high CPU usage on the Airflow scheduler. Any common causes or debugging strategies? Looking for insights on resource optimization.

airflow-scheduler performance troubleshooting cpu

Best Practices for Scheduler HA Setup

Posted by: dev_ops_guru Date: 2023-10-25 Replies: 8

Recently upgraded to Airflow 2.x and setting up High Availability for the scheduler. What are the recommended configurations and potential pitfalls?

airflow-scheduler ha deployment best-practices

Understanding Scheduler Deadlocks

Posted by: data_engineer_42 Date: 2023-10-20 Replies: 5

Encountered scheduler deadlocks after introducing complex DAG dependencies. How can I prevent or diagnose these issues effectively?

airflow-scheduler deadlock dag-dependencies debugging

Scheduler Configuration for Large Number of DAGs

Posted by: scalability_fan Date: 2023-10-18 Replies: 12

Managing over 500 DAGs. What are the key scheduler configurations to optimize performance and prevent delays in task scheduling?

airflow-scheduler scalability configuration optimization
Start a New Discussion