DAGs View
The DAGs view is the central hub for managing and monitoring your Directed Acyclic Graphs (DAGs) in Apache Airflow. From this page, you can see all your DAGs, their status, trigger them, pause/unpause them, and access other related functionalities.
Key Features
- DAG List: A comprehensive list of all DAGs discovered by Airflow.
- Status Indicators: Visual cues to quickly identify the state of a DAG (e.g., active, paused, has recent failures).
- Search and Filter: Easily find specific DAGs using search queries or filters.
- Quick Actions: Perform common actions like triggering, pausing, unpausing, and clearing DAG runs directly from the list.
- Access to Other Views: Links to detailed views for each DAG, such as the Graph View, Tree View, and Task Logs.
Understanding the Table Columns
The DAGs table typically includes the following columns:
- DAG ID: The unique identifier for your DAG.
- Owner: The owner of the DAG, as defined in the DAG file.
- Last Run: The timestamp of the most recent DAG run.
- Next Run: The scheduled timestamp for the next DAG run.
- Recent Tasks: An indicator of the status of recent task instances within the DAG runs.
- Owner (Updated): The owner of the DAG, as defined in the DAG file (can be different from initial owner).
- Tags: Any tags associated with the DAG for organization.
- Schedule: The schedule interval for the DAG.
- Actions: A menu of available actions for the DAG.
Actions Menu
Clicking the "Actions" button for a specific DAG reveals a dropdown menu with several options:
- Trigger DAG: Manually start a new run of the DAG.
- Unpause: Enable scheduled runs for a paused DAG.
- Pause: Disable scheduled runs for an active DAG.
- Clear: Clear task states for selected DAG runs, allowing them to be re-executed.
- View DAG: Navigate to a more detailed view of the DAG's structure and runs (often redirects to Graph View or Tree View).
Example of a DAG Entry:
DAG ID: my_etl_pipeline
Owner: airflow_user
Last Run: 2023-10-27T10:00:00+00:00
Next Run: 2023-10-27T11:00:00+00:00
Recent Tasks: [Success, Success, Running]
Schedule: 0 * * * *
Note: The exact columns and available actions might vary slightly depending on your Airflow version and configuration.
Searching and Filtering
Use the search bar at the top of the page to quickly find DAGs by their ID, owner, or tags. You can also use the filter options to narrow down the list based on DAG status or other criteria.
Accessing Detailed Views
Clicking on a DAG ID in the list (rather than the actions menu) will typically take you to the Graph View for that DAG, providing a visual representation of the task dependencies and the status of each task instance in recent runs.
From the DAGs view, you have a powerful overview of your entire workflow landscape within Airflow, enabling efficient monitoring and management.