- Introduction
-
Welcome! 0 hr 1 min
- The Basics
-
What Are Task Groups? 0 hr 2 min
-
Creating a Basic Task Group 0 hr 1 min
-
Practice: Creating a Basic Task Group
- The power of Taskgroups
-
Creating multiple TaskGroups with loops 0 hr 1 min
-
Ordering Your Task Groups 0 hr 1 min
-
Nesting Your Task Groups 0 hr 1 min
- Taskgroups with Dynamic Task Mapping
-
The New Way of Creating TaskGroups 0 hr 3 min
-
Using XCOMs in Dynamic Taskgroups 0 hr 2 min
-
Dynamic TaskGroups in Action 0 hr 6 min
- Finishing Up...
-
Quiz!
-
Wrap-up 0 hr 1 min
-
How was it?
Airflow: Task Groups
Learn how to optimize DAGs and clean up the Airflow UI with Task Groups.
Welcome! We're so glad you're here 😍
A TaskGroup is a way to organize your tasks into hierarchical groups in the Graph view.
It is useful for creating repeating patterns and cutting down the clutter on the UI.
And the best thing is unlike SubDags, Tasks in TaskGroups live on the same original DAG, and honor all the DAG settings and pool configurations.
Let's find more about TaskGroups.
🎯Objectives
At the end of this course, you'll be able to:
- Create task groups (practice):
- Manual
- Dynamic
- Nested
- Demonstrate an understanding of various aspects of task grouping
👥 Audience
Who should take this course:
- Data Engineers
- Data Analysts
- Software Engineers
Set aside 12 minutes to complete the course.
💻 Setup Requirements
You need to have the following:
- Docker and Docker compose on your computer (cf: get Docker)
- The Astro CLI
- Access to a web browser