Airflow 101
Airflow 101
The Airflow 101 learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow. This includes the core concepts, the Airflow UI, creating your first data pipeline following best practices, how to schedule this data pipeline efficiently and more!
Free
12 Modules
Learning Path Airflow
Airflow: Datasets
Airflow: Datasets
Learn how to take advantage datasets to create data-aware scheduled DAGs.
Free
0 hr 10 min
Beginner Data Engineer Astro Runtime Intermediate Airflow Module
Airflow: The KubernetesPodOperator
Airflow: The KubernetesPodOperator
Master the KubernetesPodOperator (KPO) to better manage resources and dependencies of DAG tasks.
Free
0 hr 13 min
Data Engineer Astro Runtime Advanced Kubernetes Airflow Module
Airflow: XComs 101
Airflow: XComs 101
Learn the basics of sharing data between tasks using XComs
Free
0 hr 10 min
Beginner 101 Astro Runtime Airflow Module
Airflow: Variables 101
Airflow: Variables 101
Learn how to store data with variables and make DAGs more dynamic.
Free
0 hr 6 min
Beginner 101 Astro Runtime Airflow Module
Airflow: Trigger Rules
Airflow: Trigger Rules
Learn how to effectively control the task execution flow using trigger rules.
Free
0 hr 6 min
Data Engineer Astro Runtime Intermediate Airflow Module
Airflow: The ExternalPythonOperator
Airflow: The ExternalPythonOperator
Learn how to run python tasks in a safe virtual environment.
Free
0 hr 21 min
Beginner 101 Data Engineer Astro Runtime Airflow Module
Airflow: Templating
Airflow: Templating
Learn how to pass dynamic data to tasks at runtime.
Free
0 hr 12 min
Beginner Data Engineer Astro Runtime Intermediate Templating Airflow Module
Airflow: Taskflow API
Airflow: Taskflow API
Learn how to use the Taskflow API to create DAGs faster.
Free
0 hr 28 min
Data Engineer Astro Runtime Airflow Module
Airflow: SubDAGs
Airflow: SubDAGs
Learn how to use SubDAGs to write cleaner and more efficient DAGs.
Free
0 hr 28 min
Beginner Data Engineer Astro Runtime Grouping Intermediate Airflow Module
Airflow: Task Groups
Airflow: Task Groups
Learn how to optimize DAGs and clean up the Airflow UI with Task Groups.
Free
0 hr 18 min
Beginner Astro Runtime task groups Airflow Module
Astro: SDK
Astro: SDK
Speed up your DAG development with the Astro SDK
Free
0 hr 50 min
Astro Data Engineer Astro Runtime Intermediate Module
Airflow: Pools
Airflow: Pools
Learn how to define how many tasks run in parallel for a set of tasks with Airflow pools.
Free
0 hr 7 min
Data Engineer Astro Runtime Intermediate Airflow Module
Airflow: Dynamic Task Mapping
Airflow: Dynamic Task Mapping
Learn to create tasks based on current data using Dynamic Task Mapping.
Free
0 hr 12 min
Astro Runtime Advanced Airflow Module
Airflow: Dynamic DAGs
Airflow: Dynamic DAGs
Learn how to avoid duplicating DAGs with Dynamic DAGs.
Free
0 hr 8 min
Data Engineer Astro Runtime Advanced Airflow Module
Airflow: Deferrable Operators
Airflow: Deferrable Operators
Learn how to efficiently manage resources by using Deferrable Operators.
Free
0 hr 9 min
Data Engineer Astro Runtime Intermediate Airflow Module
Airflow Project: Dynamic Task Mapping with S3
Airflow Project: Dynamic Task Mapping with S3
Build a DAG that interacts with S3 buckets using Dynamic Task Mapping.
Free
0 hr 25 min
Beginner AWS Data Engineer Astro Runtime Projects Airflow Module
Airflow: UI
Airflow: UI
Learn how to efficiently monitor DAGs and Tasks in the Airflow UI.
Free
Beginner 101 Astro Runtime Airflow Module
Airflow: Branching
Airflow: Branching
Learn how to branch in order to tell the DAGs to not to run all dependent tasks, but instead to pick and choose one or more paths to go down.
Free
0 hr 26 min
Beginner 101 Intermediate Airflow Module
Airflow: DAG Scheduling
Airflow: DAG Scheduling
Learn about how DAGs are scheduled.
Free
0 hr 10 min
Beginner Data Engineer Astro Runtime Scheduling Airflow Module
Airflow: Connections 101
Airflow: Connections 101
Learn how to interact with systems from data pipelines with connections.
Free
0 hr 7 min
Beginner 101 Airflow Module
Astro: HTTP Provider
Astro: HTTP Provider
Interact with HTTP Resources by making Web Requests to an API.
Free
0 hr 35 min
Beginner Astro Providers Module
Airflow: DAGs 101
Airflow: DAGs 101
Learn the basics of how to create a data pipeline in Airflow.
Free
0 hr 17 min
Beginner 101 Astro Runtime Airflow Module
Airflow: Debug DAGs
Airflow: Debug DAGs
Discover how to effectively debug DAGs.
Free
0 hr 27 min
Beginner Airflow Module
Airflow: Sensors
Airflow: Sensors
Learn how to use Airflow sensors to wait for events before triggering tasks.
Free
0 hr 15 min
Beginner 101 Airflow Module
Airflow: Command Line Interface (CLI)
Airflow: Command Line Interface (CLI)
Learn how to use the Airflow CLI to perform a variety of operations.
Free
0 hr 19 min
Beginner Airflow Module
Airflow: Basics
Airflow: Basics
Explore how Apache Airflow works under the hood and the basics of how a DAG is built!
Free
Beginner 101 Airflow
Introduction to Orchestration and Airflow
Introduction to Orchestration and Airflow
An overview of the world of data orchestration and Apache Airflow!
Free
Beginner Airflow Module
Airflow: Local Development Environment
Airflow: Local Development Environment
Set up a local development environment for Airflow!
Free
Beginner Airflow
Airflow: Basics
Airflow: Basics
Explore how Apache Airflow works under the hood and the basics of how a DAG is built!
Free
Beginner 101 Airflow
Introduction to Orchestration and Airflow
Introduction to Orchestration and Airflow
An overview of the world of data orchestration and Apache Airflow!
Free
Beginner Airflow Module
Airflow: Sensors
Airflow: Sensors
Learn how to use Airflow sensors to wait for events before triggering tasks.
Free
0 hr 15 min
Beginner 101 Airflow Module
Airflow: Debug DAGs
Airflow: Debug DAGs
Discover how to effectively debug DAGs.
Free
0 hr 27 min
Beginner Airflow Module
Airflow: Command Line Interface (CLI)
Airflow: Command Line Interface (CLI)
Learn how to use the Airflow CLI to perform a variety of operations.
Free
0 hr 19 min
Beginner Airflow Module
Airflow: DAG Scheduling
Airflow: DAG Scheduling
Learn about how DAGs are scheduled.
Free
0 hr 10 min
Beginner Data Engineer Astro Runtime Scheduling Airflow Module
Airflow: XComs 101
Airflow: XComs 101
Learn the basics of sharing data between tasks using XComs
Free
0 hr 10 min
Beginner 101 Astro Runtime Airflow Module
Airflow: UI
Airflow: UI
Learn how to efficiently monitor DAGs and Tasks in the Airflow UI.
Free
Beginner 101 Astro Runtime Airflow Module
Airflow: DAGs 101
Airflow: DAGs 101
Learn the basics of how to create a data pipeline in Airflow.
Free
0 hr 17 min
Beginner 101 Astro Runtime Airflow Module
Airflow: Local Development Environment
Airflow: Local Development Environment
Set up a local development environment for Airflow!
Free
Beginner Airflow
Airflow: Connections 101
Airflow: Connections 101
Learn how to interact with systems from data pipelines with connections.
Free
0 hr 7 min
Beginner 101 Airflow Module
Airflow: Variables 101
Airflow: Variables 101
Learn how to store data with variables and make DAGs more dynamic.
Free
0 hr 6 min
Beginner 101 Astro Runtime Airflow Module