Reset

Learn Apache Airflow

Free Airflow courses taught by the Astronomer experts behind the project. Grow your skills to create powerful, scalable and reliable data pipelines based on industry and data engineering best practices. From anywhere, at anytime.

Get Certified Explore All Modules →

Marc Lamberti

Marc Lamberti

Course Instructor

Introducing Learning Bytes: 10-min videos on new features for quick learning →

New to Airflow?

Airflow 101 Learning Path

This learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow.

New to Astro?

Astro Onboarding Learning Path

This learning path shows you how to run Airflow on Astronomer’s managed service. Deploy your first DAG in minutes.

[separator] Popular Airflow Modules

[separator] Popular Airflow Modules

Airflow: Datasets

Airflow: Datasets

Learn how to take advantage datasets to create data-aware scheduled DAGs.

Beginner Data Engineer Astro Runtime Intermediate Airflow Module

Airflow: The KubernetesPodOperator

Airflow: The KubernetesPodOperator

Master the KubernetesPodOperator (KPO) to better manage resources and dependencies of DAG tasks.

Data Engineer Astro Runtime Advanced Kubernetes Airflow Module

Airflow: Trigger Rules

Airflow: Trigger Rules

Learn how to effectively control the task execution flow using trigger rules.

Data Engineer Astro Runtime Intermediate Airflow Module

[separator] Popular Astro Modules

[separator] Popular Astro Modules

Astro: Cloud IDE

Astro: Cloud IDE

Learn about the Cloud IDE which makes it simple for someone new to Airflow and Astronomer users to write a data pipeline.

Beginner 101 Astro Module

Astro: HTTP Provider

Astro: HTTP Provider

Interact with HTTP Resources by making Web Requests to an API.

Beginner Astro Providers Module

Astro: Deployments

Astro: Deployments

Organize and configure your deployments to better run your workflows

Beginner 101 Astro Module

Airflow: Dynamic DAGs

Airflow: Dynamic DAGs

Learn how to avoid duplicating DAGs with Dynamic DAGs.

Data Engineer Astro Runtime Advanced Airflow Module

Learn how to define how many tasks run in parallel for a set of tasks with Airflow pools.

Data Engineer Astro Runtime Intermediate Airflow Module

Airflow: Deferrable Operators

Airflow: Deferrable Operators

Learn how to efficiently manage resources by using Deferrable Operators.

Data Engineer Astro Runtime Intermediate Airflow Module

Astronomer Software 101

Astronomer Software 101

Get started with Software and get the most out of the platform for your workflows

Astronomer Platform Beginner Astronomer Enterprise Admin 101

The Airflow 101 learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow. This includes the core concepts, the Airflow UI, creating your first data pipeline following best practices, how to schedule this data pipeline efficiently and more!

Learning Path Airflow

Airflow: Basics

Airflow: Basics

Explore how Apache Airflow works under the hood and the basics of how a DAG is built!

Beginner 101 Airflow

Airflow: XComs 101

Airflow: XComs 101

Learn the basics of sharing data between tasks using XComs

Beginner 101 Astro Runtime Airflow Module

Get started with Astro quickly and learn how to get the most out of it!

Beginner 101 Astro

Learning Bytes: Customer Managed Workload Identity

Learning Bytes: Customer Managed Workload Identity

An overview of the Customer Managed Workload Identity feature on Astro!

Astro Runtime Learning Byte

Airflow: DAGs 101

Airflow: DAGs 101

Learn the basics of how to create a data pipeline in Airflow.

Beginner 101 Astro Runtime Airflow Module

Airflow: Local Development Environment

Airflow: Local Development Environment

Set up a local development environment for Airflow!

Beginner Airflow

Learning Bytes: Reporting

Learning Bytes: Reporting

An overview of the reporting feature on Astro!

Astro Astro Runtime Learning Byte

Learning Bytes: Custom Deployment Roles

Learning Bytes: Custom Deployment Roles

An overview of the custom deployment roles feature on Astro!

Astro Astro Runtime Learning Byte

Introduction to Orchestration and Airflow

Introduction to Orchestration and Airflow

An overview of the world of data orchestration and Apache Airflow!

Beginner Airflow Module

Astro: User permissions

Astro: User permissions

Define the right permissions to the right users in Astro

Beginner 101 Astro permissions Module

Make reliable and resilient deployments with CI/CD

Beginner 101 Astro cicd Module

Airflow: Templating

Airflow: Templating

Learn how to pass dynamic data to tasks at runtime.

Beginner Data Engineer Astro Runtime Intermediate Templating Airflow Module

Software: Metrics

Software: Metrics

What are the key metrics to know, what to do if something goes wrong, let's find out!

Astronomer Platform Beginner Astronomer Enterprise Admin Monitoring Software Module

Speed up your DAG development with the Astro SDK

Astro Data Engineer Astro Runtime Intermediate Module

Airflow: Branching

Airflow: Branching

Learn how to branch in order to tell the DAGs to not to run all dependent tasks, but instead to pick and choose one or more paths to go down.

Beginner 101 Intermediate Airflow Module

Airflow: Task Groups

Airflow: Task Groups

Learn how to optimize DAGs and clean up the Airflow UI with Task Groups.

Beginner Astro Runtime task groups Airflow Module

Airflow: Connections 101

Airflow: Connections 101

Learn how to interact with systems from data pipelines with connections.

Beginner 101 Airflow Module

Astro: Local Development Environment

Astro: Local Development Environment

Set up your local development environment with the Astro CLI and speed up your DAGs development

Beginner 101 Astro Module

Software: User Permissions

Software: User Permissions

Setting the proper permissions and roles for your users can be a pain. Let us help you make it more enjoyable and straightforward.

Beginner Astronomer Enterprise Admin Software Module

Software: Alerting

Software: Alerting

Be notified when something goes wrong and know what to do

Beginner Astronomer Enterprise Admin Software Module

Astro: Environment Variables

Astro: Environment Variables

The fundamentals of how to apply Environment Variables in Astro

Beginner 101 Astro environment variables Module

Software: Workspaces

Software: Workspaces

Learn how to better organize your Airflow deployments and Users with Workspaces.

Astronomer Platform Beginner Astronomer Enterprise Admin Workspace Software Module

Astro: Onboarding

Astro: Onboarding

Discover Astro and Airflow by building and deploying a data pipeline!

101 Astro Module

Monitor your deployments and quickly spot failures

Beginner 101 Astro Module

Software: Deployment Resources

Software: Deployment Resources

Don't get your tasks killed anymore. Learn how to define your resources according to your needs.

Astronomer Platform Beginner Astronomer Enterprise Admin resources Software Module

Astro: Deployment Analytics

Astro: Deployment Analytics

Learn how to interpret powerful insights relating to your deployment

Beginner Monitoring 101 Astro analytics Module

Astro: Secrets Backend

Astro: Secrets Backend

The fundamentals of how to configure an external secrets backend in Astro

Beginner modules 101 Astro AWS secrets backend secrets Module

Airflow: Command Line Interface (CLI)

Airflow: Command Line Interface (CLI)

Learn how to use the Airflow CLI to perform a variety of operations.

Beginner Airflow Module

Airflow: Variables 101

Airflow: Variables 101

Learn how to store data with variables and make DAGs more dynamic.

Beginner 101 Astro Runtime Airflow Module

Airflow: DAG Scheduling

Airflow: DAG Scheduling

Learn about how DAGs are scheduled.

Beginner Data Engineer Astro Runtime Scheduling Airflow Module

Airflow: Taskflow API

Airflow: Taskflow API

Learn how to use the Taskflow API to create DAGs faster.

Data Engineer Astro Runtime Airflow Module

Airflow: Sensors

Airflow: Sensors

Learn how to use Airflow sensors to wait for events before triggering tasks.

Beginner 101 Airflow Module

Airflow Project: Dynamic Task Mapping with S3

Airflow Project: Dynamic Task Mapping with S3

Build a DAG that interacts with S3 buckets using Dynamic Task Mapping.

Beginner AWS Data Engineer Astro Runtime Projects Airflow Module

Airflow: Debug DAGs

Airflow: Debug DAGs

Discover how to effectively debug DAGs.

Beginner Airflow Module

Airflow: Dynamic Task Mapping

Airflow: Dynamic Task Mapping

Learn to create tasks based on current data using Dynamic Task Mapping.

Astro Runtime Advanced Airflow Module

Airflow: The ExternalPythonOperator

Airflow: The ExternalPythonOperator

Learn how to run python tasks in a safe virtual environment.

Beginner 101 Data Engineer Astro Runtime Airflow Module

Learn how to efficiently monitor DAGs and Tasks in the Airflow UI.

Beginner 101 Astro Runtime Airflow Module

Airflow: SubDAGs

Airflow: SubDAGs

Learn how to use SubDAGs to write cleaner and more efficient DAGs.

Beginner Data Engineer Astro Runtime Grouping Intermediate Airflow Module

[separator] Airflow Fundamentals

[separator] Airflow Fundamentals

Test your skills and make sure you've mastered the Airflow fundamentals

[separator] Airflow DAG Authoring

[separator] Airflow DAG Authoring

Show your expertise to the world and level-up your data pipelines with DAG Authoring

Certification Exam: DAG Authoring

Certification Exam: DAG Authoring

Challenge your DAG authoring skills and show to the world your expertise in creating amazing DAGs!

Prep Course: DAG Authoring

Prep Course: DAG Authoring

The course is an on-demand class which dives into topics covered on the Astronomer Certification: Apache Airflow DAG Authoring

preparation course certification

Certification Exam: Airflow Fundamentals

Certification Exam: Airflow Fundamentals

Demonstrate your mastery of fundamental Apache Airflow concepts to the world, highlighting your proficiency in designing, scheduling, and overseeing data pipelines.

Airflow: Basics

Airflow: Basics

Explore how Apache Airflow works under the hood and the basics of how a DAG is built!

Beginner 101 Airflow

Introduction to Orchestration and Airflow

Introduction to Orchestration and Airflow

An overview of the world of data orchestration and Apache Airflow!

Beginner Airflow Module

Airflow: Sensors

Airflow: Sensors

Learn how to use Airflow sensors to wait for events before triggering tasks.

Beginner 101 Airflow Module

Airflow: Debug DAGs

Airflow: Debug DAGs

Discover how to effectively debug DAGs.

Beginner Airflow Module

Airflow: Command Line Interface (CLI)

Airflow: Command Line Interface (CLI)

Learn how to use the Airflow CLI to perform a variety of operations.

Beginner Airflow Module

Airflow: DAG Scheduling

Airflow: DAG Scheduling

Learn about how DAGs are scheduled.

Beginner Data Engineer Astro Runtime Scheduling Airflow Module

Airflow: XComs 101

Airflow: XComs 101

Learn the basics of sharing data between tasks using XComs

Beginner 101 Astro Runtime Airflow Module

Learn how to efficiently monitor DAGs and Tasks in the Airflow UI.

Beginner 101 Astro Runtime Airflow Module

Airflow: DAGs 101

Airflow: DAGs 101

Learn the basics of how to create a data pipeline in Airflow.

Beginner 101 Astro Runtime Airflow Module

Airflow: Local Development Environment

Airflow: Local Development Environment

Set up a local development environment for Airflow!

Beginner Airflow

Airflow: Connections 101

Airflow: Connections 101

Learn how to interact with systems from data pipelines with connections.

Beginner 101 Airflow Module

Airflow: Variables 101

Airflow: Variables 101

Learn how to store data with variables and make DAGs more dynamic.

Beginner 101 Astro Runtime Airflow Module

Software: Metrics

Software: Metrics

What are the key metrics to know, what to do if something goes wrong, let's find out!

Astronomer Platform Beginner Astronomer Enterprise Admin Monitoring Software Module

Software: Deployment Resources

Software: Deployment Resources

Don't get your tasks killed anymore. Learn how to define your resources according to your needs.

Astronomer Platform Beginner Astronomer Enterprise Admin resources Software Module

Software: User Permissions

Software: User Permissions

Setting the proper permissions and roles for your users can be a pain. Let us help you make it more enjoyable and straightforward.

Beginner Astronomer Enterprise Admin Software Module

Software: Alerting

Software: Alerting

Be notified when something goes wrong and know what to do

Beginner Astronomer Enterprise Admin Software Module

Software: Workspaces

Software: Workspaces

Learn how to better organize your Airflow deployments and Users with Workspaces.

Astronomer Platform Beginner Astronomer Enterprise Admin Workspace Software Module

Astro: Deployments

Astro: Deployments

Organize and configure your deployments to better run your workflows

Beginner 101 Astro Module

Astro: Local Development Environment

Astro: Local Development Environment

Set up your local development environment with the Astro CLI and speed up your DAGs development

Beginner 101 Astro Module

Astro: User permissions

Astro: User permissions

Define the right permissions to the right users in Astro

Beginner 101 Astro permissions Module

Make reliable and resilient deployments with CI/CD

Beginner 101 Astro cicd Module

Astro: Secrets Backend

Astro: Secrets Backend

The fundamentals of how to configure an external secrets backend in Astro

Beginner modules 101 Astro AWS secrets backend secrets Module

Astro: Environment Variables

Astro: Environment Variables

The fundamentals of how to apply Environment Variables in Astro

Beginner 101 Astro environment variables Module

Astro: Deployment Analytics

Astro: Deployment Analytics

Learn how to interpret powerful insights relating to your deployment

Beginner Monitoring 101 Astro analytics Module

Monitor your deployments and quickly spot failures

Beginner 101 Astro Module