- Welcome!
-
Introduction
-
Installing Docker
-
Installing the Astro CLI
-
Running airflow 2.0 with the Astro CLI
- The Basics
-
Define your DAG: the right way
-
DAG Scheduling 101
-
Cron vs Timedelta
-
Task idempotence and determinism
-
Backfilling
- Master your Variables
-
Variables
-
Properly fetch your Variables
-
The Power of Environment Variables
-
A Few Additional Notes
- The power of the TaskFlow API
-
Add data at runtime with templating
-
Sharing data with XCOMs and limitations
-
The new way of creating DAGs
-
XComs with the TaskFlow API
- Grouping your tasks
-
SubDAGs: The Hard Way of Grouping your Tasks
-
TaskGroups: The Best Way of Grouping your Tasks
- Advanced Concepts
-
The (not so) dynamic tasks
-
Make your choices with Branching
-
Change task execution with Trigger Rules
-
Dependencies and Helpers
-
Get the control of your tasks
-
Dealing with resource consuming tasks with Pools
-
Execute critical tasks first, the others after
-
What if a task needs the output of its previous execution?
-
Demystifying wait for downstream
-
All you need to know about Sensors
-
Don't get stuck with your Tasks by using Timeouts
-
How to react in case of failure? or retry?
-
The different (and smart) ways of retrying your tasks
-
Get notified with SLAs
-
DAG versioning
-
Dynamic DAGs: The two ways!
- DAG dependencies
-
Wait for multiple DAGs with the ExternalTaskSensor
-
DAG dependencies with the TriggerDagRunOperator
- Well done!
-
Quick message for you!
Prep Course: DAG Authoring
The course is an on-demand class which dives into topics covered on the Astronomer Certification: Apache Airflow DAG Authoring
Get Certified!
Overview
The Astronomer Certification: Apache Airflow DAG Authoring Preparation Course is an on-demand class which dives into the topics covered on the Astronomer Certification: Apache Airflow DAG Authoring. The purpose of the course is to prepare you as much as possible for the exam to put the odds in your favour. Not only you will be prepared for the course, but also you will learn how to create incredible data pipelines thanks to advanced Airflow features . The course is made up of video lectures, quizzes and additional studying resources.
At the end of the course you should feel confident enough to succeed for the exam.
Key Benefits
- Learn at your own pace and schedule
- Cost-effective exam preparation
- Free to access the course
- Focused on the exam