- Introduction
-
Welcome!
- Airflow Architecture
-
Airflow Core Components
-
How Does Airflow Run a DAG?
- DAG Components
-
DAG Setup
- Wrap Up
-
Review
-
Final Quiz
-
How was it?
Airflow: Basics
Explore how Apache Airflow works under the hood and the basics of how a DAG is built!
Welcome to the Airflow Basics Module!
In this module, we will explore the fundamentals of Apache Airflow. We will walk through each of the core components of Airflow and the role it plays in running a DAG. We'll then explore the step-by-step process of how Airflow runs a DAG. Lastly, we will break down a DAG file by exploring each individual component and its role in building a data pipeline.
🎯 Learning Objectives
At the end of this module, you'll be able to:
- Match each of the core components in Airflow’s architecture to their purpose
- Identify how each of the core components in Airflow’s architecture works together to run a DAG
- Identify each of the core components of a DAG file and their purpose
- Identify how to set up a dependency in Airflow using bitwise operators
- Establish connections between dependencies in a DAG by employing the terms "upstream" and "downstream."