- Introduction
-
Welcome! 0 hr 1 min
-
Why Deferrable Operators? 0 hr 1 min
- Deferrable Operator
-
What is it? 0 hr 2 min
-
The Triggerer: How does it work? 0 hr 2 min
-
The reschedule mode and Smart Sensors
- The Deferrable Operators in Action!
-
Find your deferrable operator 0 hr 1 min
-
Wait for files more efficiently 0 hr 2 min
- Finishing up...
-
Quiz!
-
Summary
-
How was it?
Airflow: Deferrable Operators
Learn how to efficiently manage resources by using Deferrable Operators.
Welcome! We're so glad you're here 😍
Want to know why you should use the Deferrable operators instead of sensors.
Well in order to define a deferrable operator we must also know about the concepts that it brings with it such as the triggerer and the trigger.
Also let's see how to use deferrable operators in your dags to better optimize your resources and run more tasks as Standard Operators and Sensors take up a full worker slot for the entire time they are running, even if they are idle.
🎯Objectives
At the end of this course, you'll be able to:
- Why deferrables over Sensors?
- Define what is a Deferrable Operator
- Implement a DAG with Deferrable Operators
👥 Audience
Who should take this course:
- Data Engineers
- Data Analysts
- Software Engineers
Set aside 14 minutes to complete the course.
💻 Setup Requirements
You need to have the following:
- Docker and Docker compose on your computer (cf: get Docker)
- The Astro CLI
- Access to a web browser