- Introduction
-
Welcome! 0 hr 1 min
-
Why Sensors? 0 hr 1 min
-
What's a Sensor? 0 hr 1 min
- The basics
-
Waiting for files in a S3 bucket 0 hr 5 min
-
Running the Sensor 0 hr 2 min
-
Practice: Better utilize Sensors 0 hr 3 min
- Advanced
-
Implement any logic in your Sensors 0 hr 3 min
-
Best practices with Sensors 0 hr 1 min
- Finishing up...
-
Quiz!
-
Wrap up 0 hr 1 min
-
How was it?
Airflow: Sensors
Learn how to use Airflow sensors to wait for events before triggering tasks.
Welcome! We're so glad you're here 😍
Sensors help to wait for an event to happen before getting executed.
With Sensors, you can take your data pipelines to the next level and cover a variety of new use cases.
🎯Objectives
At the end of this course, you'll be able to:
- Define a Sensor
- Identify use cases where to use a Sensor
- Implement a Sensor to check if an API is available
- Use the task sensor decorator
👥 Audience
Who should take this course:
- Data Engineers
- Data Analysts
- Software Engineers
- Data Scientists
Set aside 10 minutes to complete the course.
💻 Setup Requirements
You need to have the following:
- Docker and Docker compose on your computer (cf: get Docker)
- The Astro CLI
- Access to a web browser