Airflow: Trigger Rules

Airflow: Trigger Rules

Learn how to effectively control the task execution flow using trigger rules.

rate limit

Code not recognized.

About this course

Welcome! We're so glad you're here 😍

Want to modify the execution flow of your data pipelines? Well by default, Airflow will wait for all upstream tasks for a task to be successful before it runs that task.

However, this behaviour is configurable and you can control it using the trigger_rule argument to a Task.

Trigger rules opens for you a ton of possibilities to modify the way your tasks are executed.

Let's learn what trigger rules to use in which use case.

🎯Objectives

At the end of this course, you'll be able to:

  • Define trigger rules and which one to use accordingly
  • Modify the execution path of a DAG
  • Avoid the common pitfalls with Branching and DAGRuns

👥 Audience

Who should take this course:

  • Data Engineers
  • Data Analysts
  • Software Engineers

Set aside 9 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

Curriculum0 hr 6 min

  • Introduction
  • Welcome! 0 hr 1 min
  • Why Trigger Rules? 0 hr 1 min
  • Default behaviour 0 hr 1 min
  • The 3 types of trigger rules
  • The all rules 0 hr 1 min
  • The one rules 0 hr 1 min
  • Practice: Get notified
  • The none rules 0 hr 1 min
  • Common pitfalls
  • The cascading effect 0 hr 1 min
  • Practice: Apply trigger rules with Branching
  • Finishing up...
  • Quiz!
  • Summary
  • How was it?

About this course

Welcome! We're so glad you're here 😍

Want to modify the execution flow of your data pipelines? Well by default, Airflow will wait for all upstream tasks for a task to be successful before it runs that task.

However, this behaviour is configurable and you can control it using the trigger_rule argument to a Task.

Trigger rules opens for you a ton of possibilities to modify the way your tasks are executed.

Let's learn what trigger rules to use in which use case.

🎯Objectives

At the end of this course, you'll be able to:

  • Define trigger rules and which one to use accordingly
  • Modify the execution path of a DAG
  • Avoid the common pitfalls with Branching and DAGRuns

👥 Audience

Who should take this course:

  • Data Engineers
  • Data Analysts
  • Software Engineers

Set aside 9 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

Curriculum0 hr 6 min

  • Introduction
  • Welcome! 0 hr 1 min
  • Why Trigger Rules? 0 hr 1 min
  • Default behaviour 0 hr 1 min
  • The 3 types of trigger rules
  • The all rules 0 hr 1 min
  • The one rules 0 hr 1 min
  • Practice: Get notified
  • The none rules 0 hr 1 min
  • Common pitfalls
  • The cascading effect 0 hr 1 min
  • Practice: Apply trigger rules with Branching
  • Finishing up...
  • Quiz!
  • Summary
  • How was it?