Airflow: Taskflow API

Airflow: Taskflow API

Learn how to use the Taskflow API to create DAGs faster.

rate limit

Code not recognized.

Overview

Welcome! We're so glad you're here 😍

The Taskflow API drastically improves your development experience with DAGs

Creating tasks and sharing data between them has never been easier.

Your DAGs will become easier to read, develop, and maintain.

🎯Objectives

At the end of this course, you'll be able to:

  • Define what’s the Taskflow API
  • Differentiate between Decorators and Classic Operators
  • Share data efficiently with XComArgs
  • Develop DAGs with the TaskflowAPI
  • Use map and zip to extend DAG capabilities

👥 Audience

Who should take this course:

  • Data Engineers
  • Data Scientists

Set aside 30 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

Curriculum0 hr 28 min

  • Introduction
  • Welcome! 0 hr 1 min
  • Why Taskflow? 0 hr 2 min
  • What's Taskflow? 0 hr 1 min
  • Component 1: The Decorators
  • Discover the Decorators 0 hr 2 min
  • Build the cleanest DAG 0 hr 3 min
  • Configuring task decorators 0 hr 1 min
  • Accessing context from Decorators 0 hr 2 min
  • Component 2: The XComArgs
  • Discover the XComArgs 0 hr 4 min
  • Practice: Sharing many XComs with Taskflow
  • The most efficient way to share data 0 hr 4 min
  • Sharing data between Classic Operators 0 hr 2 min
  • Sharing data between Decorators and Classic Operators 0 hr 3 min
  • The secret awesome features!
  • 🤫 Map 0 hr 4 min
  • 🤫 Zip
  • Finishing up...
  • Quiz!
  • How was it?

Overview

Welcome! We're so glad you're here 😍

The Taskflow API drastically improves your development experience with DAGs

Creating tasks and sharing data between them has never been easier.

Your DAGs will become easier to read, develop, and maintain.

🎯Objectives

At the end of this course, you'll be able to:

  • Define what’s the Taskflow API
  • Differentiate between Decorators and Classic Operators
  • Share data efficiently with XComArgs
  • Develop DAGs with the TaskflowAPI
  • Use map and zip to extend DAG capabilities

👥 Audience

Who should take this course:

  • Data Engineers
  • Data Scientists

Set aside 30 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

Curriculum0 hr 28 min

  • Introduction
  • Welcome! 0 hr 1 min
  • Why Taskflow? 0 hr 2 min
  • What's Taskflow? 0 hr 1 min
  • Component 1: The Decorators
  • Discover the Decorators 0 hr 2 min
  • Build the cleanest DAG 0 hr 3 min
  • Configuring task decorators 0 hr 1 min
  • Accessing context from Decorators 0 hr 2 min
  • Component 2: The XComArgs
  • Discover the XComArgs 0 hr 4 min
  • Practice: Sharing many XComs with Taskflow
  • The most efficient way to share data 0 hr 4 min
  • Sharing data between Classic Operators 0 hr 2 min
  • Sharing data between Decorators and Classic Operators 0 hr 3 min
  • The secret awesome features!
  • 🤫 Map 0 hr 4 min
  • 🤫 Zip
  • Finishing up...
  • Quiz!
  • How was it?