Astro: HTTP Provider

Astro: HTTP Provider

Interact with HTTP Resources by making Web Requests to an API.

rate limit

Code not recognized.

Overview

Welcome! We're so glad you're here 😍

Do you want to make CRUD requests to external APIs using airflow.

Or maybe you want to wait until a webserver responds with a particular status code.

Or maybe you want to keep a session authenticated and make several requests to it.

Well the HTTP Provider comes with Operators, Hook & Sensor that allows you to interact with external webservers by using a connection that has the necessary authentication details.

🎯Objectives

At the end of this course, you'll be able to:

  • Perform CRUD operations on an endpoint.
  • Transfer data from a HTTP operator to another task.
  • Connect to endpoints using HTTP and HTTPS protocol
  • Use HTTP Sensor to wait for a particular response from a server

👥 Audience

Who should take this course:

  • Data Engineers
  • Data Analysts
  • Software Engineers

Set aside 45 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

  • Docker and Docker compose on your computer (cf: get Docker)
  • The Astro CLI
  • An internet connection with permission to access SWAPI website
  • Access to a web browser

Curriculum0 hr 35 min

  • Introduction
  • Welcome 0 hr 1 min
  • Objectives
  • Getting Started
  • Set up Connection - SWAPI 0 hr 3 min
  • Interacting with SWAPI 0 hr 4 min
  • Practice: Find the Movie Titles
  • Best Practices
  • Hooking the Server
  • Set up Connection - RestfulBooker 0 hr 2 min
  • Interact with a server using HttpHook 0 hr 5 min
  • Practice: Make requests using the Hook
  • Additional Info
  • Make your Bookings using HttpOperator
  • Filtering the Web Response 0 hr 5 min
  • Transferring Data for CRUD operation 0 hr 4 min
  • Practice: Book a Dinner instead
  • Waiting for Status 200
  • Setting up a Sensor 0 hr 4 min
  • Waiting for Status 200 0 hr 5 min
  • Practice: Alert on 500
  • Defer the Http Sensor 0 hr 3 min
  • Finishing up...
  • Quiz
  • Resources
  • Summary
  • How was it?

Overview

Welcome! We're so glad you're here 😍

Do you want to make CRUD requests to external APIs using airflow.

Or maybe you want to wait until a webserver responds with a particular status code.

Or maybe you want to keep a session authenticated and make several requests to it.

Well the HTTP Provider comes with Operators, Hook & Sensor that allows you to interact with external webservers by using a connection that has the necessary authentication details.

🎯Objectives

At the end of this course, you'll be able to:

  • Perform CRUD operations on an endpoint.
  • Transfer data from a HTTP operator to another task.
  • Connect to endpoints using HTTP and HTTPS protocol
  • Use HTTP Sensor to wait for a particular response from a server

👥 Audience

Who should take this course:

  • Data Engineers
  • Data Analysts
  • Software Engineers

Set aside 45 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

  • Docker and Docker compose on your computer (cf: get Docker)
  • The Astro CLI
  • An internet connection with permission to access SWAPI website
  • Access to a web browser

Curriculum0 hr 35 min

  • Introduction
  • Welcome 0 hr 1 min
  • Objectives
  • Getting Started
  • Set up Connection - SWAPI 0 hr 3 min
  • Interacting with SWAPI 0 hr 4 min
  • Practice: Find the Movie Titles
  • Best Practices
  • Hooking the Server
  • Set up Connection - RestfulBooker 0 hr 2 min
  • Interact with a server using HttpHook 0 hr 5 min
  • Practice: Make requests using the Hook
  • Additional Info
  • Make your Bookings using HttpOperator
  • Filtering the Web Response 0 hr 5 min
  • Transferring Data for CRUD operation 0 hr 4 min
  • Practice: Book a Dinner instead
  • Waiting for Status 200
  • Setting up a Sensor 0 hr 4 min
  • Waiting for Status 200 0 hr 5 min
  • Practice: Alert on 500
  • Defer the Http Sensor 0 hr 3 min
  • Finishing up...
  • Quiz
  • Resources
  • Summary
  • How was it?