Astro: Secrets Backend

About this course

Welcome! We're so glad you're here 😍

Apache Airflow variables and connections often contain sensitive information about your external systems that should be kept secret in a secure, centralized location that complies with your organization's security requirements.

While secret values of Airflow variables and connections are encrypted in the Airflow metadata database of every Deployment, integrating with a secrets backend tool is highly recommended.

So if you wanna learn about a wonderful way to keep secrets secure through Astro by configuring your very own external secrets backend, then it's gonna be a lot easier than you think.

🎯Objectives

At the end of this course, you'll be able to:

Primary: Configure secrets backend on Astro using the AWS Parameter Store using:
- Variables
- Connections
Secondary: Demonstrate an understanding of key concepts around secrets backend with Astro

👥 Audience

Who should take this course:

Data Engineers
DevOps Engineer
Platform Engineers

Set aside 20 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

Docker and Docker compose on your computer (cf: get Docker)
The Astro CLI
Access to a web browser
AWS account

Curriculum0 hr 13 min

Introduction
Welcome! 0 hr 2 min
Intro to Secrets Management 0 hr 3 min
Prerequisites...
Method
The AWS Parameter Store 0 hr 2 min
Local Configuration 0 hr 2 min
Testing with a DAG 0 hr 2 min
Deploy to Astro! 0 hr 2 min
Test Your Learning
Hands-On Exercise
Best Practices & Tips
Activity: Integrate HashiCorp Vault
Finishing Up...
Quiz!
Summary
Wrap-Up 0 hr 1 min
Resources
How was it?

About this course