Apache Airflow From Basics To Mastery

Apache Airflow From Basics To Mastery
Published 3/2025
MP4 | Video: h264, 1920×1080 | Audio: AAC, 44.1 KHz

Learn Apache Airflow with practical examples and build efficient, scalable data pipelines

What you’ll learn

How to write complex pipelines with just a few lines of code

The look and feel of the Airflow tool and its ecosystem

Step-by-step guidance on moving from simple to complex system components

How to avoid mistakes and understand why they happen

You will learn through practical examples based on common real-world usage

Requirements

You should be familiar with the basics of Python

Description

Overview

Section 1: Introduction

Lecture 1 Introduction

Section 2: Development environment

Lecture 2 How to create development environment

Section 3: Airflow ecosystem

Lecture 3 Airflow ecosystem

Section 4: How to Create Your First DAG

Lecture 4 How to Create Your First DAG

Lecture 5 Branching and trigger rules

Section 5: Decorators

Lecture 6 @dag and @task decorators

Lecture 7 Dynamic tasks and task group

Lecture 8 BashOperator

Section 6: Hooks

Lecture 9 AWS S3 Hook

Lecture 10 Postgres Hook

Section 7: Sensors

Lecture 11 S3 Sensor

Lecture 12 SQL Sensor

Section 8: Scheduling

Lecture 13 Scheduling and datasets

Section 9: Additional information

Lecture 14 Integration with DBT

Lecture 15 Versioning code in GIT

Lecture 16 Storing passwords with Fernet key

Lecture 17 Roles and Access Control

This course is for anyone looking to boost their Airflow skills or use it regularly for workflow automation