Articles liés à Apache Airflow in Action: Automate and scale cloud...

Apache Airflow in Action: Automate and scale cloud data pipelines with ease (English Edition) - Couverture souple

Ahmed Syed, Imran

 
9789378547195: Apache Airflow in Action: Automate and scale cloud data pipelines with ease (English Edition)
Couverture souple
ISBN 10 : 9378547192 ISBN 13 : 9789378547195
Editeur : BPB Publications, 2026

Synopsis

Apache Airflow cemented its position as the de facto workflow automation and data orchestration tool; hence, mastering Airflow has become critical for ensuring data reliability and operational efficiency. As Airflow enters the version 3.0 era, shifting towards a decentralized, service-oriented architecture with a native focus on data assets, staying ahead of its design patterns is important for modern data teams.

This book provides a comprehensive journey through the modern patterns of data orchestration. Readers will start with the origins and architecture of Airflow, followed by installation and configuration, core and special features, logging and monitoring, and popular managed versions. Each chapter delivers practical and hands-on insights that will help readers to practice side-by-side.

By the end of this book, readers will possess the practical competencies required to design, develop, test, and deploy production-grade pipelines. Readers will also gain invaluable skills in the latest asset-centric development, micro-orchestration, and modern CI/CD practices, turning them into highly capable engineers ready to tackle complex, enterprise-scale data infrastructure challenges.

What you will learn

● Learn Airflow components and core operational architectures.

● Install and configure a local environment on your machine.

● Design efficient DAGs using foundational operators.

● Manage execution with XComs and hooks.

● Implement flexible scheduling, triggering mechanisms, and robust monitoring.

● Understand and relate how different providers are supporting managed instances.

● New features in 3.0 and major shifts from the previous version.

Who this book is for

The book is designed for data, analytics, and MLOps engineers alongside data scientists with basic Python, CLI, and database familiarity. It guides beginners from core concepts to intermediate-level production scaling, debugging, and automating cloud-based ETL and machine learning workflows.

Table of Contents

1. Getting to Know Airflow

2. Installing and Configuring

3. The Power of DAGs

4. Operators and Sensors

5. Scheduling and Triggering

6. Monitoring and Logging

7. Managed Airflow Services

8. Specialized Features

9. Modernizing Orchestration with Airflow 3.0

10. Hands-on Example to Write Your First DAG

Les informations fournies dans la section « Synopsis » peuvent faire référence à une autre édition de ce titre.

À propos de l'auteur

Imran A Syed is a data architect and engineer with over 19 years of experience; designing and implementing data pipelines across data lakehouse and warehouse applications.

Les informations fournies dans la section « A propos du livre » peuvent faire référence à une autre édition de ce titre.

Éditeur
BPB Publications
Date d'édition
2026
Langue
anglais
ISBN 10 
9378547192
ISBN 13 
9789378547195
Reliure
Broché
Nombre de pages
306
Coordonnées du fabricant
Manufactured by Amazon on behalf of the author
https://www.amazon.fr/hz/contact-us

c/o Amazon Media EU S.à.r.l., 38 Avenue John F. Kennedy
Luxembourg
L-1855
Luxembourg