byteorgshiva / introduction-to-workflow-management-platform-airflow Goto Github PK
View Code? Open in Web Editor NEWThis project forked from develop-packt/introduction-to-workflow-management-platform-airflow
In this module, you will look at creating a pipeline by breaking down a job into multiple executable stages. You will implement a simple linear pipeline and then move further by implementing a multi-stage data pipeline, then automate the multi-stage pipeline using Bash. Further to this you will improve the efficiency by running the pipeline as an asynchronous process using the ETL workflow and then create DAG for the pipeline and implement it using Airflow.
License: MIT License