Awesome
airflow-diagrams
Auto-generated Diagrams from Airflow DAGs. đŽ đĒ
This project aims to easily visualise your Airflow DAGs on service level from providers like AWS, GCP, Azure, etc. via diagrams.
Before | After |
---|---|
đ Get started
To install it from PyPI run:
pip install airflow-diagrams
NOTE: Make sure you have Graphviz installed.
Then just call it like this:
Examples of generated diagrams can be found in the examples directory.
đ¤ How it Works
- âšī¸ It connects, by using the official Apache Airflow Python Client, to your Airflow installation to retrieve all DAGs (in case you don't specify any
dag_id
) and all Tasks for the DAG(s). - đĒ It processes every DAG and its Tasks and đŽ tries to find a diagram node for every DAGs task, by using Fuzzy String Matching, that matches the most. If you are unhappy about the match you can also provide a
mapping.yml
file to statically map from Airflow task to diagram node. - đ¨ It renders the results into a python file which can then be executed to retrieve the rendered diagram. đ
â¤ī¸ Contributing
Contributions are very welcome. Please go ahead and raise an issue if you have one or open a PR. Thank you.