techindicium / dbt-dag-monitoring Goto Github PK
View Code? Open in Web Editor NEWdbt package for monitoring airflow DAGs and tasks
License: Apache License 2.0
dbt package for monitoring airflow DAGs and tasks
License: Apache License 2.0
Add some kind CI/CD + tests
dim_dates
for dbt Model dbt_dag_monitoring
The macro dim_dag_monitoring_dates
and the macro dim_dag_monitoring_task
used in the dbt model dbt_dag_monitoring
currently lacks the BigQuery adapter implementation, causing errors when running the model on a BigQuery environment.
The macros should be adaptable to different database adapters, including BigQuery. When using the dbt_dag_monitoring
model with a BigQuery adapter, it should work seamlessly without causing errors or requiring manual adjustments.
When running dbt_dag_monitoring
on a BigQuery environment, the following error occurs:
This indicates that the macro dim_dates
isn't handling BigQuery correctly, leading to failure when processing date-related operations.
dbt_dag_monitoring
model in your project.dbt run
.dim_dates
macro.Add support for the BigQuery adapter in the dim_dag_monitoring_dates
and the dim_dag_monitoring_task
macros:
Thank you for your attention to this issue. Please let me know if you need additional information or context.
We started this as an Airflow monitoring project but now we`ve expanded to dags tooling in general.
We should rename specific Airflow names to some dag terminology e.g. change the name of the repo itself from dbt-airflow-monitoring to dbt-dag-monitoring
Today we can only enable one of the three options, sometimes we will have more than one e.g. both databricks and adf
The command dbt build isn't taking the information from the folder integration_tests
maybe we should change the unique key for pipelines instead of deduping here. etag is the pipeline version, we are using it for deduping
(suggestion given by vitoravancini - extracted from README.md)
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.