Comments (11)
I had a similar problem. In my case the exception message was like "airflow.exception.SerializedDagNoFound: DAG 'None' not found in serialized_dag table". Fixed with following query in airflow database:
DELETE FROM dag_run WHERE dag_id IS NULL;
from airflow-exporter.
Interesting, thanks for reporting.
from airflow-exporter.
@nvn01234
I experienced the same thing.
In my case, the error occurred if it disappeared from UI due to git-sync but remained in the DB
you solve this error just delete dag from DB. Use airflow cli airflow dags delete <dag_id> -y
from airflow-exporter.
Hi, everyone!
If anyone would have time to create a PR that fixes it, I would be grateful. Fix should not be too complex.
from airflow-exporter.
@elephantum How should I fix it?
just fix it to ignore airflow.exceptions.SerializedDagNotFound
?
from airflow-exporter.
I would suggest altering sqlalchemy query for this case, most probably simple join with dag table would be enough.
I.e. filter out such tasks and dags that do not have corresponding dag in DB.
from airflow-exporter.
@elephantum #105 I create PR
Thank you for the opportunity.😁😁
from airflow-exporter.
Experienced it as well.
from airflow-exporter.
Same issue here, with airflow-exporter 1.5.1,
and airflow 1.10.15, (where for some very old dags we do not have serialized_dag
entries, as we only enabled that option few weeks ago in preparation for the Airflow 2.x update), but it will be an issue when I upgrade to 2.x, because we will be preserving full history.
I have a single dag in dag
table, that is no longer available. Looking at postgresql database it has is_paused false, is_subdag false, is_active false.
from airflow-exporter.
Fixed in v1.5.2
from airflow-exporter.
Excellent, it works. Thanks @sawaca96 and @elephantum
from airflow-exporter.
Related Issues (20)
- How can I export metrics to prometheus or grafana? HOT 2
- Integration with MWAA AWS?
- Sqlalchemy error with Airflow 2.0.1 HOT 5
- PyPI source package HOT 2
- airflow v2.1.3 webserver failing to start after installing latest airflow-exporter HOT 2
- airflow exporter is failing on /admin/metrics page HOT 4
- Bug with state is null in dag_run table
- Custom labels not working after upgrade to Airflow 2.3.1 HOT 1
- PostgreSQL CPU consumption HOT 1
- Custom labels not working in Airflow 2.3.3
- [question] What would be the right Servicemonitor configuration for Kubernetes?
- Add a label to indicate if DAG is paused or not
- Plugin broken with Airflow 1.10.14 HOT 10
- Not getting metrics after pip install in container HOT 6
- Tests for recent Airflow versions: 1.10.12+
- Not compatible with 2.0.0 HOT 7
- Plugin loaded multiple times in webserver HOT 2
- [question] - airflow-exporter vs. StatsD HOT 3
- Exporter fails with MySQL: get_dag_duration_info HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from airflow-exporter.