Comments (15)
Sure I will be fixing this soon
from druid-exporter.
Please use this version of release
https://github.com/opstree/druid-exporter/releases/tag/v0.3
from druid-exporter.
and another one (
An error has occurred while serving metrics:
10 error(s) occurred:
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:10.764Z" > label:<name:"datasource" value:"xxx-impressions" > label:<name:"index_group_id" value:"index_kafka_xxx-impressions" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:10.841Z" > label:<name:"datasource" value:"xxx-bids" > label:<name:"index_group_id" value:"index_kafka_xxx-bids" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:10.911Z" > label:<name:"datasource" value:"xxx-bids" > label:<name:"index_group_id" value:"index_kafka_xxx-bids" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:10.967Z" > label:<name:"datasource" value:"xxx-ad-data" > label:<name:"index_group_id" value:"index_kafka_xxx-ad-data" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:10.967Z" > label:<name:"datasource" value:"xxx-invalid-events" > label:<name:"index_group_id" value:"index_kafka_xxx-invalid-events" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:10.967Z" > label:<name:"datasource" value:"auction-events" > label:<name:"index_group_id" value:"index_kafka_auction-events" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:10.967Z" > label:<name:"datasource" value:"xxx-openrtb-events" > label:<name:"index_group_id" value:"index_kafka_xxx-openrtb-events" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:11.001Z" > label:<name:"datasource" value:"xxx-ad-data" > label:<name:"index_group_id" value:"index_kafka_xxx-ad-data" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:11.001Z" > label:<name:"datasource" value:"ad-requests" > label:<name:"index_group_id" value:"index_kafka_ad-requests" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
* collected metric "druid_tasks" { label:<name:"created_time" value:"2020-05-18T15:22:11.022Z" > label:<name:"datasource" value:"auction-events" > label:<name:"index_group_id" value:"index_kafka_auction-events" > label:<name:"task_status" value:"RUNNING" > gauge:<value:1 > } was collected before with the same name and label values
from druid-exporter.
Thank You!
It seems duplicate errors still exist.
collected metric "druid_tasks_status_duration" { label:<name:"created_time" value:"2020-05-19T17:26:54.179Z" > label:<name:"datasource" value:"xxx-clicks" > label:<name:"index_group_id" value:"index_kafka_xxx-clicks" > label:<name:"task_status" value:"RUNNING" > gauge:<value:0 > } was collected before with the same name and label values
from druid-exporter.
I'll check this shouldn't be the case. I guess the API is returning the duplicate tasks.
from druid-exporter.
Is there a way to skip this error? Or another way how to avoid this.
Thank You!
from druid-exporter.
It needs development effort, but don't worry I will fix this by tomorrow
from druid-exporter.
Hopefully, this will fix your problem for task name duplication
https://github.com/opstree/druid-exporter/releases/tag/v0.3
I have updated the same release for you. Let me know if the issue still persist
from druid-exporter.
Thanks for your patience and quick response.
After latest fixes something wrong with "count(druid_tasks_duration) by (task_status)"
from druid-exporter.
So task details are the information that druid is fetching not emitted. So you should configure your scrape interval in the Prometheus job block. I guess by default it is seconds.
from druid-exporter.
- job_name: druid_monitoring
honor_timestamps: true
scrape_interval: 1m
scrape_timeout: 10s
metrics_path: /metrics
...
This is my config for druid's job.
from druid-exporter.
- job_name: druid_monitoring
honor_timestamps: true
scrape_interval: 10s
scrape_timeout: 10s
metrics_path: /metrics
Change scrape_interval to 10s
from druid-exporter.
Thank You for advice.
It seems after restart exporter data was changed. Strange behaviour...
from druid-exporter.
Yes, I am correct. After restart an exporter the date became the same as in the druid console.
And seems like it isn't just for druid_tasks_duration
.
from druid-exporter.
I checked exporter's logs, data from druid/indexer/v1/tasks
is grabbing only once after start/restart, I guess it is a cause of my issues.
{"level":"info","msg":"GET request is successful for druid api","ts":"2020-05-21T06:42:43.732Z","url":"http://data:8888/druid/indexer/v1/tasks"}
{"level":"info","msg":"Successfully retrieved the data for druid's supervisors tasks","ts":"2020-05-21T06:42:43.742Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.769Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.770Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.771Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"err":"strconv.ParseFloat: parsing \"\u003cnil\u003e\": invalid syntax","level":"error","msg":"Unable to parse the duration value","ts":"2020-05-21T06:42:43.772Z"}
{"level":"info","msg":"Druid exporter started listening on :7072","ts":"2020-05-21T06:42:43.772Z"}
from druid-exporter.
Related Issues (20)
- Exporter override metrics value if there is more than one task in parallel HOT 3
- Issue while integrating druid-exporter to grafana
- Ability to disable / blacklist metrics HOT 6
- New release any time soon? HOT 2
- last version doesn't work in multi-node cluster HOT 4
- Prometheus doesn't seem to be scraping "/metrics" HOT 1
- Helm chart 0.11.0 on the helm repo seems to be outdated HOT 3
- Some coordinator metrics not populated properly HOT 1
- Histogram of Query Time Taken HOT 1
- Memory leak and exporter becomes unresponsive over time HOT 2
- dutyGroup dimension missing from coordinator metrics HOT 1
- Unable to visualize jvm pool related dimensions inside grafana HOT 1
- Possibility of listening exporter to custom interface HOT 3
- Missing Indexer Metrics HOT 1
- Druid exporter is emitting huge metrics HOT 2
- Druid exporter is fetching more metrics HOT 1
- Can you create new latest docker image of druid-exporter HOT 1
- Cannot parse JSON data: invalid character '<' looking for beginning of value HOT 2
- Error: http panic after upgrading from Druid 25.0.0 to Druid 29.0.0 HOT 1
- How to get datasources metrics ?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from druid-exporter.