Comments (9)
Okay we will be reconsidering it
from druid-exporter.
You can list the status of the task by using PromQL, like:-
count(druid_tasks_duration{task_status=!""}) by (task_status)
from druid-exporter.
Means I have to add custom rules on prometheus-adapter for a metrics which should be standard. I propose you reconsider this.
from druid-exporter.
Please use this release https://github.com/opstree/druid-exporter/releases/tag/v0.9. metrics are added
druid_running_tasks
druid_waiting_tasks
druid_completed_tasks
druid_pending_tasks
from druid-exporter.
Looks working. Thanks a lot!
from druid-exporter.
@schmichri Can you share on how you plan to deploy HPA with only task metrics?
from druid-exporter.
@Aka-shi : I plan so scale a middlemanager (statefulset) when there are too many pending tasks. The metrics are thanks to @iamabhishek-dubey are available now.
from druid-exporter.
Hey, @schmichri I understand the scale up. What I am more concerned is the scale down, if you are deploying HPA and when the controller scales up the middle manager pods based on pending tasks, the pending tasks count itself would become zero(ideally) which would in some time trigger a scale down.
IMO, to properly scale up or down, we would also need the total worker capacity of the druid cluster and after that we can use this ratio sum(druid_pending_tasks + druid_running_tasks)/druid_worker_capacity_total
. This would give a fair ratio to scale up/down. Thoughts?
from druid-exporter.
You are right. Didn't thought this through.
from druid-exporter.
Related Issues (20)
- Stopped Working Unexpectedly
- Exporter override metrics value if there is more than one task in parallel HOT 3
- Issue while integrating druid-exporter to grafana
- Ability to disable / blacklist metrics HOT 6
- New release any time soon? HOT 2
- last version doesn't work in multi-node cluster HOT 4
- Prometheus doesn't seem to be scraping "/metrics" HOT 1
- Helm chart 0.11.0 on the helm repo seems to be outdated HOT 3
- Some coordinator metrics not populated properly HOT 1
- Histogram of Query Time Taken HOT 1
- Memory leak and exporter becomes unresponsive over time HOT 2
- dutyGroup dimension missing from coordinator metrics HOT 1
- Unable to visualize jvm pool related dimensions inside grafana HOT 1
- Possibility of listening exporter to custom interface HOT 3
- Missing Indexer Metrics HOT 1
- Druid exporter is emitting huge metrics HOT 2
- Druid exporter is fetching more metrics HOT 1
- Can you create new latest docker image of druid-exporter HOT 1
- Cannot parse JSON data: invalid character '<' looking for beginning of value HOT 2
- Error: http panic after upgrading from Druid 25.0.0 to Druid 29.0.0 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from druid-exporter.