Coder Social home page Coder Social logo

cauwulixuan / hadoop_exporter Goto Github PK

View Code? Open in Web Editor NEW
85.0 85.0 54.0 259 KB

A hadoop exporter for prometheus, scrape hadoop metrics (including HDFS, YARN, MAPREDUCE, HBASE. etc.) from hadoop components jmx url.

Python 99.83% Smarty 0.17%
exporter hadoop prometheus

hadoop_exporter's People

Contributors

cauwulixuan avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

hadoop_exporter's Issues

services-api 是什么?并没有说明

执行命令报错
[root@rhel6-140 hadoop_exporter-master]# python hadoop_exporter.py -c bigdata -hdfs http://XXX:50070/jmx
usage: hadoop_exporter.py [-h] [-c cluster_name] -s services_api
[-hdfs namenode_jmx_url]
[-rm resourcemanager_jmx_url] [-dn datanode_jmx_url]
[-jn journalnode_jmx_url] [-mr mapreduce2_jmx_url]
[-nm nodemanager_jmx_url] [-hbase hbase_jmx_url]
[-rs regionserver_jmx_url] [-hive hive_jmx_url]
[-ld llapdaemon_jmx_url] [-p metrics_path]
[-host ip_or_hostname] [-P port]
hadoop_exporter.py: error: argument -s/--services-api is required

services-api 是什么?并没有说明

hive_server.py run error

File "/home/gw/module/hadoop_exporter-master/cmd/hive_server.py", line 52, in collect
self._get_metrics(beans)
File "/home/gw/module/hadoop_exporter-master/cmd/hive_server.py", line 160, in _get_metrics
self._get_node_metrics(beans[i], service, host)
UnboundLocalError: local variable 'host' referenced before assignment

Running the exporter for more than one service in dockerfile

In my docker file I can only trace one hdfs service per hadoop exporter container, which means if i need to get all the metrics from a 12 container hdfs cluster, i will need to create 12 exporter containers. How can i configure the container in a way i can get namenode,datanode,journalnode metrics in one container?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.