Comments (2)
Hi @13416157913 ,
you nee the fsimage data available on a local path.
I recommend to run the exporter on the same instance as the NameNode, to avoid having to transfer the (possibly large) fsimage over the network.
If you can not avoid it, create e.g. a script periodically copying it from the NameNode (copy to local FS and rename it to location watched by the exporter).
Using hdfs dfsadmin -fetchImage...
is IMHO not a solution, as it puts too much load on the NameNode..
from hadoop-hdfs-fsimage-exporter.
Hi @13416157913 ,
you nee the fsimage data available on a local path.
I recommend to run the exporter on the same instance as the NameNode, to avoid having to transfer the (possibly large) fsimage over the network.
If you can not avoid it, create e.g. a script periodically copying it from the NameNode (copy to local FS and rename it to location watched by the exporter).
Using
hdfs dfsadmin -fetchImage...
is IMHO not a solution, as it puts too much load on the NameNode..
Thanks your answer.
from hadoop-hdfs-fsimage-exporter.
Related Issues (20)
- Switch container OpenJDK base image to azul/zulu-openjdk-alpine:17.0.3-jre-headless
- Export all default exporter JVM metrics
- Migrate to reload4j
- Update HFSA to 1.3.5
- Update Prometheus simpleclient to 0.16.0
- Docker configuration folder changed HOT 1
- config.yml paths How do I support cross-directory re syntax HOT 3
- Extend path regexp matching
- Update hfsa lib to 1.3.7
- Update docker base image to JDK 17.0.4
- Whitelisting or blacklisting metrics HOT 4
- Update snakeyaml to 1.31
- Update snakeyaml to 1.33
- Update HFSA lib to 1.3.8
- Update docker base image to OpenJDK 17.0.5
- Update JMH to 1.36 (test scope only)
- Fsimage metrics are not getting exported HOT 3
- Update container base image to latest JVM 17.0.6
- Update container base image to latest JVM 17.0.7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hadoop-hdfs-fsimage-exporter.