How can I get the total number of files in hdfs? about hadoop-hdfs-fsimage-exporter

[marcelmay]

You can use

• fsimage_fsize_count for total number of files (I think that's your case)
• fsimage_user_fsize_count{user_name="foo"} for number of files by users, eg for user 'foo'
• fsimage_group_fsize_count{group_name="root"} for number of files by group, eg for group 'root'

fsize is of type Histogram, so you get the sum of byte (_sum) but also the number (_count),
and the distribution (_bucket). The distribution can help spotting users with too many small files.

[zhangxingdeppon]

You can use

• fsimage_fsize_count for total number of files (I think that's your case)
• fsimage_user_fsize_count{user_name="foo"} for number of files by users, eg for user 'foo'
• fsimage_group_fsize_count{group_name="root"} for number of files by group, eg for group 'root'

fsize is of type Histogram, so you get the sum of byte (_sum) but also the number (_count),
and the distribution (_bucket). The distribution can help spotting users with too many small files.

ok, got it, thanks.

[marcelmay]

FYI, I added documentation on the metrics exposed.