ccfos / nightingale Goto Github PK

An all-in-one observability solution which aims to combine the advantages of Prometheus and Grafana. It manages alert rules and visualizes metrics, logs, traces in a beautiful web UI.

Home Page: https://flashcat.cloud/docs/

License: Apache License 2.0

Go 91.77% Python 7.08% Smarty 0.87% Makefile 0.15% Shell 0.11% Dockerfile 0.02%

monitoring time-series nightingale tsdb open-falcon alerting metrics observability ccf

nightingale's People

Contributors

Stargazers

Watchers

Forkers

sdgdsffdsfff goarchiver zhanglei wang-shun 51coder resigmund lifehacking itcrown macaty beaver-company soarpenguin xlwh yindashan willpyshan13 jamesbond111 mistshi jackson10291011 shuiminglin freedomkk-qfeng lihong12500 1920853199 llitfkitfk realm2go m00zh33 qt-pay ethan-2017 piano-wow susunola whantt cw2030 reference-project zwunix jackey925 delkyd chengyh2golang redhare-ma sodaicenai techkie qiqiaobin yagetang liyongyan wangduogit eailoo higkoo smewl wulorn walnut-tom xmlgrg bilalrahim jangocheng yunhostnet zzti taylorzhou mfrank2016 crazylsq chengang2 johnny-face marchhu chly1103 tchigher lts120784620 5l1v3r1 hongleixia gonwalk yuxin02 orjuly xiaodi2015 greyireland xchiefx iobond yimeng missiletcy sam138115 dut3062796s xqzhang2015 withgame xiejiashuai wanglonghuan hzgcoding carcoon igit-cn czxyzqs zxlnet shuke163 whoneed konmoron stlcours zerolugithub menwaichong l1-j5n windrivder yuanleilei progpark gordonkk dongcd xdnice swzhaogang lyrl thtantos soolaugust

nightingale's Issues

测试使用有几个问题

现有的mail-sender貌似不支持o365邮箱发件
我在指定节点新增关于端口的采集配置，然后我将次采集配置删除，但监控图表中仍有此端口的选项
是否可以将url监控做到控制台
用户权限这块，是否可以增加人和目录树的关联，只能看指定目录树的图表
相同的报警策略，根节点配置了，子节点也配置了，但告警接收人不同，那么子节点的人收到了，根节点的人还能收到吗
是否可以有个清单，比如那些常规监控的插件可以和open-falcon共用
关于短信的sender是否可以提供下，在社区不活跃并且不会编程的人来说，使用上还是有点问题的

与条件告警恢复无法触发

触发条件为与条件时，当告警恢复时，若第一个条件就没满足时，将直接退出，不触发恢复通知
if len(exps) == 1 {条件满足不了

ERROR rpc/push.go:74 send too many col ons in address

请问我用源码自己编译的，go version go1.12 linux/amd64。运行起来总是报这个错误。too many colons in address。网上流传的加中括号方案会直接导致退出运行，请问各位有遇到我这个问题吗？

地址为默认，安装在一台服务器上面。
PS:
2020-03-24 10:50:36.972499 ERROR rpc/push.go:74 send [0xc00008cc30] to
index addr:192.168.19.32:5831 fail: addr:192.168.19.32:5831 get connect
ion fail: conn , err address addr:192.168.19.32:5831: too many col
ons in address. proc: Name:addr:192.168.19.32:5831,Cnt:0,active:0,all:0
,free:0

[bug] 节点下对象勾选显示挂载节点报错

问题现象:
节点下对象勾选显示挂载节点报错

前端页面关于指标列表内的各个指标的中文提示怎么没有了？

指标列表内的各个指标的中文提示，看你们的视频里面是有的，我这边没有，是我的问题吗，还是你们给去掉了？如果是去掉了，那小白如何知道各个指标是做什么用的呢？

mac goland debug环境

goland address.local.yml找不到

debug src/modules/collector/collector.go 说是找不到address.local.yml

解决方案

website uptime

能否添加website uptime的监控和报警

agent install

Where can I download the agent client?

Judge模块取数问题

Judge模块在判断第一个规则的时候用linkedList.HistoryData(needCount)，如果监控指标在上报过程中丢点，是否存在取到判断周期外的数据

ubuntu18.04 glibc2.27 go build 后会报错，不知如何解决

# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/stdlib.h:25,
                 from _cgo_export.c:3:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/stdlib.h:25,
                 from vendor/github.com/open-falcon/rrdlite/rrd_c.go:4:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/stdlib.h:25,
                 from hash_32.c:61:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/stdlib.h:25,
                 from rrd_create.c:7:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/ctype.h:25:0,
                 from rrd_diff.c:38:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/stdlib.h:25,
                 from rrd_error.c:36:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_fetch.c:55:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_format.c:50:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/stdlib.h:25,
                 from rrd_hw.c:9:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_hw_math.c:5:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_hw_update.c:5:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_info.c:7:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/sys/types.h:25:0,
                 from rrd.h:55,
                 from rrd_nan_inf.c:15:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_open.c:9:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/stdlib.h:25,
                 from rrd_parsetime.c:118:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/limits.h:26,
                 from /usr/lib/gcc/x86_64-linux-gnu/7/include-fixed/limits.h:194,
                 from /usr/lib/gcc/x86_64-linux-gnu/7/include-fixed/syslimits.h:7,
                 from /usr/lib/gcc/x86_64-linux-gnu/7/include-fixed/limits.h:34,
                 from rrd_rpncalc.c:7:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_update.c:10:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_utils.c:24:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from rrd_config_bottom.h:14:0,
                 from rrd_config.h:397,
                 from rrd_tool.h:17,
                 from rrd_version.c:9:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~
# github.com/open-falcon/rrdlite
In file included from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33:0,
                 from /usr/include/stdlib.h:25,
                 from rrdfunc.c:1:
/usr/include/features.h:184:3: warning: #warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE" [-Wcpp]
 # warning "_BSD_SOURCE and _SVID_SOURCE are deprecated, use _DEFAULT_SOURCE"
   ^~~~~~~

有没有好的开机自启动服务方式

重启服务器后，每次得执行 ./control start all
centos7下面貌似加入/etc/rc.d/rc.local 中没有效果
可否考虑添加一个服务？

图表聚合问题

假如有endpoint、url、code三个tagk。
我需要根据url来group == 聚合，没生效。
1、结果没根据url来聚合
2、曲线的Legend也没对应更新

已经将nginx的配置文件更改为etc下配置文件，外网访问响应超时，目前不清楚原因

是我的操作有问题嘛，在服务器搭建的，访问指定端口提示响应超时，netstat -tlunp命令查看都是正常的，就是外面访问不到，nginx都能正常启动无报错

add

企业微信群机器人告警——求支持

目前的微信告警太繁琐了，直接使用机器人token会方便很多。如果可以在UI进行配置and支持配置告警模板，那就更好了

打包文件名优化

-rw-r--r--   1 spy  staff    64M Mar 23 18:15 n9e-2020-03-23-18-15-19.tar.gz

建议文件名改成：n9e-202003231815.targ.gz

首次登录强制修改登录密码

从安全角度出发，无论超管账户还是普通用户，在首次登录时强制修改密码，提升安全性。

往redis里加数据，是不是本应该是lpush，实际写成了RPUSH，因为我看微信告警读出是用rpop

for i := range RedisConnPools {
		rc := RedisConnPools[i].Get()
		defer rc.Close()

		// 写入用lpush 读出应该用 rpop
		stats.Counter.Set("redis.push", 1)
		_, err = rc.Do("RPUSH", event.Partition, string(bytes))

		if err == nil {
			succ = true
			break
		}
	}

支持 oidc 或者 oauth2 登录吗？

nightingale不兼容open-falcon的mymon插件？

测试nightingale 是否可以使用mymon插件，发现数据无法发送到本机的agent

2020/03/25 18:21:02.079 [E] [main.go:150] Send response 127.0.0.1:3306 -
2020/03/25 18:21:02.673 [E] [metric.go:333] Send alive data failed: Post http://127.0.0.1:2058/api/collector/push

是否是插件不兼容？

[bug] 树节点管理灰色的删除按钮点击后弹出删除确认框,但文字提示根节点不能删除

问题现象:
树节点管理灰色的删除按钮点击后弹出删除确认框,但文字提示根节点不能删除

提供tsdb生产扩容文档

English web interface

Please support i18n in the web interface, and add English translation.

Default language preference should be configurable.

About development roadmap

Thanks for nightngale-team's contributions.

nightngale is an awesome project on the monitoring system filed. And I want to know that does nightngale has a development roadmap about its future version?

collector是否只支持linux

支持windows吗？交叉编译报错

图表时间区间选了不生效

监控看图中，选定了时间<1小时><1天>，但是图表就是默认的1小时。选时间没有联动

endpoint的别名怎么在客户端设置

默认collector上报的endpoint是IP

一般我会在web上别名设置为主机名，将IP和主机名关联起来

如何在collector设置别名，自动上报上来

编译是文档中少了一步编译动作

https://n9e.didiyun.com/docs/install/compile/ 这个文档
cd nightingale && ./control pack
应该改为
cd nightingale && ./control build && ./control pack

能否支持计算历史记录，生成自动base-line，告警指标中增加baseline对比？

cat的告警有个功能，生成baseline，业务告警指标可以和baseline对比，这样告警更加符合实际情况，因为业务有平峰和高峰，和历史同期对比才有意义

reference: https://github.com/dianping/cat/wiki/business#%E5%9F%BA%E7%BA%BF

spring项目和数据库监控

请问java spring项目和数据库可以进行监控吗？

server.go:3061: http: Accept error: accept tcp [::]:5820: accept4: too many open files; retrying in 1s

日志logs/tsdb下面的stdout.log，一直在产生error：
2020/03/31 23:14:57 server.go:3061: http: Accept error: accept tcp [::]:5820: accept4: too many open files; retrying in 1s
2020/03/31 23:14:58 server.go:3061: http: Accept error: accept tcp [::]:5820: accept4: too many open files; retrying in 1s
2020/03/31 23:14:59 server.go:3061: http: Accept error: accept tcp [::]:5820: accept4: too many open files; retrying in 1s
2020/03/31 23:15:00 server.go:3061: http: Accept error: accept tcp [::]:5820: accept4: too many open files; retrying in 1s
2020/03/31 23:15:01 server.go:3061: http: Accept error: accept tcp [::]:5820: accept4: too many open files; retrying in 1s
2020/03/31 23:15:02 server.go:3061: http: Accept error: accept tcp [::]:5820: accept4: too many open files; retrying in 1s
2020/03/31 23:15:03 server.go:3061: http: Accept error: accept tcp [::]:5820: accept4: too many open files; retrying in 1s

其他信息：
-bash-4.2# ss -ntlp |grep 58
LISTEN 0 128 127.0.0.1:6379 : users:(("redis-server",pid=15810,fd=6))
LISTEN 0 128 :::2058 :::* users:(("n9e-collector",pid=13725,fd=12))
LISTEN 0 128 :::5840 :::* users:(("n9e-judge",pid=13699,fd=14))
LISTEN 0 128 :::5841 :::* users:(("n9e-judge",pid=13699,fd=11))
LISTEN 0 128 :::5810 :::* users:(("n9e-transfer",pid=13639,fd=13))
LISTEN 0 128 :::5811 :::* users:(("n9e-transfer",pid=13639,fd=12))
LISTEN 129 128 :::5820 :::* users:(("n9e-tsdb",pid=13656,fd=12))
LISTEN 0 128 :::5821 :::* users:(("n9e-tsdb",pid=13656,fd=13))
LISTEN 0 128 :::5830 :::* users:(("n9e-index",pid=13672,fd=13))
LISTEN 0 128 :::5831 :::* users:(("n9e-index",pid=13672,fd=12))
LISTEN 0 128 :::5800 :::* users:(("n9e-monapi",pid=13620,fd=18))

❗️提issue注意事项！

提问题？
请把问题现象、相关日志、初步排查结果写清楚，即提供尽量多的线索，这样方便我们定位问题。

提建议？
请写明白建议原因，即为何有此建议。

提修复PR？
请说明为何做此修改，需要做好测试。

提Feature？
建议先将想法提出，不着急写代码，与社区同道沟通，大家觉得OK再做代码实现

---

另外，我们是在做开源软件，不是服务于您的企业，做您的乙方，您一分钱没付，就不要颐指气使了，认同我们这个社区，则参与进来，不认同，就不参与，谢谢理解

存在一些数据丢失现象，如何排查

如下图示。

报送日志，如下，是持续的过程。

collector组件无错误日志，应该如何定位问题？

关于节点ip获取失败的解决方法（全部对象不显示主机ip）

/usr/sbin/ifconfig `/usr/sbin/route|grep '^default'|awk '{print $NF}'`|grep inet|awk '{print $2}'|head -n 1

在主机含有多网络时，该命令无法获取到节点ip,即全部对象不显示节点ip.需在collector.yaml identity.specify手动设置该主机的ip

问题3: 时间选择能否支持 6小时 12小时这样更多的区间段

感谢。