[Bug]: Alarms not sent when using static builds on AmazonLinux2023 about netdata

[mkesper]

OK. Found out that ALL alerts default to silent.
Sorry but I did not expect that. Maybe a good addition to the docs?
Also your log check line would be a good addition as filtering out relevant lines from log is nowhere described afaics.

[ilyam8]

Hey, @mkesper.

bash-5.2$ grep alarm etc/netdata/netdata.conf
        # postpone alarms during hibernation for seconds = 60
        # enabled alarms = *
        script to execute on alarm = /usr/libexec/netdata/plugins.d/alarm-notify.sh

Did you cd /opt/netdata before grep?

The script to execute on alarm path is correct for static installs. As you see it is uncommented in your netdata.conf. So someone changed it.

[mkesper]

You're right. I tried to change it to get it working. But the alerts were not sent out even before changing that entry. Only manual testing works.

[ilyam8]

@mkesper Can you give a specific example?

• What alerts (notifications) didn't work?
• Were those alerts active?
• Did you check logs? Can you share logs? (journalctl --namespace=netdata --grep "health|ALERT NOTIFICATION")

[ilyam8]

@mkesper you can also see alert transitions/notifications in Logs

Screenshot

---

Found out that ALL alerts default to silent.

By default, not all of them are silent - 99 out of 320.

$ pwd
/Users/ilyam/Projects/github/ilyam8/netdata/health/health.d

$ git grep -Eo "to: .+"  | awk '{print $2}' | sort | uniq -c | sort -n
     13 sitemgr
     17 webmaster
     43 dba
     99 silent
    148 sysadmin

---

Also your log check line would be a good addition as filtering out relevant lines from log is nowhere described afaics.

You are right, that is an issue.