Understand the alert
The exporting_metrics_sent alert is triggered when the Netdata Agent fails to send all metrics to the configured external database server. This could be due to the exporting destination being down, unreachable, or short-term network availability problems.
Troubleshoot the alert
To troubleshoot this alert, follow these steps:
- Verify the exporting destination status:
- Make sure the external database server is up and running.
- Check if there are any issues with the server, such as high CPU usage, low memory, or a full disk.
- Check the network connection between the Netdata Agent and the external database server:
- Use tools like
pingortracerouteto test the connection. - Check for any firewall rules that may be blocking the connection.
- Increase the
buffer on failuresinexporting.conf:
Open the
exporting.conffile, which is typically located at/etc/netdata/exporting.conf.Increase the value of the
buffer on failuressetting to allow for more metrics to be stored when network/connectivity issues occur. For example, if the current setting is10000, try increasing it to20000or higher, depending on your server's available memory.
[exporting:global]
buffer on failures = 20000
Save and exit the file.
Restart the Netdata Agent to apply the changes.
- Review the Netdata Agent logs:
Check for any error messages or warnings related to the exporting engine in the Netdata Agent logs (
/var/log/netdata/error.log).Use the information from the logs to troubleshoot any issues you find.
- Ensure your configuration settings are correct:
- Double-check your exporting configuration settings (located in
/etc/netdata/exporting.conf) to ensure they match the requirements of your external database server.