Docker update 26.0.2 broke cadvisor / node-exporter

Hi!

I am running a small stack for some system stats in a Rpi5 with Raspberry OS using cadvisor, node-exporter and grafana.
I updated docker via apt to 26.0.2 last evening and since then I get zero system stats in my grafana dashboard from cadvisor or node-exporter any more. Cannot find a helpful error message except this in node-exporter:

ts=2024-04-20T08:10:33.912Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data

Any clues what could have happened?

I pinned the error down and the problem is that prometheus cannot reach node-exporter with “localhost” or “raspberrypi” hostname any more for some reason but only via the external hostname or ip from my router.

in prometheus.yml I changed the source for node-exporter from http://raspberrypi:9100/metrics to http://192.168.1.x:9100/metrics and now it works again.

Coulnd’t figure out how to enable to resolution of a local hostname defined in /etc/hosts again.

1 Like