Hi,
I have log full of these errors: “Failed to deserialize netlink ndmsg: Link not found”.
We have a cluster of three manager nodes, errors goes from all of them…
OS: Ubuntu 16.04 - private cluster, nodes communicate over LAN
Docker info:
Containers: 50
Running: 26
Paused: 0
Stopped: 24
Images: 189
Server Version: 17.12.0-ce
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: active
NodeID: vm2eeuteohfoxnn2afa6llvwd
Is Manager: true
ClusterID: zkqa5nrgqn042xedq172mwz5v
Managers: 3
Nodes: 3
Orchestration:
Task History Retention Limit: 5
Raft:
Snapshot Interval: 10000
Number of Old Snapshots to Retain: 0
Heartbeat Tick: 1
Election Tick: 3
Dispatcher:
Heartbeat Period: 5 seconds
CA Configuration:
Expiry Duration: 3 months
Force Rotate: 2
Autolock Managers: false
Root Rotation In Progress: false
Node Address: 10.10.10.1
Manager Addresses:
10.10.10.1:2377
10.10.10.2:2377
10.10.10.3:2377
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 89623f28b87a6004d4b785663257362d1658a729
runc version: b2567b37d7b75eb4cf325b77297b140ea686ce8f
init version: 949e6fa
Security Options:
apparmor
seccomp
Profile: default
Kernel Version: 4.4.0-112-generic
Operating System: Ubuntu 16.04.3 LTS
OSType: linux
Architecture: x86_64
CPUs: 32
Total Memory: 62.88GiB
ID: EIKM:AYWA:TSKT:27HN:ILHI:QFAX:SHCA:MFOB:4C2V:6ECR:UY5A:7ZMN
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false
WARNING: No swap limit support
Error log:
Feb 13 08:37:28 dockerd: time="2018-02-13T08:37:28.318310099+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:28 dockerd: time="2018-02-13T08:37:28.412980064+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:28 dockerd: time="2018-02-13T08:37:28.599645953+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:29 dockerd: time="2018-02-13T08:37:29.318243750+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:29 dockerd: time="2018-02-13T08:37:29.413106142+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:29 dockerd: time="2018-02-13T08:37:29.599741179+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:30 dockerd: time="2018-02-13T08:37:30.129528243+01:00" level=warning msg="unknown container" container=c1b0a28d5ab03715b404548e9861badc93b686b7848328f14308655a6c41e8f9 module=libcontainerd namespace=plugins.moby
Feb 13 08:37:30 dockerd: time="2018-02-13T08:37:30.131113836+01:00" level=warning msg="unknown container" container=d2ce3fe4331c30d3ad033452520dc0b9cba709752556b988d3418f3b632a6da4 module=libcontainerd namespace=plugins.moby
Feb 13 08:37:30 dockerd: time="2018-02-13T08:37:30.161085768+01:00" level=warning msg="unknown container" container=c1b0a28d5ab03715b404548e9861badc93b686b7848328f14308655a6c41e8f9 module=libcontainerd namespace=plugins.moby
Feb 13 08:37:30 dockerd: time="2018-02-13T08:37:30.161147544+01:00" level=warning msg="unknown container" container=d2ce3fe4331c30d3ad033452520dc0b9cba709752556b988d3418f3b632a6da4 module=libcontainerd namespace=plugins.moby
Feb 13 08:37:30 dockerd: time="2018-02-13T08:37:30.318555210+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:30 dockerd: time="2018-02-13T08:37:30.412933561+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:30 dockerd: time="2018-02-13T08:37:30.599647384+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:31 dockerd: time="2018-02-13T08:37:31.318233689+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:31 dockerd: time="2018-02-13T08:37:31.412909479+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:31 dockerd: time="2018-02-13T08:37:31.599775679+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:31 dockerd: time="2018-02-13T08:37:31.890443488+01:00" level=warning msg="unknown container" container=026ac7794401f9774a380fd7039df52a581c320a9b2228a76018fdc1ca0088cc module=libcontainerd namespace=plugins.moby
Feb 13 08:37:31 dockerd: time="2018-02-13T08:37:31.931501311+01:00" level=warning msg="unknown container" container=026ac7794401f9774a380fd7039df52a581c320a9b2228a76018fdc1ca0088cc module=libcontainerd namespace=plugins.moby
Feb 13 08:37:32 dockerd: time="2018-02-13T08:37:32.318229241+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Feb 13 08:37:32 dockerd: time="2018-02-13T08:37:32.413081227+01:00" level=error msg="Failed to deserialize netlink ndmsg: Link not found"
Does anybody have a clue why this is happening?
Thank you,
Martin