Hello,
I’m reaching out here to ask if anyone could help me diagnose a strange behavior my instance on docker is showing.
I’m running the community edition version 2:20.10.7~3-0~debian-buster atop a Debian 10 server.
Lately, as I Have been adding more and more containers that communicate with each other, I began noticing new containers can suddenly change their address range, causing issues with services outside docker, that are limited only to a certain IP range.
As such, I attempted to change the bridge IP range pool via setting the “bip” parameter in /etc/docker/daemon.json
However, despite having no address from the range allocated on the machine, the daemon still fails to restart, instead giving me an error of: failed to start daemon: Error initializing network controller: Error creating default "bridge" network: failed to allocate gateway (10.32.0.0): Address already in use (That’s when I tried setting the bip to 10.32.0.0/16)
I tried several different private IP ranges and none seem to work.
All my currently running containers are set to use a manually defined network br0 with the range 10.137.0.0/24
Interfaces and IPs (except the global IP, redacted for privacy):
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: enp2s0f0: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
link/ether 1e:4b:b1:f6:05:42 brd ff:ff:ff:ff:ff:ff permaddr 00:25:90:94:9f:fe
3: enp2s0f1: <BROADCAST,MULTICAST,SLAVE,UP,LOWER_UP> mtu 1500 qdisc mq master bond0 state UP group default qlen 1000
link/ether 1e:4b:b1:f6:05:42 brd ff:ff:ff:ff:ff:ff permaddr 00:25:90:94:9f:ff
4: bond0: <BROADCAST,MULTICAST,MASTER,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
link/ether 1e:4b:b1:f6:05:42 brd ff:ff:ff:ff:ff:ff
inet 1.3.3.7/28 brd 1.3.3.15 scope global bond0
valid_lft forever preferred_lft forever
5: wg1: <POINTOPOINT,NOARP,UP,LOWER_UP> mtu 1420 qdisc noqueue state UNKNOWN group default qlen 1000
link/none
inet 10.0.45.2/32 scope global wg1
valid_lft forever preferred_lft forever
9: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default
link/ether 02:42:49:ca:bc:9c brd ff:ff:ff:ff:ff:ff
inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
valid_lft forever preferred_lft forever
72: br-9d4cc840f89e: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default
link/ether 02:42:ef:0e:58:96 brd ff:ff:ff:ff:ff:ff
inet 10.137.0.1/24 brd 10.137.0.255 scope global br-9d4cc840f89e
valid_lft forever preferred_lft forever
inet6 fe80::42:efff:fe0e:5896/64 scope link
valid_lft forever preferred_lft forever
74: vethe4d10fa@if73: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether d6:57:c2:5b:84:c9 brd ff:ff:ff:ff:ff:ff link-netnsid 4
inet6 fe80::d457:c2ff:fe5b:84c9/64 scope link
valid_lft forever preferred_lft forever
76: veth0fea56a@if75: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 8a:d7:2f:2d:a4:53 brd ff:ff:ff:ff:ff:ff link-netnsid 5
inet6 fe80::88d7:2fff:fe2d:a453/64 scope link
valid_lft forever preferred_lft forever
78: veth7fe7cad@if77: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether a2:2a:46:7a:b2:6b brd ff:ff:ff:ff:ff:ff link-netnsid 6
inet6 fe80::a02a:46ff:fe7a:b26b/64 scope link
valid_lft forever preferred_lft forever
80: vethc27a78b@if79: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 26:b0:e8:55:c1:45 brd ff:ff:ff:ff:ff:ff link-netnsid 7
inet6 fe80::24b0:e8ff:fe55:c145/64 scope link
valid_lft forever preferred_lft forever
82: vethac5c4af@if81: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 46:41:2b:64:cd:0e brd ff:ff:ff:ff:ff:ff link-netnsid 8
inet6 fe80::4441:2bff:fe64:cd0e/64 scope link
valid_lft forever preferred_lft forever
84: vetha617b6d@if83: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether e2:66:14:72:25:a8 brd ff:ff:ff:ff:ff:ff link-netnsid 9
inet6 fe80::e066:14ff:fe72:25a8/64 scope link
valid_lft forever preferred_lft forever
86: veth46ab1ec@if85: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 22:c8:db:dd:04:16 brd ff:ff:ff:ff:ff:ff link-netnsid 10
inet6 fe80::20c8:dbff:fedd:416/64 scope link
valid_lft forever preferred_lft forever
88: veth4bb622d@if87: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 52:7a:51:c5:f0:8e brd ff:ff:ff:ff:ff:ff link-netnsid 11
inet6 fe80::507a:51ff:fec5:f08e/64 scope link
valid_lft forever preferred_lft forever
90: veth4cefc8a@if89: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether b6:70:4b:b2:fd:c3 brd ff:ff:ff:ff:ff:ff link-netnsid 12
inet6 fe80::b470:4bff:feb2:fdc3/64 scope link
valid_lft forever preferred_lft forever
92: vethdfd046d@if91: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether c2:55:4d:4a:3d:31 brd ff:ff:ff:ff:ff:ff link-netnsid 13
inet6 fe80::c055:4dff:fe4a:3d31/64 scope link
valid_lft forever preferred_lft forever
94: veth453a109@if93: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 6e:a1:67:93:ca:4e brd ff:ff:ff:ff:ff:ff link-netnsid 14
inet6 fe80::6ca1:67ff:fe93:ca4e/64 scope link
valid_lft forever preferred_lft forever
96: veth61b8020@if95: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 1a:2e:04:32:13:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 15
inet6 fe80::182e:4ff:fe32:13d2/64 scope link
valid_lft forever preferred_lft forever
98: vethdc2424e@if97: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 1e:89:9a:bd:ae:7e brd ff:ff:ff:ff:ff:ff link-netnsid 16
inet6 fe80::1c89:9aff:febd:ae7e/64 scope link
valid_lft forever preferred_lft forever
100: veth84ba6b4@if99: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue master br-9d4cc840f89e state UP group default
link/ether 52:82:e8:0a:65:ef brd ff:ff:ff:ff:ff:ff link-netnsid 17
inet6 fe80::5082:e8ff:fe0a:65ef/64 scope link
valid_lft forever preferred_lft forever
101: wg0: <POINTOPOINT,NOARP,UP,LOWER_UP> mtu 1420 qdisc noqueue state UNKNOWN group default qlen 1000
link/none
inet 10.0.42.2/32 scope global wg0
valid_lft forever preferred_lft forever
My current private-range routing table is
10.0.42.1 dev wg0 scope link
10.0.45.1 dev wg1 scope link
10.137.0.0/24 dev br-9d4cc840f89e proto kernel scope link src 10.137.0.1
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown
My networks:
NETWORK ID NAME DRIVER SCOPE
9d4cc840f89e br0 bridge local
59674e5503ea bridge bridge local
5e4d5920674a host host local
dfa28c33fec7 none null local
br0 is manually made with docker network create --subnet=10.137.0.0/24 br0, others are default.
Could anyone give me any pointers to the possible cause of this issue?
Any additional details, I’ll gladly provide, if needed.
Thank you.