cberthe067
September 17, 2023, 4:09pm
1
I just create a 3 node Docker Swarm !
The problem is that each service create with
docker swarm deploy
can create the running container without problem but …
These container are only bind to ipv6
netstat give only ipv6 bind as also lsof -i -n command ! => NO IPv4 LISTENER !!!
How could i configure my cluster to listen to IPv4 ???
I already check sysctl value for net.* and all value are seems to be correct …
Do you have an idea how to solve this problem ?
Exemple
docker service create --name portainer-ee --replicas 1 --publish published=9444,target=9443,mode=ingress portainer/portainer-ee
get service running :
ID NAME MODE REPLICAS IMAGE PORTS
Netstat
Active Internet connections (only servers)
No IPv4 for port 9444 !!!
lsof
COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
No IPv4 for port 9444
For the 2 commands only listening on IPv6 !!!
How to solve this problem to also listen on IPv4 ! IPv6 not forward to IPv4 for Docker …
Thanks,
1 Like
bluepuma77
September 18, 2023, 4:48am
2
Does your node have an IPv4 address? Try hostname -I.
cberthe067
September 18, 2023, 7:31am
3
Yes,
root@Docker:~# hostname -I
I already investigate a lot of time on this problem without finding the culprit of this …
Thanks,
cberthe067
September 18, 2023, 7:32am
4
Here also my docker info
root@Docker:~# docker info
Server:
cberthe067
September 18, 2023, 8:06am
5
Hi,
After some investigation, this is what i found …
I leave all node from swarm (also the Leading node), so i’m back to single docker
when running my container, it bind well to ipv4 and ipv6 !
When doing the swarm init, then container only bind to ipv6 and i do not know why, even passing parameters to swarm init with host ip v4 for --listen* and -addr* do not solve the problem !
I do not know what to do … Is it a bug in docker ? or Ubuntu 23 ? Don’t know …
1 Like
hebidu
September 18, 2023, 9:12am
6
same problem same problem
bluepuma77
September 18, 2023, 9:56am
7
Setup 2 VMs with Ubuntu 22.04, then updated to 23 and installed Docker via convenience script.
sudo apt update && sudo apt upgrade -y
sudo nano /etc/update-manager/release-upgrades # Prompt=LTS -> Prompt=normal
sed -i 's/jammy/lunar/g' /etc/apt/sources.list
cat /etc/os-release
reboot
curl -fsSL https://get.docker.com -o get-docker.sh
sudo sh get-docker.sh
docker swarm init --advertise-addr 1.2.3.4
# docker swarm join ...
wget https://raw.githubusercontent.com/bluepuma77/traefik-best-practice/main/docker-swarm-traefik/docker-compose.yml
docker stack deploy -c docker-compose.yml traefik
# netstat -tulpn
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 2060/docker-proxy
tcp 0 0 127.0.0.54:53 0.0.0.0:* LISTEN 417/systemd-resolve
tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 2018/docker-proxy
tcp 0 0 127.0.0.53:53 0.0.0.0:* LISTEN 417/systemd-resolve
tcp6 0 0 :::80 :::* LISTEN 2071/docker-proxy
tcp6 0 0 :::22 :::* LISTEN 1/init
tcp6 0 0 :::443 :::* LISTEN 2032/docker-proxy
For me it works.
cberthe067
September 18, 2023, 11:17am
8
I may finally found the culprit of the story on running docker on … LXC container in proxmox !
It seems that docker is running fine but as soon as you use swarm, it seems that then completly broken !
The advice was to run docker in vm !
I will try this and return here to give my conclusion …
cberthe067
September 18, 2023, 12:47pm
9
Did install a VM with lite linux distribution Alpine, and install docker ! Same problem no binding on ipv4 …
I give up for now … swarm get me crazy !
bluepuma77
September 18, 2023, 5:24pm
10
Have you tried with plain Ubuntu 22 in your infrastructure?
Bard says there might be relevant changes:
Yes, there are a few firewall changes in Ubuntu 23. The most notable change is that UFW is now enabled by default. This means that all incoming and outgoing traffic will be blocked by default, unless you explicitly allow it.
cberthe067
September 19, 2023, 3:09pm
11
Did not try with Ubuntu 22 but with a much lighter linux distribution Alpine Linux (small footprint) in VM, same problem with swarm … only binding on IPv6 … I will try with Ubuntu 22 as soon as i have free time …
cberthe067
September 19, 2023, 3:36pm
12
Just install Ubuntu 22 and docker packages from ubuntu repository and same problem only binding on IPv6 in swarm mode …
bluepuma77
September 20, 2023, 10:19am
13
What’s your infrastructure around?
As stated above, I did fresh installs of Ubuntu 22/23 with updates and a fresh Swarm install on 2 Cloud-VMs and it worked.
cberthe067
September 20, 2023, 1:49pm
14
I’m running a cluster 3 nodes proxmox with ceph storage.
Running Ubuntu 22 & 23 with apparmor running …
I created a VM with Ubuntu 22 & 23, and installed docker using the standard ubuntu repository with the following command :
apt-get install docker.io docker-compose
After that docker is running in standalone mode and i can create a container using portainer/portainer-ce for example …
After i launch the following command to be in swarm mode
docker swarm join init
This give me a docker node with a Leader/Manager.
Trying the following command
docker stack deploy --compose-file docker-compose.yml portainer-ce
This command create de stack with a service
After that if i run netstat -tapeu
This command only give IPv6 connection for the port exposed !
Same thing for lsof -i -n
I will try again to install docker without using default Ubuntu repository but installing from the script ofered by docker
rimelek
September 20, 2023, 5:45pm
15
Please, format your posts according to the following guide: How to format your forum posts </> button to share codes, terminal outputs, error messages or anything that can contain special characters which would be interpreted by the MarkDown filter. Use the preview feature to make sure your text is formatted as you would expect it and check your post after you have sent it so you can still fix it.
It can get you much more answers.
I’ve the same problem with ubuntu 22.04 and 23.04, and i’ve found another post dated 2021 with the same problem but without reply
rimelek
September 30, 2023, 12:53pm
17
Can you share that post? It might give someone a new idea.
rimelek
September 30, 2023, 12:58pm
19
Thank you. I still can’t answer, but the in this post:
It’s clear that Docker was not installed from the official repository provided by Docker. The proper installation way is in the documentation.
For ubuntu:
cberthe067
October 13, 2023, 10:35am
20
I finally had time to test again docker swarm in VM using the script helper describe in de documentation using debian 12 … get-docker.sh
After docker swarm join
I ran
docker stack deploy --compose-file docker-compose.yml portainer-ce
my docker compose-file is
version: "3"
services:
portainer:
image: portainer/portainer-ce:latest
container_name : portainer-ce
ports:
- 9443:9443
volumes:
- ./persist/data:/data
- /var/run/docker.sock:/var/run/docker.sock
restart: unless-stopped
Container is not reachable !
netstat connection only give tcp6 for port 9443 !
Docker VM is running on Proxmox !