Ok, so I found the reason for this and now it is working. The VM’s main interface has an MTU value of 1450 and Docker, by default, has an MTU value of 1500.
This is why outgoing HTTPS connections failed and it seemed like not much was working. I found out useful, additional information with the Netshoot container.
So in the end this was fixed by adding this to docker-compose .yml files
networks:
default:
driver: bridge
driver_opts:
com.docker.network.driver.mtu: 1450