Routing mesh not working docker 20.10 Ubunut

My docker environment has 2 nodes (1 master and 1 worker). When I deploy to either node in the swarm, I can only access that containers app from the socket of the node it is hosted on. I.E. If I deploy the app on the worker node I cannot access it from the master node (only from the worker node). I have all ports open that are needed for the swarm (TCP: 2375, 2377, 4789, 7946 and UDP 7946). However, this routing mesh does not seem to work for me.

Is there any one who can help me figure out how to troubleshoot this? Maybe someone has run into this and has some pointers? Thx.