Are you familiar with setting up reverse proxy rules with nginx? You will basicly need to mount the nginx.conf holding your reverse proxy rules to /etc/nginx/nginx.conf and make sure to use the service names of the target container in the proxy_pass directives. Whetever you do, do NOT use container ips in the proxy_pass directive.
This thead discusses some useful details about nginx as a reverse proxy with docker (it is valid for non swarm deplyoments as well).