First of all, I am fairly new to the Docker world, so it is possible I missed something or I am doing something wrong.
My issue is the following:
I am developing a system based on a docker swarm, and for some reason, I need to be able to modify the number of containers, among other things, on the fly, depending on events that are not docker related. (To be precise, it is a Minecraft minigame server that needs new Minecraft instances whenever players request it)
So I choose to design my own orchestrator on top of Docker swarm.
I am designing a python service that will run on every manager node of my swarm to ensure a continuity of service if some of the manager nodes were to fail.
To ensure synchronism between the different orchestrator services I was hoping to be able to use the overlay network I created to connect the different containers.
This design would allow me easy scalability.
But I cannot figure out how to connect a non-docker service to a docker network.
A solution would be to put my orchestrator inside a docker container, but then it would not be able to create, add and destroy containers (if I am not mistaken).
I would be glad if someone could explain to me if it is even possible and in this case points me toward sources that would explain how.
I stay at your disposal for any need information about what I am doing.