Docker Swarm GPU Support

Hi everyone.

This forum is the last hope for me to guide me about the docker swarm ability to use the GPU.

I’m trying to provide my stack.yml file a runtime property or any other property from where I can tell it which runtime to use. But, it does not let me deploy that.

Additionally, upon making the default container runtime “Nvidia”. I got success. But, that’s really not a solution, as all the containers will inherit from that runtime.

I need a way to explicitly mention the docker swarm services the runtime it needs to use and I want to keep the default runtime as runc.

Is there any way or anything people can help us? Awaiting for your response. Anybody! Thanks!

Regards,
Ahson Shaikh

1 Like

I just used the forum search and found this topic:

Note: I don’t use Swarm with GPU support, so I won’t be able to answer any follow-up questions.