Nvidia-smi not working inside Docker container

[asragul (RAGUL)]

Hi all,
I am unable to run the nvidia-smi command inside my Docker container. I started the container using the following command “docker run -it nvidia/cuda:12.8.0-cudnn-devel-ubuntu22.04” However, nvidia-smi does not work inside the container. I need a way to monitor GPU usage from within the container as a regular user. How can I resolve this issue?

Thanks!

[rimelek (Ákos Takács)]

@asragul

However, nvidia-smi does not work inside the container

What does that mean exactly?

Have you checked other related topics?

https://forums.docker.com/search?q=nvidia-smi%20order%3Alatest

For example this one but other topics could be useful too

Nvdia-smi showing CUDA:N/A since latest Nvidia driver update on host

Without knowing what you did exactly, how you installed Docker and the nvidia driver, and how you start a container, we can’t tell what you do wrong. Normally, you would install Docker from the official repo Install the correct nvidia driver, and also install the NVidia container toolkit https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html This steps are mentioned in the Docker documentation in the GPU section https://docs.docker.com/engine/container…