Adding user in docker group / root privileges / how to avoid

Hi,

We have a system with docker container on Ubuntu 18.04. Users have account on this system. Whenever any user wants to use docker container, we add the user in the docker group. It helps user in spawning the container, however, the root privileges are granted to the user indirectly. How can we avoid this?