As I always say in these topics, I am not a Swarm user, just share some ideas.
When you list GPUs on the node, can you see multiple GPU instances?
Are you also sure all requirements are met like described here?
For example GPU types, required dependencies like nvidia container toolkit
Since I never used Nvidia MIG, I can’t tell you what exactly you could miss if that happened. Or whether Swarm supports that or not.