I have finally managed to locate the cause of the issue.
My company uses AppLocker to restrict which applications can be run, it appears to be blocking C:\ProgramData\Docker\cli-plugins\docker-mutagen.exe mutagen daemon run
from running.
I have a separate account that isn’t subject to AppLocker restrictions, running Docker Desktop as that user account gets it running fine