I checked and it does not seem possible which surprises me. You can create a docker context without TLS keys and copy the keys into the .docker folder.
The other option I can see and what I actually prefer is using SSH for the context.
docker context create --docker="host=ssh://myuser@mydomain:22" mycontext
It also works on Windows. I have just tried.