Running containers don't stop with Ctrl + C

I don’t think there is a difference between the Windows and Linux editions. A container will remain available after shutdown unless you use --rm, i.e.

docker run --rm --name test-nginx nginx

That said, things can go wrong. I have experienced issues when the container doesn’t shut down correctly and remains available. The easiest solution is to run docker container prune now and again.