The gitlab container is running, but I can't find anything in docker ps -a

What does docker context ls show?

I missed it earlier, but you have docker-ce installed in your WSL2 distribution AND have Docker Desktop installed on your Windows host and use the docker WSL2 integration.