I finally managed to get it running! I removed the installation and ran these commands:
rm -rf ~/Library/Group\ Containers/group.com.docker
rm -rf ~/Library/Containers/com.docker.docker
rm -rf ~/.docker
I noticed that .docker directory was owned by root user, so I had to use sudo to remove it.