I could not reproduce issues with IPv6. Docker pull worked even when I disabled IPv6, but I have an Ubuntu. VM.
I don’t use Debian often, but I remember more networking issues on that. And I never used Rasberry PI.
I would check if any firewall is enabled like “ufw”
sudo ufw status