I ran into this error as well, and noticed what @rimelek said about Django not being able to find pytz, so I added this line to my requirements.txt file which fixed this issue for me:
pytz==2021.3
Seeing how Django 4 just came out, that might be related, but this combination of requirements seems to work for me:
Django==4.0
pytz==2021.3