Docker rm doesn't respond and only option is to restart docker desktop

I have docker desktop (2.4.00) installed on Mac (Catalina ). Recently, we have been seeing docker not responding in the middle of the builds. The subsequent docker requests are in “created” state, but never progresses from there. Basically all the containers are hung. The only way to recover from here is to restart docker desktop.

followed the steps in https://docs.docker.com/docker-for-mac/troubleshoot/ to collect the logs and found the below message in right about when all the containers became unresponsive.

localhost com.docker.backend[988]: volumeResource: cannot inspect container 94126dd1****** localhost com.docker.backend[988]: volumeResource: cannot inspect container 59988882******

Can someone please guide me further on how to debug more and how to get the docker back to usable state without a need to restart docker desktop. Thanks !