I talked about it on YouTube: https://www.youtube.com/watch?v=maQJSnRdy10
In the video I just show some ways to find out what you can remove, but different Docker Desktop versions can have different files and if you have Docker extensions installed, it could be important to delete the folders of those too. Be careful! Remove files that you are sure would not break something else on your Mac.
I also experienced some issues when I started Docker Desktop some months ago, but the latest Docker Desktop on the latest macOS (Ventura 13.1) looks stable on my MacBook.