Hi there
I am running a chatbot model inside a docker container but it takes a while to respond (even six minutes some times). When I check processes running inside the container, my model is running but it gives me a (‘Connection aborted.’, ConnectionResetError(104, ‘Connection reset by peer’)) error when I send a request. After waiting for a few minutes, it then responds; the waiting time is random so I can’t predict how long it takes to start a model. Any reason why the container is up and running, and the processes inside the container are running but I am getting this error?
Your assistance will be much appreciated.