WORKDIR Caching

Trying to figure out to not cache WORKDIR when bringing/building the service up. While I understand that docker-compose build --no-cache app builds the app again without cache, is there a way to exempt docker build from using cached WORKDIR.