Windows Grafana container advice


I’ve built a Windows Server Core container using a custom dockerfile.
The dockerfile copies Windows Grafana binaries, including various amended config files when building the container.
As we have several test and a production environment, I need to replace values within the config files.
Having a separate container for each environment seems to defeat the purpose of containers.
The only other option I can think of is to deploy the config files separately (Octopus Deploy) and have the container access the them (via a volume mount) when starting.

Any advice/guidance on how to best approach this would be most appreciated!