I have a Flask app that is part of a larger group of containers, all deployed via docker swarm. I recently began having issues where I change the startup script (boot.sh) but those changes are not reflected when I re-build the containers and bring up the swarm. I’m trying to understand exactly why that would happen and what I can do to fix it. I am confident I can fix the issues with the app itself once I understand why this file is not being copied over with the changes I made.
Essentially, I’ve tried adding/removing debugging statements from the boot.sh script to just make sure it is actually changing and it appears it is NOT and I’m not clear why. I’ve tried building with docker-compose build --no-cache as well as completely removing all containers and re-building from scratch, and nothing seems to change. I still see the same old echo statements that were in the first version. I’ve also tried changing the filename thinking that would force it to re-build from scratch, but no dice. It seems like I’m misunderstanding something fundamental about how docker images are built and how the cache works. I would love to know why this happens and how I can fix it!
The structure of the app is as follows:
Folder/App Structure
app/
conf/
tests/
migrations/
.dockerignore
.gitignore
boot.sh
config.py
docker-compose.yml
docker-compose.override.yml
Dockerfile
manage.py
requirements.txt
The Dockerfile looks like:
Dockerfile
FROM python:3.6-slim-stretch
LABEL maintainer="<maintainer-here>"
RUN useradd -m <name-repl> -s /bin/bash
WORKDIR /home/<folder-here>
COPY requirements.txt poetry-reqs.txt
RUN python -m venv venv
RUN apt-get update -yq && apt-get upgrade -yq && \
apt-get install -yq curl libpq-dev libffi-dev tzdata gnupg build-essential supervisor && \
apt-get clean && \
rm -rf /var/lib/apt/lists/*
# replace with v12?
RUN curl -sL https://deb.nodesource.com/setup_8.x | bash && apt-get install -yq nodejs
RUN pip install --upgrade pip
RUN venv/bin/pip install gunicorn --no-cache-dir --compile
RUN venv/bin/pip install psycopg2-binary --no-cache-dir --compile
RUN venv/bin/pip install -r poetry-reqs.txt --no-cache-dir --compile
ADD package.json /tmp
RUN cd /tmp && npm install
RUN mv /tmp/node_modules /home/<folder-here>/node_modules
RUN cd /home/<folder-here>
COPY app app
COPY migrations migrations
COPY manage.py config.py boot.sh boot-workers.sh pyproject.toml ./
RUN chmod +x boot.sh
RUN chmod +x boot-workers.sh
# this layer adds 0.541GB!!
RUN chown -R quantaq:quantaq ./
USER <user-repl>
EXPOSE 5000
ENTRYPOINT ["./boot.sh"]
docker-compose.yml
version: "3.3"
services:
app-primary:
image: <image-name>
reverse-proxy:
<redacted>
redis_db:
<redacted>
volumes:
redis-data:
docker-compose.override.yml
version: "3.3"
services:
app-primary:
image: <image name>
build: .
env_file: conf/dev/app.env
ports:
- "8000:8000"
depends_on:
- postgres-primary
- redis_db
configs:
nginx_conf:
file: ./conf/dev/nginx.conf
redis_conf:
file: ./conf/dev/redis.conf
supervisor_conf:
file: ./conf/dev/supervisor.conf
volumes:
db:
I removed/left-out a few things that I don’t think we’re relevant for succinctness. I can add back if needed.
Other Important Info
- Docker version 2.3.0.3
- Compose: 1.25.5
- Engine: 19.03.8
Docker Info
Client:
Debug Mode: false
Plugins:
app: Docker Application (Docker Inc., v0.8.0)
buildx: Build with BuildKit (Docker Inc., v0.3.1-tp-docker)
mutagen: Synchronize files with Docker Desktop (Docker Inc., testing)
Server:
Containers: 16
Running: 6
Paused: 0
Stopped: 10
Images: 79
Server Version: 19.03.8
Storage Driver: overlay2
Backing Filesystem: <unknown>
Supports d_type: true
Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: active
NodeID: ryd06ymf1dosx7mi7530u4efs
Is Manager: true
ClusterID: 7225atxknsy5w3kh9i5uc786p
Managers: 1
Nodes: 1
Default Address Pool: 10.0.0.0/8
SubnetSize: 24
Data Path Port: 4789
Orchestration:
Task History Retention Limit: 5
Raft:
Snapshot Interval: 10000
Number of Old Snapshots to Retain: 0
Heartbeat Tick: 1
Election Tick: 10
Dispatcher:
Heartbeat Period: 5 seconds
CA Configuration:
Expiry Duration: 3 months
Force Rotate: 0
Autolock Managers: false
Root Rotation In Progress: false
Node Address: 192.168.65.3
Manager Addresses:
192.168.65.3:2377
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 7ad184331fa3e55e52b890ea95e65ba581ae3429
runc version: dc9208a3303feef5b3839f4323d9beb36df0a9dd
init version: fec3683
Security Options:
seccomp
Profile: default
Kernel Version: 4.19.76-linuxkit
Operating System: Docker Desktop
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 5.811GiB
Name: docker-desktop
ID: 6SU5:FS3A:BRBI:SPGE:5FMQ:FIHD:TGNI:M3R4:POXS:ECTM:BUJS:DEX7
Docker Root Dir: /var/lib/docker
Debug Mode: true
File Descriptors: 128
Goroutines: 268
System Time: 2020-05-28T19:56:02.871137Z
EventsListeners: 15
HTTP Proxy: gateway.docker.internal:3128
HTTPS Proxy: gateway.docker.internal:3129
Registry: https://index.docker.io/v1/
Labels:
Experimental: true
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false
Product License: Community Engine``