Extremely slow parallel docker builds

Docker Engine General
1

Hello,

I tried to run 4 docker build commands at the same time on my server and none of them ended within hours (5+) while they usually take up to 15 minutes to complete…

My configuration is as follow:

  • Ubuntu 14.04 server
  • Docker version:

Client:
Version: 17.07.0-ce
API version: 1.31
Go version: go1.8.3
Git commit: 8784753
Built: Tue Aug 29 17:43:06 2017
OS/Arch: linux/amd64
Server:
Version: 17.07.0-ce
API version: 1.31 (minimum version 1.12)
Go version: go1.8.3
Git commit: 8784753
Built: Tue Aug 29 17:41:57 2017
OS/Arch: linux/amd64
Experimental: false

Is it a known issue ? Or just my configuration which is bad :slight_smile: ?

Thanks in advance for your help,

PS: is the category correct ? I did not found “Docker for Ubuntu/Linux”

Cheers,
Nicolas

2

is it slow on http://play-with-docker.com as well?
If so its either Docker or your Dockerfile. If not it’s your configuration. :slight_smile:

3

Hello think,

Thank you for your reply, but not it is not slow there.

After some Googlings, I found out that Docker on Ubuntu 14.04 can use devicemapper as a file storage system, which is deprecated (cf https://docs.docker.com/engine/userguide/storagedriver/aufs-driver). This can be the reason of this very high latency.

To use the recommended AUFS instead, I need to run:
$ sudo apt-get install linux-image-extra-$(uname -r)
But it did not work!
I think it was because the Kernel I was using is 3.13.0-132-generic, which might be too old, so I forced it to 3.19.0-18-generic.

Now I have, in the docker info:
$ docker info
Containers: 0
Running: 0
Paused: 0
Stopped: 0
Images: 0
Server Version: 17.09.0-ce
Storage Driver: aufs
Root Dir: /var/lib/docker/aufs
Backing Filesystem: extfs
Dirs: 0
Dirperm1 Supported: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 06b9cb35161009dcb7123345749fef02f7cea8e0
runc version: 3f2f8b84a77f73d38244dd690525642a72156c64
init version: 949e6fa
Security Options:
apparmor
Kernel Version: 3.19.0-18-generic
Operating System: Ubuntu 14.04.5 LTS
OSType: linux
Architecture: x86_64
CPUs: 8
Total Memory: 31.02GiB
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false

WARNING: No swap limit support

Let’s hope it solves the issue ! :slight_smile:

4

I installed Kernel linux-generic-lts-vivid as I got some troubles running docker build with the 3.19.0-18.