I’ve been running docker on production for almost 2 years now (on about 80 - 150 busy ec2 instances) and I’m still looking for a stable docker/distro/setup. Currently it’s becoming an urgent topic for us (see below) and I want to hear from your experience. So far I’ve tried:
- CoreOS (the relevant version for 1.5 years ago) on btrfs - It run quickly but suffered from problem under load (CoreOS, not docker).
- For a long time I was running on AmazonLinux and various docker versions (last was 1.7.1) with device mapper and LVM. This was very stable and used successfully for about 1.5 years, until I discovered that Amazon Linux doesn’t support locking yourself to a version and getting security updates (which is unfortunate).
- In the last few days I tried running CentOs 7 with docker 1.10.3 using DM and LVM thinpool. This one really fails miserably. Of the 5 machines that run for 2 days, one docker instance was completely stuck and couldn’t be killed, and three were acting like there is no space left on the device although
docker infoindicates that there still is 7G available. Because both CoreOS and CentOs 7 were using systemd I started to suspect that maybe that is the problem?
So, I’m looking for a stable linux distribution (e.g. debian testing won’t work for us) with security updates and most important runs docker without issues even under heavy load.