ERROR: failed to register layer: Untar re-exec error: exit status 1: output: open /bin/mknod: no space left on device

Hi there!

I’m currently getting errors of limited disk space but am finding inconsistent information regarding actual disk usage.

Expected behavior

Docker images continue to download and I can run containers.

Actual behavior

Docker images fail to download due to limited disk space.

Information

$ docker info
Containers: 1
 Running: 0
 Paused: 0
 Stopped: 1
Images: 42
Server Version: 1.10.3
Storage Driver: aufs
 Root Dir: /var/lib/docker/aufs
 Backing Filesystem: extfs
 Dirs: 485
 Dirperm1 Supported: true
Execution Driver: native-0.2
Logging Driver: json-file
Plugins:
 Volume: local
 Network: bridge null host
Kernel Version: 4.1.19
Operating System: Alpine Linux v3.3
OSType: linux
Architecture: x86_64
CPUs: 2
Total Memory: 1.957 GiB
Name: docker
ID: SZDJ:NX5U:2ZQ3:E2ZD:I6YD:IY3D:Q3KQ:4MRU:R6AC:Z4XY:BDGF:E6M3
Debug mode (server): true
 File Descriptors: 13
 Goroutines: 25
 System Time: 2016-04-01T02:48:16.793321693Z
 EventsListeners: 1
 Init SHA1:
 Init Path: /usr/bin/docker
 Docker Root Dir: /var/lib/docker

$ pinata diagnose -u
OS X: version 10.11.4 (build: 15E65)
Docker.app: version v1.10.3-beta5
Running diagnostic tests:
[OK]      docker-cli
[OK]      Moby booted
[OK]      driver.amd64-linux
[OK]      vmnetd
[OK]      lofs
[OK]      osxfs
[OK]      db
[OK]      slirp
[OK]      menubar
[OK]      environment
[OK]      Docker
[OK]      VT-x
Docker logs are being collected into /tmp/20160331-172619.tar.gz.
Your unique id in bugsnag is: 1358B31A-3894-4CD4-994F-1B0F25EC12EB

Steps to reproduce the behavior

After downloading a number of images…

$ docker run -d -p 80:80 --name webserver nginx
Unable to find image 'nginx:latest' locally
latest: Pulling from library/nginx

fdd5d7827f33: Already exists
a3ed95caeb02: Download complete
716f7a5f3082: Extracting [==================================================>] 23.51 MB/23.51 MB
7b10f03a0309: Download complete
docker: failed to register layer: Untar re-exec error: exit status 1: output: open /etc/init.d/nginx-debug: no space left on device.
See 'docker run --help'.

In Docker for Mac VM:

docker:/var# df -h
Filesystem                Size      Used Available Use% Mounted on
tmpfs                   200.4M    156.0K    200.2M   0% /run
dev                      10.0M         0     10.0M   0% /dev
shm                    1001.7M         0   1001.7M   0% /dev/shm
cgroup_root              10.0M         0     10.0M   0% /sys/fs/cgroup
/dev/vda1                95.1G     83.3G      6.9G  92% /var
df: /Mac: Function not implemented
df: /var/log: Function not implemented
df: /Users: Function not implemented
df: /Volumes: Function not implemented
df: /tmp: Function not implemented
df: /private: Function not implemented
/dev/vda1                95.1G     83.3G      6.9G  92% /var/lib/docker/aufs

docker:/var# du -sh /var
8.9G    /var
docker:/var# du -sh /var/lib/docker/aufs/
8.6G    /var/lib/docker/aufs/

Getting the same error on Windows. The default VMDK is now at 19GB (does it have 20GB limit?)

How to work around this situation?

@dblandin can you do a df -ih, I suspect this could be shortage of inodes but not 100% sure.
@krishnapg you may want to ask over in the Docker for Windows forums about that!