Cannot start any container: process is killed right after bridge connection

Dear all,
I’d like to ask for some help diagnosing the following problem:

docker run -ti nginx /bin/bash

docker: Error response from daemon: Cannot start container f24104b29f7f1f1614024414e8346e1a98c722c027f4122e6c70f7ace0cc5353: [9] System error: exit status 1.

I think the process gets killed right after trying to assign an address on network bridge. But I have no idea why nor how to debug further!

Any help would really be appreciated!

Best,

Mario

  • I’m on Fedora 24 atomic.
    ************************************ docker info
    -bash-4.3# docker info
    Containers: 5
    Running: 0
    Paused: 0
    Stopped: 5
    Images: 2
    Server Version: 1.10.3
    Storage Driver: devicemapper
    Pool Name: fedora–atomic-docker–pool
    Pool Blocksize: 524.3 kB
    Base Device Size: 10.74 GB
    Backing Filesystem: xfs
    Data file:
    Metadata file:
    Data Space Used: 379.6 MB
    Data Space Total: 4.756 GB
    Data Space Available: 4.377 GB
    Metadata Space Used: 217.1 kB
    Metadata Space Total: 20.97 MB
    Metadata Space Available: 20.75 MB
    Udev Sync Supported: true
    Deferred Removal Enabled: true
    Deferred Deletion Enabled: true
    Deferred Deleted Device Count: 0
    Library Version: 1.02.122 (2016-04-09)
    Execution Driver: native-0.2
    Logging Driver: journald
    Plugins:
    Volume: local
    Network: bridge null host
    Kernel Version: 4.8.4-200.fc24.x86_64
    Operating System: Fedora 24 (Atomic Host)
    OSType: linux
    Architecture: x86_64
    Number of Docker Hooks: 2
    CPUs: 4
    Total Memory: 5.828 GiB
    Name: atom2.s.upf.edu
    ID: WKGH:XL6O:QNBB:VSF7:CWSP:IO2J:FSNY:CEBW:2XL4:5IEA:YSHI:ZD2G
    Debug mode (server): true
    File Descriptors: 12
    Goroutines: 19
    System Time: 2016-11-07T18:27:53.402703742Z
    EventsListeners: 0
    Init SHA1: 81b13ac99473772e48627b98cb12bae8b6bae62c
    Init Path:
    Docker Root Dir: /var/lib/docker
    Registries: docker.io (secure)
    -bash-4.3# docker run -ti nginx /bin/bash
    docker: Error response from daemon: Cannot start container f24104b29f7f1f1614024414e8346e1a98c722c027f4122e6c70f7ace0cc5353: [9] System error: exit status 1.
    -bash-4.3# docker info
    Containers: 6
    Running: 0
    Paused: 0
    Stopped: 6
    Images: 2
    Server Version: 1.10.3
    Storage Driver: devicemapper
    Pool Name: fedora–atomic-docker–pool
    Pool Blocksize: 524.3 kB
    Base Device Size: 10.74 GB
    Backing Filesystem: xfs
    Data file:
    Metadata file:
    Data Space Used: 393.2 MB
    Data Space Total: 4.756 GB
    Data Space Available: 4.363 GB
    Metadata Space Used: 241.7 kB
    Metadata Space Total: 20.97 MB
    Metadata Space Available: 20.73 MB
    Udev Sync Supported: true
    Deferred Removal Enabled: true
    Deferred Deletion Enabled: true
    Deferred Deleted Device Count: 0
    Library Version: 1.02.122 (2016-04-09)
    Execution Driver: native-0.2
    Logging Driver: journald
    Plugins:
    Volume: local
    Network: host bridge null
    Kernel Version: 4.8.4-200.fc24.x86_64
    Operating System: Fedora 24 (Atomic Host)
    OSType: linux
    Architecture: x86_64
    Number of Docker Hooks: 2
    CPUs: 4
    Total Memory: 5.828 GiB
    Name: atom2.s.upf.edu
    ID: WKGH:XL6O:QNBB:VSF7:CWSP:IO2J:FSNY:CEBW:2XL4:5IEA:YSHI:ZD2G
    Debug mode (server): true
    File Descriptors: 12
    Goroutines: 19
    System Time: 2016-11-07T18:38:47.242325194Z
    EventsListeners: 0
    Init SHA1: 81b13ac99473772e48627b98cb12bae8b6bae62c
    Init Path:
    Docker Root Dir: /var/lib/docker
    Registries: docker.io (secure)

***************************************************************The daemon says:
INFO[1660] {Action=start, ID=f24104b29f7f1f1614024414e8346e1a98c722c027f4122e6c70f7ace0cc5353, Username=mario, LoginUID=1000, PID=21971, Config={Hostname=f24104b29f7f, AttachStdin=true, AttachStdout=true, AttachStderr=true, ExposedPorts=map[443/tcp:{} 80/tcp:{}], Tty=true, OpenStdin=true, StdinOnce=true, Env=[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin NGINX_VERSION=1.11.5-1~jessie], Cmd={parts:[/bin/bash]}, ArgsEscaped=false, Image=nginx, NetworkDisabled=false, Labels=map[]}, HostConfig={LogConfig={Type:journald Config:map[]}, NetworkMode=default, PortBindings=map[], RestartPolicy={Name:no MaximumRetryCount:0}, DNS=[], DNSOptions=[], DNSSearch=[], Privileged=false, PublishAllPorts=false, ReadonlyRootfs=false, ShmSize=67108864, Resources={CPUShares:0 CgroupParent: BlkioWeight:0 BlkioWeightDevice:[] BlkioDeviceReadBps:[] BlkioDeviceWriteBps:[] BlkioDeviceReadIOps:[] BlkioDeviceWriteIOps:[] CPUPeriod:0 CPUQuota:0 CpusetCpus: CpusetMems: Devices:[] KernelMemory:0 Memory:0 MemoryReservation:0 MemorySwap:0 MemorySwappiness:0xc820d099d8 OomKillDisable:0xc820d099e2 PidsLimit:0 Ulimits:[]}}}
DEBU[1660] devmapper: activateDeviceIfNeeded(5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1660] devmapper: cancelDeferredRemovalIfNeeded START(docker-253:0-132619-5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1660] devmapper: cancelDeferredRemovalIfNeeded END(docker-253:0-132619-5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1660] container mounted via layerStore: /var/lib/docker/devicemapper/mnt/5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6/rootfs
DEBU[1660] Assigning addresses for endpoint reverent_stallman’s interface on network bridge
DEBU[1660] RequestAddress(LocalDefault/172.16.43.0/24, , map[])
DEBU[1660] Assigning addresses for endpoint reverent_stallman’s interface on network bridge
WARN[1661] signal: killed
DEBU[1661] attach: stdout: end
DEBU[1661] attach: stdin: end
DEBU[1661] attach: stderr: end
DEBU[1661] Closing buffered stdin pipe
DEBU[1661] Releasing addresses for endpoint reverent_stallman’s interface on network bridge
DEBU[1661] ReleaseAddress(LocalDefault/172.16.43.0/24, 172.16.43.2)
DEBU[1661] devmapper: UnmountDevice(hash=5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1661] devmapper: Unmount(/var/lib/docker/devicemapper/mnt/5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1661] devmapper: Unmount done
DEBU[1661] devmapper: deactivateDevice(5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1661] devicemapper: RemoveDeviceDeferred START(docker-253:0-132619-5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1661] devicemapper: RemoveDeviceDeferred END(docker-253:0-132619-5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1661] devmapper: deactivateDevice END(5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6)
DEBU[1661] devmapper: UnmountDevice(hash=5a1bdc185efab79c7e3fc0005c69590a302854fff9d45615df72ba89b87d47f6) END
ERRO[1661] error locating sandbox id 32951c52ad5111b3664bb1cfa0db508c92e384d26ebed007144060dd141771d1: sandbox 32951c52ad5111b3664bb1cfa0db508c92e384d26ebed007144060dd141771d1 not found
WARN[1661] failed to cleanup ipc mounts:
failed to umount /var/lib/docker/containers/f24104b29f7f1f1614024414e8346e1a98c722c027f4122e6c70f7ace0cc5353/shm: invalid argument
ERRO[1661] Error unmounting container f24104b29f7f1f1614024414e8346e1a98c722c027f4122e6c70f7ace0cc5353: not mounted
ERRO[1661] Handler for POST /v1.22/containers/f24104b29f7f1f1614024414e8346e1a98c722c027f4122e6c70f7ace0cc5353/start returned error: Cannot start container f24104b29f7f1f1614024414e8346e1a98c722c027f4122e6c70f7ace0cc5353: [9] System error: exit status


Thanks anyway. Fixed: