My Docker crash and exit suddenly

Version OSX 10.11.6 beta2
My Diagnostic ID: 542B1DFD-8A1B-492F-8239-C485264D7342

Expected behavior

None

Actual behavior

I don’t know why, I did nothing, while I am reading emails, later come back to check my console, I found the Docker crash and exited already.

Information

=== Errors ===
Exception in thread Thread-7:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-9:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)
Exception in thread Thread-10:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-8:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)
Exception in thread Thread-16:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-11:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-13:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 190, in watch_events
File “compose/project.py”, line 343, in events
File “site-packages/docker/client.py”, line 233, in _stream_helper
File “json/init.py”, line 338, in loads
File “json/decoder.py”, line 369, in decode
ValueError: Extra data: line 2 column 1 - line 3 column 1 (char 652 - 1300)

No “pinata diagnose -u”, so I can’t get its output.

Steps to reproduce the behavior

I don’t know how to reproduce this issue, it just crash suddenly

I’m having the same issue… can’t reproduce right now as it happens irregularly but almost daily - also when changing offices and now the first time during development (just running queries against a mysql container)

Diagnostic ID: 482F75DF-A39C-416D-B52C-AA1103A245CC

Docker for Mac: version: mac-v1.11.2-beta15
OS X: version 10.11.4 (build: 15E65)
logs: /tmp/20160614-151825.tar.gz
failure: No error was detected
[OK] docker-cli
[OK] app
[OK] menubar
[OK] virtualization
[OK] system
[OK] osxfs
[OK] db
[OK] slirp
[OK] moby-console
[OK] logs
[OK] vmnetd
[OK] env
[OK] moby
[OK] driver.amd64-linux

seen similar issues and want some sort of guidance.

So I have seen similar issues and would like some community help to help the community. What logs should we attach to these issues after a crash. What diagnostics could be run?

Any help would be welcome. I seem to be trawling the web for which folder docker logs to, when we should have some simple plans, I’m sure they exist but where?

Similar issues here. Every once in a while (it seems like it happens a couple times per day) I’m noticing that Docker has just exited without any explanation. I notice that some containers aren’t responding, and when I look up to my taskbar I see the whale isn’t even there anymore, and I have to launch Docker for mac again from scratch.

This only started happening after I installed the most recent update.

After I’ve launched Docker for mac again, I goto the diagnostic output but it doesn’t seem to show anything useful:
Docker for Mac: version: mac-v1.11.2-beta15
OS X: version 10.11.3 (build: 15D21)
logs: /tmp/20160614-120830.tar.gz
failure: No error was detected
[OK] docker-cli
[OK] app
[OK] menubar
[OK] virtualization
[OK] system
[OK] osxfs
[OK] db
[OK] slirp
[OK] moby-console
[OK] logs
[OK] vmnetd
[OK] env
[OK] moby
[OK] driver.amd64-linux

Yea this is a new issue which is being reported frequently(?). How do we
send the crash report on to Docker? Does docker have a relationship with
Apple to get these reports forwarded to them? How does this work? ( if
there are any such third party agreements ).

Hi all, I’m having the same issue. Suddenly, I guess mainly at nights, I discover that the Docker client on my mac is not working. Then I restart it again and everything is working fine until the next day.

I’ll try to find out more details about possible causes.

Regards

Version 1.11.2-beta15 (build: 9168)

Tag ID:
01157CF6-7689-4564-8F9A-F715F2BA1A58

My Docker exit again, with this error and I did nothing:

Exception in thread Thread-10:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-7:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)
Exception in thread Thread-9:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-12:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)
Exception in thread Thread-8:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)
Exception in thread Thread-11:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-13:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 190, in watch_events
File “compose/project.py”, line 356, in events
File “compose/container.py”, line 42, in from_id
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 182, in inspect_container
File “site-packages/docker/utils/decorators.py”, line 47, in inner
File “site-packages/docker/client.py”, line 120, in _get
File “site-packages/requests/sessions.py”, line 477, in get
File “site-packages/requests/sessions.py”, line 465, in request
File “site-packages/requests/sessions.py”, line 573, in send
File “site-packages/requests/adapters.py”, line 415, in send
ConnectionError: (‘Connection aborted.’, BadStatusLine("’’",))

Same issue for me, not sure why it crashed but took out the docker process not just the containers it was running.

Stack trace below. I was running 3 containers using docker-compose at the time if that’s any help

Docker for Mac: version: mac-v1.11.2-beta15
OS X: version 10.11.5 (build: 15F34)

Exception in thread Thread-6:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-5:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-4:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 149, in tail_container_logs
File “compose/cli/log_printer.py”, line 179, in wait_on_exit
File “compose/container.py”, line 239, in wait
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 439, in wait
File “site-packages/docker/client.py”, line 154, in _raise_for_status
APIError: 502 Server Error: Bad Gateway (“Bad response from Docker engine”)

Exception in thread Thread-7:
Traceback (most recent call last):
File “threading.py”, line 810, in __bootstrap_inner
File “threading.py”, line 763, in run
File “compose/cli/log_printer.py”, line 190, in watch_events
File “compose/project.py”, line 356, in events
File “compose/container.py”, line 42, in from_id
File “site-packages/docker/utils/decorators.py”, line 21, in wrapped
File “site-packages/docker/api/container.py”, line 182, in inspect_container
File “site-packages/docker/utils/decorators.py”, line 47, in inner
File “site-packages/docker/client.py”, line 120, in _get
File “site-packages/requests/sessions.py”, line 477, in get
File “site-packages/requests/sessions.py”, line 465, in request
File “site-packages/requests/sessions.py”, line 573, in send
File “site-packages/requests/adapters.py”, line 415, in send
ConnectionError: (‘Connection aborted.’, BadStatusLine("’’",))

I have version 1.11.2-beta15 (build: 9168) running on four macs (3 desktops, one laptop). They all have the same crash problems with this version (previous versions worked fine). Here is a snippet from crash log from ~/Library/Logs/DiagnosticReports/ :

Process: Docker [14698]
Path: /Applications/Docker.app/Contents/MacOS/Docker
Identifier: com.docker.docker
Version: 1.11.2-beta15 (9168)
Code Type: X86-64 (Native)
Parent Process: ??? [1]
Responsible: Docker [14698]
User ID: 502

Date/Time: 2016-06-16 00:43:10.189 -0700
OS Version: Mac OS X 10.11.5 (15F34)
Report Version: 11
Anonymous UUID: E43FF404-E839-D74E-4043-32FDD7A669CC

Time Awake Since Boot: 230000 seconds

System Integrity Protection: enabled

Crashed Thread: 1 Dispatch queue: com.apple.root.background-qos

Exception Type: EXC_CRASH (SIGABRT)
Exception Codes: 0x0000000000000000, 0x0000000000000000
Exception Note: EXC_CORPSE_NOTIFY

Application Specific Information:
*** Terminating app due to uncaught exception ‘NSInternalInconsistencyException’, reason: 'Failed to set posix_spawn_file_actions for fd -1 at index 0 with errno 9’
terminating with uncaught exception of type NSException
abort() called

Application Specific Backtrace 1:
0 CoreFoundation 0x00007fff92b3e4f2 __exceptionPreprocess + 178
1 libobjc.A.dylib 0x00007fff8c1b973c objc_exception_throw + 48
2 CoreFoundation 0x00007fff92ba54bd +[NSException raise:format:] + 205
3 Foundation 0x00007fff988b885d -[NSConcreteTask launchWithDictionary:] + 2494
4 Docker 0x000000010d36e177 TTSf4gs_d___TZFC6Docker7Backend15sendRequestSyncfSST5errorGSqSS_4respSS + 791
5 Docker 0x000000010d371a93 TFZFC6Docker7Backend27listenForDockerStateChangesFT_T_U_FT_T + 1459
6 libdispatch.dylib 0x00007fff9586e93d _dispatch_call_block_and_release + 12
7 libdispatch.dylib 0x00007fff9586340b _dispatch_client_callout + 8
8 libdispatch.dylib 0x00007fff9586729b _dispatch_root_queue_drain + 1890
9 libdispatch.dylib 0x00007fff95866b00 _dispatch_worker_thread3 + 91
10 libsystem_pthread.dylib 0x00007fff90d054de _pthread_wqthread + 1129
11 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Global Trace Buffer (reverse chronological seconds):
0.744388 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd213e2acc0) failed
0.744722 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2161f4d40) failed
0.745009 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2161f4890) failed
0.745317 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd213e2e150) failed
0.745582 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2161f3610) failed
0.745954 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2161f4070) failed
0.747187 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2163eb9f0) failed
0.747492 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2167abc30) failed
0.747620 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2167aca30) failed
0.747722 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2167a8e40) failed
0.747900 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2163df500) failed
0.747974 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2163df500) failed
0.748120 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2163df500) failed
0.748196 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2163df500) failed
0.748308 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2163df500) failed
0.748661 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2163e9e20) failed
0.748825 libsystem_trace.dylib 0x00007fff863ee0fa dyld_image_header_containing_address(0x7fd2167a4020) failed
1847.053309 CFNetwork 0x00007fff86d9c3cb TCP Conn 0x7fd216651e40 SSL Handshake DONE
1847.306265 CFNetwork 0x00007fff86d9c2a7 TCP Conn 0x7fd216651e40 starting SSL negotiation
1847.306397 CFNetwork 0x00007fff86d9ac71 TCP Conn 0x7fd216651e40 complete. fd: 4531, err: 0
1847.306532 CFNetwork 0x00007fff86e2954b TCP Conn 0x7fd216651e40 event 1. err: 0
1847.418635 CFNetwork 0x00007fff86d99f43 TCP Conn 0x7fd216651e40 started
1857.971155 CFNetwork 0x00007fff86d9c3cb TCP Conn 0x7fd216764ee0 SSL Handshake DONE
1858.026361 CFNetwork 0x00007fff86d9c2a7 TCP Conn 0x7fd216764ee0 starting SSL negotiation
1858.026471 CFNetwork 0x00007fff86d9ac71 TCP Conn 0x7fd216764ee0 complete. fd: 4529, err: 0
1858.026613 CFNetwork 0x00007fff86e2954b TCP Conn 0x7fd216764ee0 event 1. err: 0
1858.056829 CFNetwork 0x00007fff86d99f43 TCP Conn 0x7fd216764ee0 started
5447.062785 CFNetwork 0x00007fff86d9c3cb TCP Conn 0x7fd2165d9060 SSL Handshake DONE
5447.316866 CFNetwork 0x00007fff86d9c2a7 TCP Conn 0x7fd2165d9060 starting SSL negotiation
5447.316999 CFNetwork 0x00007fff86d9ac71 TCP Conn 0x7fd2165d9060 complete. fd: 3889, err: 0
5447.317102 CFNetwork 0x00007fff86e2954b TCP Conn 0x7fd2165d9060 event 1. err: 0
5447.420396 CFNetwork 0x00007fff86d99f43 TCP Conn 0x7fd2165d9060 started
5457.971051 CFNetwork 0x00007fff86d9c3cb TCP Conn 0x7fd2163a7c10 SSL Handshake DONE
5458.026269 CFNetwork 0x00007fff86d9c2a7 TCP Conn 0x7fd2163a7c10 starting SSL negotiation
5458.026360 CFNetwork 0x00007fff86d9ac71 TCP Conn 0x7fd2163a7c10 complete. fd: 3887, err: 0
5458.026490 CFNetwork 0x00007fff86e2954b TCP Conn 0x7fd2163a7c10 event 1. err: 0
5458.057075 CFNetwork 0x00007fff86d99f43 TCP Conn 0x7fd2163a7c10 started
9046.925971 CFNetwork 0x00007fff86d9c3cb TCP Conn 0x7fd21653d9b0 SSL Handshake DONE
9047.205656 CFNetwork 0x00007fff86d9c2a7 TCP Conn 0x7fd21653d9b0 starting SSL negotiation
9047.205774 CFNetwork 0x00007fff86d9ac71 TCP Conn 0x7fd21653d9b0 complete. fd: 3247, err: 0
9047.205897 CFNetwork 0x00007fff86e2954b TCP Conn 0x7fd21653d9b0 event 1. err: 0
9047.423246 CFNetwork 0x00007fff86d99f43 TCP Conn 0x7fd21653d9b0 started

Thread 0:: Dispatch queue: com.apple.main-thread
0 libsystem_kernel.dylib 0x00007fff8d4d9f72 mach_msg_trap + 10
1 libsystem_kernel.dylib 0x00007fff8d4d93b3 mach_msg + 55
2 com.apple.CoreFoundation 0x00007fff92ab31c4 __CFRunLoopServiceMachPort + 212
3 com.apple.CoreFoundation 0x00007fff92ab268c __CFRunLoopRun + 1356
4 com.apple.CoreFoundation 0x00007fff92ab1ed8 CFRunLoopRunSpecific + 296
5 com.apple.HIToolbox 0x00007fff891f3935 RunCurrentEventLoopInMode + 235
6 com.apple.HIToolbox 0x00007fff891f376f ReceiveNextEventCommon + 432
7 com.apple.HIToolbox 0x00007fff891f35af _BlockUntilNextEventMatchingListInModeWithFilter + 71
8 com.apple.AppKit 0x00007fff9ab36df6 _DPSNextEvent + 1067
9 com.apple.AppKit 0x00007fff9ab36226 -[NSApplication _nextEventMatchingEventMask:untilDate:inMode:dequeue:] + 454
10 com.apple.AppKit 0x00007fff9ad4d021 -[NSApplication _shouldTerminate] + 971
11 com.apple.AppKit 0x00007fff9ad4c66d -[NSApplication terminate:] + 762
12 com.apple.CoreFoundation 0x00007fff92ad34ac CFRUNLOOP_IS_CALLING_OUT_TO_A_BLOCK + 12
13 com.apple.CoreFoundation 0x00007fff92ab2d05 __CFRunLoopDoBlocks + 341
14 com.apple.CoreFoundation 0x00007fff92ab24ce __CFRunLoopRun + 910
15 com.apple.CoreFoundation 0x00007fff92ab1ed8 CFRunLoopRunSpecific + 296
16 com.apple.HIToolbox 0x00007fff891f3935 RunCurrentEventLoopInMode + 235
17 com.apple.HIToolbox 0x00007fff891f376f ReceiveNextEventCommon + 432
18 com.apple.HIToolbox 0x00007fff891f35af _BlockUntilNextEventMatchingListInModeWithFilter + 71
19 com.apple.AppKit 0x00007fff9ab36df6 _DPSNextEvent + 1067
20 com.apple.AppKit 0x00007fff9ab36226 -[NSApplication _nextEventMatchingEventMask:untilDate:inMode:dequeue:] + 454
21 com.apple.AppKit 0x00007fff9ad4d021 -[NSApplication _shouldTerminate] + 971
22 com.apple.AppKit 0x00007fff9ad4c66d -[NSApplication terminate:] + 762
23 com.apple.CoreFoundation 0x00007fff92ad34ac CFRUNLOOP_IS_CALLING_OUT_TO_A_BLOCK + 12
24 com.apple.CoreFoundation 0x00007fff92ab2d05 __CFRunLoopDoBlocks + 341
25 com.apple.CoreFoundation 0x00007fff92ab2a6b __CFRunLoopRun + 2347
26 com.apple.CoreFoundation 0x00007fff92ab1ed8 CFRunLoopRunSpecific + 296
27 com.apple.HIToolbox 0x00007fff891f3935 RunCurrentEventLoopInMode + 235
28 com.apple.HIToolbox 0x00007fff891f376f ReceiveNextEventCommon + 432
29 com.apple.HIToolbox 0x00007fff891f35af _BlockUntilNextEventMatchingListInModeWithFilter + 71
30 com.apple.AppKit 0x00007fff9ab36df6 _DPSNextEvent + 1067
31 com.apple.AppKit 0x00007fff9ab36226 -[NSApplication _nextEventMatchingEventMask:untilDate:inMode:dequeue:] + 454
32 com.apple.AppKit 0x00007fff9ab2ad80 -[NSApplication run] + 682
33 com.apple.AppKit 0x00007fff9aaf4368 NSApplicationMain + 1176
34 com.docker.docker 0x000000010d326529 main + 73
35 libdyld.dylib 0x00007fff971895ad start + 1

Thread 1 Crashed:: Dispatch queue: com.apple.root.background-qos
0 libsystem_kernel.dylib 0x00007fff8d4dff06 __pthread_kill + 10
1 libsystem_pthread.dylib 0x00007fff90d084ec pthread_kill + 90
2 libsystem_c.dylib 0x00007fff864c8787 __abort + 145
3 libsystem_c.dylib 0x00007fff864c86f6 abort + 144
4 libc++abi.dylib 0x00007fff90cd8f81 abort_message + 257
5 libc++abi.dylib 0x00007fff90cfea47 default_terminate_handler() + 267
6 libobjc.A.dylib 0x00007fff8c1bd491 _objc_terminate() + 103
7 net.hockeyapp.sdk.mac 0x000000010d55840a BITCrashUncaughtCXXTerminateHandler() + 761
8 libc++abi.dylib 0x00007fff90cfc19e std::__terminate(void (*)()) + 8
9 libc++abi.dylib 0x00007fff90cfc213 std::terminate() + 51
10 libdispatch.dylib 0x00007fff9586341f _dispatch_client_callout + 28
11 libdispatch.dylib 0x00007fff9586729b _dispatch_root_queue_drain + 1890
12 libdispatch.dylib 0x00007fff95866b00 _dispatch_worker_thread3 + 91
13 libsystem_pthread.dylib 0x00007fff90d054de _pthread_wqthread + 1129
14 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Thread 2:: Dispatch queue: com.apple.libdispatch-manager
0 libsystem_kernel.dylib 0x00007fff8d4e0efa kevent_qos + 10
1 libdispatch.dylib 0x00007fff95869165 _dispatch_mgr_invoke + 216
2 libdispatch.dylib 0x00007fff95868dcd _dispatch_mgr_thread + 52

Thread 3:
0 libsystem_kernel.dylib 0x00007fff8d4d9f72 mach_msg_trap + 10
1 libsystem_kernel.dylib 0x00007fff8d4d93b3 mach_msg + 55
2 net.hockeyapp.sdk.mac 0x000000010d56f0fc exception_server_thread + 202
3 libsystem_pthread.dylib 0x00007fff90d0599d _pthread_body + 131
4 libsystem_pthread.dylib 0x00007fff90d0591a _pthread_start + 168
5 libsystem_pthread.dylib 0x00007fff90d03351 thread_start + 13

Thread 4:: com.apple.NSEventThread
0 libsystem_kernel.dylib 0x00007fff8d4d9f72 mach_msg_trap + 10
1 libsystem_kernel.dylib 0x00007fff8d4d93b3 mach_msg + 55
2 com.apple.CoreFoundation 0x00007fff92ab31c4 __CFRunLoopServiceMachPort + 212
3 com.apple.CoreFoundation 0x00007fff92ab268c __CFRunLoopRun + 1356
4 com.apple.CoreFoundation 0x00007fff92ab1ed8 CFRunLoopRunSpecific + 296
5 com.apple.AppKit 0x00007fff9ac8cd95 _NSEventThread + 149
6 libsystem_pthread.dylib 0x00007fff90d0599d _pthread_body + 131
7 libsystem_pthread.dylib 0x00007fff90d0591a _pthread_start + 168
8 libsystem_pthread.dylib 0x00007fff90d03351 thread_start + 13

Thread 5:: com.apple.NSURLConnectionLoader
0 libsystem_kernel.dylib 0x00007fff8d4d9f72 mach_msg_trap + 10
1 libsystem_kernel.dylib 0x00007fff8d4d93b3 mach_msg + 55
2 com.apple.CoreFoundation 0x00007fff92ab31c4 __CFRunLoopServiceMachPort + 212
3 com.apple.CoreFoundation 0x00007fff92ab268c __CFRunLoopRun + 1356
4 com.apple.CoreFoundation 0x00007fff92ab1ed8 CFRunLoopRunSpecific + 296
5 com.apple.CFNetwork 0x00007fff86d61095 +[NSURLConnection(Loader) _resourceLoadLoop:] + 412
6 com.apple.Foundation 0x00007fff98825e64 NSThread__start + 1351
7 libsystem_pthread.dylib 0x00007fff90d0599d _pthread_body + 131
8 libsystem_pthread.dylib 0x00007fff90d0591a _pthread_start + 168
9 libsystem_pthread.dylib 0x00007fff90d03351 thread_start + 13

Thread 6:: com.apple.CFSocket.private
0 libsystem_kernel.dylib 0x00007fff8d4e007a __select + 10
1 com.apple.CoreFoundation 0x00007fff92af04fa __CFSocketManager + 762
2 libsystem_pthread.dylib 0x00007fff90d0599d _pthread_body + 131
3 libsystem_pthread.dylib 0x00007fff90d0591a _pthread_start + 168
4 libsystem_pthread.dylib 0x00007fff90d03351 thread_start + 13

Thread 7:
0 libsystem_kernel.dylib 0x00007fff8d4e05e2 __workq_kernreturn + 10
1 libsystem_pthread.dylib 0x00007fff90d05578 _pthread_wqthread + 1283
2 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Thread 8:: Dispatch queue: com.apple.root.background-qos
0 libsystem_kernel.dylib 0x00007fff8d4e010a __semwait_signal + 10
1 libsystem_c.dylib 0x00007fff864e9d17 nanosleep + 199
2 libsystem_c.dylib 0x00007fff864e9c0a usleep + 54
3 com.docker.docker 0x000000010d38e136 TFC6Docker12TaskInstanceP33_E96D9D758867CC4C7B0BA23827303CE729WaitForTerminationWithTimeOutfT_T + 710
4 com.docker.docker 0x000000010d38be68 TZFC6Docker11TaskManager4StopfT_T + 1896
5 com.docker.docker 0x000000010d3294db TPA__TFFC6Docker11AppDelegate26applicationShouldTerminateFCSo13NSApplicationOSC27NSApplicationTerminateReplyU_FT_T + 43
6 libdispatch.dylib 0x00007fff9586e93d _dispatch_call_block_and_release + 12
7 libdispatch.dylib 0x00007fff9586340b _dispatch_client_callout + 8
8 libdispatch.dylib 0x00007fff9586729b _dispatch_root_queue_drain + 1890
9 libdispatch.dylib 0x00007fff95866b00 _dispatch_worker_thread3 + 91
10 libsystem_pthread.dylib 0x00007fff90d054de _pthread_wqthread + 1129
11 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Thread 9:
0 libsystem_kernel.dylib 0x00007fff8d4e05e2 __workq_kernreturn + 10
1 libsystem_pthread.dylib 0x00007fff90d05578 _pthread_wqthread + 1283
2 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Thread 10:
0 libsystem_kernel.dylib 0x00007fff8d4e05e2 __workq_kernreturn + 10
1 libsystem_pthread.dylib 0x00007fff90d05578 _pthread_wqthread + 1283
2 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Thread 11:
0 libsystem_kernel.dylib 0x00007fff8d4e05e2 __workq_kernreturn + 10
1 libsystem_pthread.dylib 0x00007fff90d05578 _pthread_wqthread + 1283
2 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Thread 12:
0 libsystem_kernel.dylib 0x00007fff8d4e05e2 __workq_kernreturn + 10
1 libsystem_pthread.dylib 0x00007fff90d05578 _pthread_wqthread + 1283
2 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Thread 13:: Dispatch queue: com.apple.root.background-qos
0 libsystem_kernel.dylib 0x00007fff8d4dfde6 __psynch_mutexwait + 10
1 libsystem_pthread.dylib 0x00007fff90d05e4a _pthread_mutex_lock_wait + 89
2 com.apple.Foundation 0x00007fff987f8fb7 -[NSLock lock] + 145
3 com.docker.docker 0x000000010d38bbec TZFC6Docker11TaskManager4StopfT_T + 1260
4 com.docker.docker 0x000000010d3294db TPA__TFFC6Docker11AppDelegate26applicationShouldTerminateFCSo13NSApplicationOSC27NSApplicationTerminateReplyU_FT_T + 43
5 libdispatch.dylib 0x00007fff9586e93d _dispatch_call_block_and_release + 12
6 libdispatch.dylib 0x00007fff9586340b _dispatch_client_callout + 8
7 libdispatch.dylib 0x00007fff9586729b _dispatch_root_queue_drain + 1890
8 libdispatch.dylib 0x00007fff95866b00 _dispatch_worker_thread3 + 91
9 libsystem_pthread.dylib 0x00007fff90d054de _pthread_wqthread + 1129
10 libsystem_pthread.dylib 0x00007fff90d03341 start_wqthread + 13

Thread 1 crashed with X86 Thread State (64-bit):
rax: 0x0000000000000000 rbx: 0x0000000000000006 rcx: 0x0000700000080398 rdx: 0x0000000000000000
rdi: 0x0000000000000a0b rsi: 0x0000000000000006 rbp: 0x00007000000803c0 rsp: 0x0000700000080398
r8: 0x0000000000000000 r9: 0x0000000000989680 r10: 0x000000000c000000 r11: 0x0000000000000206
r12: 0x0000700000080550 r13: 0x00007fff787baf40 r14: 0x0000700000081000 r15: 0x0000700000080430
rip: 0x00007fff8d4dff06 rfl: 0x0000000000000206 cr2: 0x0000556c2548fcf8

Logical CPU: 0
Error Code: 0x0200012d
Trap Number: 133

                            VIRTUAL   REGION 

REGION TYPE SIZE COUNT (non-coalesced)
=========== ======= =======
Accelerate.framework 256K 3
Activity Tracing 2048K 2
CG backing stores 8K 2
CG image 72K 12
CG shared images 208K 7
CoreAnimation 72K 12
CoreUI image data 1108K 10
CoreUI image file 224K 5
Dispatch continuations 8192K 2
Kernel Alloc Once 8K 3
MALLOC 50.7M 30
MALLOC guard page 32K 7
Memory Tag 242 12K 2
OpenCL 8K 2
Process Corpse Info 2048K 2
STACK GUARD 56.1M 15
Stack 14.2M 15
VM_ALLOCATE 184K 21
__DATA 24.9M 255
__IMAGE 528K 2
__LINKEDIT 95.5M 18
__TEXT 190.2M 262
__UNICODE 552K 2
mapped file 59.0M 29
shared memory 16.3M 12
=========== ======= =======
TOTAL 522.0M 707

System Profile:
AirPort: spairport_wireless_card_type_airport_extreme (0x168C, 0x9A), Atheros 9380: 4.0.74.0-P2P
Bluetooth: Version 4.4.5f3 17904, 3 services, 27 devices, 1 incoming serial ports
Thunderbolt Bus: iMac, Apple Inc., 25.1
Memory Module: BANK 0/DIMM0, 4 GB, DDR3, 1333 MHz, 0x859B, 0x435435313236344243313333392E4D313646
Memory Module: BANK 1/DIMM0, 4 GB, DDR3, 1333 MHz, 0x859B, 0x435435313236344243313333392E4D313646
Memory Module: BANK 0/DIMM1, 4 GB, DDR3, 1333 MHz, 0x859B, 0x435435313236344243313333392E4D313646
Memory Module: BANK 1/DIMM1, 4 GB, DDR3, 1333 MHz, 0x859B, 0x435435313236344243313333392E4D313646
USB Device: USB 2.0 Bus
USB Device: Hub
USB Device: USB Trackball
USB Device: IR Receiver
USB Device: Card Reader
USB Device: USB 2.0 Bus
USB Device: FaceTime HD Camera (Built-in)
USB Device: Hub
USB Device: Keyboard Hub
USB Device: Apple Keyboard
USB Device: BRCM2046 Hub
USB Device: Bluetooth USB Host Controller
Serial ATA Device: ST3500418AS, 500.11 GB
Serial ATA Device: HL-DT-STDVDRW GA32N
Model: iMac12,1, BootROM IM121.0047.B23, 4 processors, Intel Core i5, 2.5 GHz, 16 GB, SMC 1.71f22
Network Service: Ethernet, Ethernet, en0
Graphics: AMD Radeon HD 6750M, AMD Radeon HD 6750M, PCIe, 512 MB

Same Issue here when started with docker-compose.

Docker for Mac: version: mac-v1.12.0-beta20
OS X: version 10.11.6 (build: 15G31)
logs: /tmp/20160728-144159.tar.gz
[OK]     docker-cli
[OK]     app
[OK]     moby-syslog
[OK]     virtualization
[OK]     menubar
[OK]     system
[OK]     osxfs
[OK]     db
[OK]     slirp
[OK]     moby-console
[OK]     logs
[OK]     vmnetd
[OK]     env
[OK]     moby
[OK]     driver.amd64-linux

Crashed with stacktrace:

Exception in thread Thread-22:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")
Exception in thread Thread-18:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

Exception in thread Thread-26:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

Exception in thread Thread-20:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")
Exception in thread Thread-23:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

Exception in thread Thread-27:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 190, in watch_events
  File "compose/project.py", line 343, in events
  File "site-packages/docker/client.py", line 251, in _stream_helper
  File "json/__init__.py", line 338, in loads
  File "json/decoder.py", line 369, in decode
ValueError: Extra data: line 2 column 1 - line 13 column 1 (char 652 - 8024)

Exception in thread Thread-14:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")
Exception in thread Thread-17:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

Exception in thread Thread-25:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

Exception in thread Thread-24:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

Exception in thread Thread-15:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")
Exception in thread Thread-21:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")



Exception in thread Thread-19:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")



Exception in thread Thread-16:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 172, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

It happens every time on my Mac after it goes to sleep.

Also seeing this crash behavior this usually happens for me during a build from source when a LOT of i/o is going on. After further investigation i have found that my anti-virus was popping up to 80-90%+ memory usage during the build process. I am running “docker for mac beta 21” atm. After disabling AV it resolved the problem - so my theory is that there are some issues with docker for mac’s resource management functionality… my fix: examine TOP results during your crash and see if an AV program or something else is spiking

Exactly same issue here and disabling A/V resolved the issue. Only happened when running i/o intensive code.

I run a bunch of containers for mail and website and Docker daemon restarts intermittently (around once or twice a day). My containers are run with --restart=always so they automatically restart. Unfortunately, most of the time, my mail or mysql container fails to restart, leaving the old container exit’ed. The Docker daemon then hangs when I try to remove the container sometimes.

So, I have to re-install Docker For Mac and rebuild my images (taking an hour), and then run my containers in the new VM. This is somewhat frustrating. I’m hoping that Docker For Mac will update soon to 1.12.1 (I was told this will come out this week). It has become a morning ritual to reinstall and rebuild and rerun to start my day…

I left the docker containers run overnight. Woke up to find this in my terminal window. This happens a lot.

mongo_1  | 2016-10-21T01:20:05.147+0000 E STORAGE  [thread1] WiredTiger (107) [1477012805:147402][1:0x7f6d9588f700], log-server: /data/db/journal: directory-list: opendir: Transport endpoint is not connected
mongo_1  | 2016-10-21T01:20:05.147+0000 E STORAGE  [thread1] WiredTiger (107) [1477012805:147464][1:0x7f6d9588f700], log-server: log pre-alloc server error: Transport endpoint is not connected
mongo_1  | 2016-10-21T01:20:05.147+0000 E STORAGE  [thread1] WiredTiger (107) [1477012805:147470][1:0x7f6d9588f700], log-server: log server error: Transport endpoint is not connected
Exception in thread Thread-5:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 190, in watch_events
  File "compose/project.py", line 343, in events
  File "site-packages/docker/client.py", line 253, in _stream_helper
  File "json/__init__.py", line 338, in loads
  File "json/decoder.py", line 369, in decode
ValueError: Extra data: line 2 column 1 - line 3 column 1 (char 656 - 1300)

mongo_1  | 2016-10-21T01:20:05.361+0000 I CONTROL  [signalProcessingThread] got signal 15 (Terminated), will terminate after current cmd ends
mongo_1  | 2016-10-21T01:20:05.361+0000 I FTDC     [signalProcessingThread] Shutting down full-time diagnostic data capture
mongo_1  | 2016-10-21T01:20:05.362+0000 I FTDC     [signalProcessingThread] Failed to close full-time diagnostic data capture file manager: FileStreamFailed: Failed to write to archive file buffer for full-time diagnostic data capture: /data/db/diagnostic.data/metrics.2016-10-20T18-22-32Z-00000
mongo_1  | 2016-10-21T01:20:05.362+0000 I CONTROL  [signalProcessingThread] now exiting
mongo_1  | 2016-10-21T01:20:05.362+0000 I NETWORK  [signalProcessingThread] shutdown: going to close listening sockets...
mongo_1  | 2016-10-21T01:20:05.362+0000 I NETWORK  [signalProcessingThread] closing listening socket: 5
mongo_1  | 2016-10-21T01:20:05.362+0000 I NETWORK  [signalProcessingThread] closing listening socket: 6
mongo_1  | 2016-10-21T01:20:05.362+0000 I NETWORK  [signalProcessingThread] removing socket file: /tmp/mongodb-27017.sock
mongo_1  | 2016-10-21T01:20:05.362+0000 I NETWORK  [signalProcessingThread] shutdown: going to flush diaglog...
mongo_1  | 2016-10-21T01:20:05.362+0000 I NETWORK  [signalProcessingThread] shutdown: going to close sockets...
mongo_1  | 2016-10-21T01:20:05.362+0000 I STORAGE  [signalProcessingThread] WiredTigerKVEngine shutting down
mongo_1  | 2016-10-21T01:20:05.362+0000 E STORAGE  [signalProcessingThread] WiredTiger (107) [1477012805:362937][1:0x7f6d97092700], WT_SESSION.commit_transaction: /data/db/journal/WiredTigerLog.0000000084: handle-write: pwrite: failed to write 384 bytes at offset 4992: Transport endpoint is not connected
mongo_1  | 2016-10-21T01:20:05.362+0000 I -        [signalProcessingThread] Invariant failure: session->commit_transaction(session, NULL) resulted in status UnknownError: 107: Transport endpoint is not connected at src/mongo/db/storage/wiredtiger/wiredtiger_size_storer.cpp 229
mongo_1  | 2016-10-21T01:20:05.375+0000 I CONTROL  [signalProcessingThread]
mongo_1  |  0x13287d2 0x12c5c48 0x12af1fd 0x10a4554 0x108c4b6 0x108c66e 0xfb3448 0xcdd22e 0x13271e1 0x1b50620 0x7f6d974460a4 0x7f6d9717b62d
mongo_1  | ----- BEGIN BACKTRACE -----
mongo_1  | {"backtrace":[{"b":"400000","o":"F287D2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"EC5C48","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"EAF1FD","s":"_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j"},{"b":"400000","o":"CA4554","s":"_ZN5mongo20WiredTigerSizeStorer9syncCacheEb"},{"b":"400000","o":"C8C4B6","s":"_ZNK5mongo18WiredTigerKVEngine12syncSizeInfoEb"},{"b":"400000","o":"C8C66E","s":"_ZN5mongo18WiredTigerKVEngine13cleanShutdownEv"},{"b":"400000","o":"BB3448","s":"_ZN5mongo20ServiceContextMongoD34shutdownGlobalStorageEngineCleanlyEv"},{"b":"400000","o":"8DD22E","s":"_ZN5mongo11exitCleanlyENS_8ExitCodeE"},{"b":"400000","o":"F271E1"},{"b":"400000","o":"1750620","s":"execute_native_thread_routine"},{"b":"7F6D9743E000","o":"80A4"},{"b":"7F6D97093000","o":"E862D","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.2.10", "gitVersion" : "79d9b3ab5ce20f51c272b4411202710a082d0317", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.4.20-moby", "version" : "#1 SMP Thu Sep 15 12:10:20 UTC 2016", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "03AADFF60B81BAF2675CA42BB00380AB31F376AF" }, { "b" : "7FFC46571000", "path" : "linux-vdso.so.1", "elfType" : 3, "buildId" : "62A6D37117F69E399C5567F03BF8B6BC5D1F2AA3" }, { "b" : "7F6D9837A000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "0711D67B299ACA3EA6B0B57C0DA4EC83B71787EE" }, { "b" : "7F6D97F7E000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "2E613A282B22F2B0978ACCEC1B71411F5E20CC89" }, { "b" : "7F6D97D76000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "18650C365FBA12BA12DB680B988B7754C0F99364" }, { "b" : "7F6D97B72000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "1D841026FF2C5AEA25C21921FAC9C978AB465825" }, { "b" : "7F6D97871000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "BBA5CF06072F15BEA36FC8B0A2C6A32BBF08C235" }, { "b" : "7F6D9765B000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "D5FB04F64B3DAEA6D6B68B5E8B9D4D2BC1A6E1FC" }, { "b" : "7F6D9743E000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "B9DD2674891C5395C5724321158DC2EB8C7DA64B" }, { "b" : "7F6D97093000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "AD0CE0A6B6E201C9A8195B2D55043AFCD4F5DB00" }, { "b" : "7F6D985DB000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "44DA6E33EBAB324C1D0128F9465425AD355CC978" } ] }}
mongo_1  |  mongod(_ZN5mongo15printStackTraceERSo+0x32) [0x13287d2]
mongo_1  |  mongod(_ZN5mongo10logContextEPKc+0x138) [0x12c5c48]
mongo_1  |  mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xAD) [0x12af1fd]
mongo_1  |  mongod(_ZN5mongo20WiredTigerSizeStorer9syncCacheEb+0xF84) [0x10a4554]
mongo_1  |  mongod(_ZNK5mongo18WiredTigerKVEngine12syncSizeInfoEb+0x16) [0x108c4b6]
mongo_1  |  mongod(_ZN5mongo18WiredTigerKVEngine13cleanShutdownEv+0x8E) [0x108c66e]
mongo_1  |  mongod(_ZN5mongo20ServiceContextMongoD34shutdownGlobalStorageEngineCleanlyEv+0x28) [0xfb3448]
mongo_1  |  mongod(_ZN5mongo11exitCleanlyENS_8ExitCodeE+0x38E) [0xcdd22e]
mongo_1  |  mongod(+0xF271E1) [0x13271e1]
mongo_1  |  mongod(execute_native_thread_routine+0x20) [0x1b50620]
mongo_1  |  libpthread.so.0(+0x80A4) [0x7f6d974460a4]
mongo_1  |  libc.so.6(clone+0x6D) [0x7f6d9717b62d]
mongo_1  | -----  END BACKTRACE  -----
mongo_1  | 2016-10-21T01:20:05.375+0000 I -        [signalProcessingThread]
mongo_1  |
mongo_1  | ***aborting after invariant() failure
mongo_1  |
mongo_1  |
Exception in thread Thread-3:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 174, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

Exception in thread Thread-4:
Traceback (most recent call last):
  File "threading.py", line 810, in __bootstrap_inner
  File "threading.py", line 763, in run
  File "compose/cli/log_printer.py", line 149, in tail_container_logs
  File "compose/cli/log_printer.py", line 179, in wait_on_exit
  File "compose/container.py", line 239, in wait
  File "site-packages/docker/utils/decorators.py", line 21, in wrapped
  File "site-packages/docker/api/container.py", line 441, in wait
  File "site-packages/docker/client.py", line 174, in _raise_for_status
APIError: 502 Server Error: Bad Gateway ("Bad response from Docker engine")

I reduced number of processors for docker to 1 - no sign of this error since then (but that’s only for 1 day now)

Hello,

I accidentally posted this in an older thread (I see @pjar) did the same :slight_smile: - But yeah this is a real stumbling block for me. I’m attempting @pjar’s technique of setting Docker to use only a single CPU to see if that makes any difference.

I am also getting this issue, on the latest version (Version 1.13.0 (15072)) of Docker for Mac.

mysql_1   | Warning: Using a password on the command line interface can be insecure.
Exception in thread Thread-5:
Traceback (most recent call last):
  File "threading.py", line 801, in __bootstrap_inner
  File "threading.py", line 754, in run
  File "compose/cli/log_printer.py", line 197, in watch_events
  File "compose/project.py", line 350, in events
  File "site-packages/docker/api/client.py", line 295, in _stream_helper
  File "json/__init__.py", line 339, in loads
  File "json/decoder.py", line 367, in decode
ValueError: Extra data: line 2 column 1 - line 2 column 648 (char 684 - 1331)

I’ve only noticed it happen when I do docker-compose run without pushing it to the background. I’m using a mysql image, my compose file is as follows;

version: "2"
services:
    mysql:
      image: mysql:5.6
      env_file: .env
      ports:
        - "3306:3306"
      volumes:
        - ./db:/docker-entrypoint-initdb.d
        - db:/var/lib/mysql
      environment:
        - MYSQL_ROOT_PASSWORD=${MYSQL_ROOT_PASSWORD}
volumes:
    db:

As with the others, it seems pretty tempramental, it doesn’t always do it, I am sometimes able to log in to the database, and have a look before it gets killed. “docker-compose ps” returns an empty list after this failure.