Docker Community Forums

Share and learn in the Docker community.

Process stuck, can't open new container

Docker Hub
#1

Hello. Can you please help me with this stuck container behavior of docker-ce on an embedded system?

I am getting a kernel exception, when running an a pre-built ARM64 community image from docker repository. I can run successfully a small number of times. Then I get a kernel exception. When that happens, the container process never exits!

The pertinent information I will enclose. Hopefully you can advise me how to fix, or how to debug. If I need to go to another version of Docker, I will do that. I just need to understand how to work around the issue if required. Also, if you can tell me WHERE the problem is (runc? or dockerd? or containerd?) it would be awesome

Linux OS: OpenWrt 19.07.4
Docker-CE: 18.06.3. Built for ARM64
Target Processor: NXP LS1046A Reference Design Board ARDB

Please note, the dmesg trace actually prints “Fixing recursive fault but reboot is needed!”

[ 296.782435] note: exe[7115] exited with preempt_count 1
[ 296.787663] Fixing recursive fault but reboot is needed! <<<<<<<<<<<<<<<<<<<<<<<

Sincerely, Michael

Here’s my kernel check:

root@OpenWrt:~# ./check-config.sh
info: reading kernel config from /proc/config.gz …

Generally Necessary:

  • cgroup hierarchy: properly mounted [/sys/fs/cgroup]
  • CONFIG_NAMESPACES: enabled
  • CONFIG_NET_NS: enabled
  • CONFIG_PID_NS: enabled
  • CONFIG_IPC_NS: enabled
  • CONFIG_UTS_NS: enabled
  • CONFIG_CGROUPS: enabled
  • CONFIG_CGROUP_CPUACCT: enabled
  • CONFIG_CGROUP_DEVICE: enabled
  • CONFIG_CGROUP_FREEZER: enabled
  • CONFIG_CGROUP_SCHED: enabled
  • CONFIG_CPUSETS: enabled
  • CONFIG_MEMCG: enabled
  • CONFIG_KEYS: enabled
  • CONFIG_VETH: enabled
  • CONFIG_BRIDGE: enabled
  • CONFIG_BRIDGE_NETFILTER: enabled (as module)
  • CONFIG_NF_NAT_IPV4: enabled
  • CONFIG_IP_NF_FILTER: enabled (as module)
  • CONFIG_IP_NF_TARGET_MASQUERADE: enabled (as module)
  • CONFIG_NETFILTER_XT_MATCH_ADDRTYPE: enabled
  • CONFIG_NETFILTER_XT_MATCH_CONNTRACK: enabled (as module)
  • CONFIG_NETFILTER_XT_MATCH_IPVS: enabled
  • CONFIG_IP_NF_NAT: enabled (as module)
  • CONFIG_NF_NAT: enabled
  • CONFIG_NF_NAT_NEEDED: enabled
  • CONFIG_POSIX_MQUEUE: enabled

Optional Features:

  • CONFIG_USER_NS: enabled
  • CONFIG_SECCOMP: enabled
  • CONFIG_CGROUP_PIDS: enabled
  • CONFIG_MEMCG_SWAP: enabled
  • CONFIG_MEMCG_SWAP_ENABLED: enabled
    (cgroup swap accounting is currently enabled)
  • CONFIG_BLK_CGROUP: enabled
  • CONFIG_BLK_DEV_THROTTLING: enabled
  • CONFIG_IOSCHED_CFQ: enabled
  • CONFIG_CFQ_GROUP_IOSCHED: enabled
  • CONFIG_CGROUP_PERF: enabled
  • CONFIG_CGROUP_HUGETLB: missing
  • CONFIG_NET_CLS_CGROUP: enabled
  • CONFIG_CGROUP_NET_PRIO: enabled
  • CONFIG_CFS_BANDWIDTH: enabled
  • CONFIG_FAIR_GROUP_SCHED: enabled
  • CONFIG_RT_GROUP_SCHED: enabled
  • CONFIG_IP_NF_TARGET_REDIRECT: enabled (as module)
  • CONFIG_IP_VS: enabled
  • CONFIG_IP_VS_NFCT: enabled
  • CONFIG_IP_VS_PROTO_TCP: enabled
  • CONFIG_IP_VS_PROTO_UDP: enabled
  • CONFIG_IP_VS_RR: enabled
  • CONFIG_EXT3_FS: enabled
  • CONFIG_EXT3_FS_XATTR: missing
  • CONFIG_EXT3_FS_POSIX_ACL: enabled
  • CONFIG_EXT3_FS_SECURITY: enabled
    (enable these ext3 configs if you are using ext3 as backing filesystem)
  • CONFIG_EXT4_FS: enabled
  • CONFIG_EXT4_FS_POSIX_ACL: enabled
  • CONFIG_EXT4_FS_SECURITY: enabled
  • Network Drivers:
  • “overlay”:
    • CONFIG_VXLAN: enabled (as module)
    • CONFIG_BRIDGE_VLAN_FILTERING: enabled
      Optional (for encrypted networks):
      • CONFIG_CRYPTO: enabled
      • CONFIG_CRYPTO_AEAD: enabled
      • CONFIG_CRYPTO_GCM: missing
      • CONFIG_CRYPTO_SEQIV: missing
      • CONFIG_CRYPTO_GHASH: missing
      • CONFIG_XFRM: enabled
      • CONFIG_XFRM_USER: missing
      • CONFIG_XFRM_ALGO: missing
      • CONFIG_INET_ESP: missing
      • CONFIG_INET_XFRM_MODE_TRANSPORT: enabled
  • “ipvlan”:
    • CONFIG_IPVLAN: enabled
  • “macvlan”:
    • CONFIG_MACVLAN: enabled (as module)
    • CONFIG_DUMMY: enabled
  • “ftp,tftp client in container”:
    • CONFIG_NF_NAT_FTP: enabled
    • CONFIG_NF_CONNTRACK_FTP: enabled
    • CONFIG_NF_NAT_TFTP: enabled
    • CONFIG_NF_CONNTRACK_TFTP: enabled
  • Storage Drivers:
  • “aufs”:
    • CONFIG_AUFS_FS: missing
  • “btrfs”:
    • CONFIG_BTRFS_FS: enabled
    • CONFIG_BTRFS_FS_POSIX_ACL: enabled
  • “devicemapper”:
    • CONFIG_BLK_DEV_DM: enabled
    • CONFIG_DM_THIN_PROVISIONING: enabled
  • “overlay”:
    • CONFIG_OVERLAY_FS: enabled
  • “zfs”:
    • /dev/zfs: missing
    • zfs command: missing
    • zpool command: missing

Limits:

  • /proc/sys/kernel/keys/root_maxkeys: 1000000

root@OpenWrt:~# uname -a
Linux OpenWrt 4.14.195 #0 SMP PREEMPT Sun Sep 6 16:19:39 2020 aarch64 GNU/Linux
root@OpenWrt:~#

root@OpenWrt:/usr/sbin# cd /root
root@OpenWrt:~# ls
docker-binary-aarch64_18.06.3-1_aarch64_generic.ipk scripts
hw

Build and run simple hello world container:

root@OpenWrt:~# docker build --tag hw1 ./hw/
Sending build context to Docker daemon 11.78kB
Step 1/3 : FROM scratch
—>
Step 2/3 : COPY hello /
—> e8914758857f
Step 3/3 : CMD ["/hello"]
—> Running in fcde73845ad6
INFO[2020-12-26T02:50:45.126126280Z] Layer sha256:208cb46920d2a43fbf851c537dceff8136b28660dad0ecdeef47628815d3c33a cleaned up
Removing intermediate container fcde73845ad6
—> 6d0827e5c1fd
Successfully built 6d0827e5c1fd
Successfully tagged hw1:latest

root@OpenWrt:~# docker image ls
REPOSITORY TAG IMAGE ID CREATED SIZE
hw1 latest 6d0827e5c1fd 8 seconds ago 9.14kB

1st Run:
root@OpenWrt:~# docker run --rm --network none hw1
INFO[2020-12-26T02:51:11.555538520Z] No non-localhost DNS nameservers are left in resolv.conf. Using default external servers: [nameserve
r 8.8.8.8 nameserver 8.8.4.4]
INFO[2020-12-26T02:51:11.555575480Z] IPv6 enabled; Adding default IPv6 external servers: [nameserver 2001:4860:4860::8888 nameserver 2001
:4860:4860::8844]
INFO[0057] shim docker-containerd-shim started address="/containerd-shim/moby/8574f72ad27dfb7e9d9023b7395d851d6fb017de19b482b05
8ef67491a8f980f/shim.sock" debug=false pid=6754

Hello from Docker!
This message shows that your installation appears to be working correctly.

To generate this message, Docker took the following steps:

  1. The Docker client contacted the Docker daemon.
  2. The Docker daemon pulled the “hello-world” image from the Docker Hub.
    (arm64v8)
  3. The Docker daemon created a new container from that image which runs the
    executable that produces the output you are currently reading.
  4. The Docker daemon streamed that output to the Docker client, which sent it
    to your terminal.

To try something more ambitious, you can run an Ubuntu container with:
$ docker run -it ubuntu bash

Share images, automate workflows, and more with a free Docker ID:

For more examples and ideas, visit:

INFO[0057] shim reaped id=8574f72ad27dfb7e9d9023b7395d851d6fb017de19b482b058ef67491a8f980f
INFO[2020-12-26T02:51:11.838863520Z] ignoring event module=libcontainerd namespace=moby topic=/tasks/delet
e type="*events.TaskDelete"
.
.

After several identical runs, the console prints this:

[ 291.232816] cgroup: cgroup: disabling cgroup2 socket matching due to net_prio or net_cls activation
[ 293.191295] Unable to handle kernel read from unreadable memory at virtual address 0000000f
[ 293.199653] Mem abort info:
[ 293.202442] Exception class = DABT (current EL), IL = 32 bits
[ 293.208357] SET = 0, FnV = 0
[ 293.211406] EA = 0, S1PTW = 0
[ 293.214541] Data abort info:
[ 293.217465] ISV = 0, ISS = 0x00000004
[ 293.221320] CM = 0, WnR = 0
[ 293.224283] user pgtable: 4k pages, 48-bit VAs, pgd = ffff8009695cf000
[ 293.230808] [000000000000000f] *pgd=00000009cd885003, *pud=00000009ebad1003, *pmd=0000000000000000
[ 293.239769] Internal error: Oops: 96000004 [#1] PREEMPT SMP
[ 293.245332] Modules linked in: ath9k ath9k_common ath9k_hw ath rndis_host nf_conntrack_netlink nf_conntrack_ipv6 mac80211 ipt_MASQUERADE ebtable_nat ebtable_filter ebtable_broute cfg80211 cdc_ether xt_u32 xt_time xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota2 xt_quota xt_psd xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_lscan xt_limit xt_length2 xt_length xt_ipv4options xt_iprange xt_ipp2p xt_iface xt_hl xt_helper xt_hashlimit xt_geoip xt_fuzzy xt_esp xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connlabel xt_connbytes xt_condition xt_comment xt_cluster xt_bpf xt_TRACE xt_TPROXY xt_TEE xt_TCPMSS xt_SYSRQ xt_REDIRECT xt_NFQUEUE xt_NFLOG xt_NETMAP xt_LUA xt_LOGMARK xt_LED xt_IPMARK xt_HL xt_FLOWOFFLOAD xt_DSCP xt_DNETMAP xt_DHCPMAC xt_CT xt_CLASSIFY
[ 293.316661] xt_CHECKSUM xt_DELUDE xt_TARPIT ipt_REJECT xt_CHAOS xt_ACCOUNT usbnet ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress ums_alauda ts_kmp ts_fsm ts_bm rfcomm nfnetlink_queue nfnetlink_log nfnetlink nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_redirect nf_nat_masquerade_ipv4 nf_flow_table_hw nf_flow_table nf_dup_ipv6 nf_dup_ipv4 nf_defrag_ipv6 nf_conntrack_rtcache macvlan iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ah ipt_ECN ipt_CLUSTERIP ip6table_raw ip6t_rpfilter ip_tables hidp hci_uart ebtables ebt_vlan ebt_stp ebt_snat ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_ip ebt_dnat ebt_arpreply ebt_arp ebt_among ebt_802_3 crc_ccitt compat_xtables compat btusb btintel br_netfilter bnep bluetooth
[ 293.387807] sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred i2c_gpio i2c_algo_bit i2c_mux_gpio cryptodev ip6table_mangle ip6table_filter ip6t_REJECT nf_reject_ipv6 nfsv4 nfsv3 nfsd nfs msdos nat46 ip6_tunnel tunnel6 ip_tunnel rpcsec_gss_krb5 auth_rpcgss oid_registry tun lockd sunrpc grace dns_resolver dm_crypt nls_utf8 vxlan udp_tunnel ip6_udp_tunnel ecdh_generic xts algif_skcipher algif_hash af_alg md5 kpp hmac ecb des_generic cts cmac authenc usb_storage xhci_plat_hcd xhci_pci xhci_hcd dwc3 fsl_mph_dr_of ehci_platform ehci_fsl ehci_hcd usbcore usb_common mii
[ 293.445228] Process docker-runc (pid: 6864, stack limit = 0xffff000010d50000)
[ 293.452356] CPU: 3 PID: 6864 Comm: docker-runc Not tainted 4.14.195 #0
[ 293.458875] Hardware name: LS1046A RDB Board (DT)
[ 293.463570] task: ffff80096a3f7280 task.stack: ffff000010d50000
[ 293.469487] pc : account_kernel_stack+0x5c/0x1c0
[ 293.474095] lr : put_task_stack+0x108/0x158
[ 293.478270] sp : ffff000010d53aa0 pstate : 60400145
[ 293.483138] x29: ffff000010d53aa0 x28: ffff80096a3f7280
[ 293.488443] x27: ffff000010d53d18 x26: 0000000000000000
[ 293.493749] x25: ffff80096a3f77e0 x24: 0000000000000080
[ 293.499053] x23: 00000000ffffffff x22: fffffffffffffffc
[ 293.504358] x21: ffff00000a70af38 x20: ffff80096a6bf880
[ 293.509664] x19: 0000000000000008 x18: 0000000000000007
[ 293.514969] x17: 000000000000000e x16: 0000000000000068
[ 293.520274] x15: 000000000000004c x14: 0000000000000033
[ 293.525579] x13: 0000000000000019 x12: 0000000000000001
[ 293.530885] x11: ffff000008ac3620 x10: 0000000000000910
[ 293.536190] x9 : ffff000010d53b40 x8 : ffff80096a3f7bf0
[ 293.541495] x7 : 00000000ffffffff x6 : ffff80096a3f66a8
[ 293.546800] x5 : 00008009750be000 x4 : 00000044438fa800
[ 293.552105] x3 : 0000000000000000 x2 : fffffffffffffffc
[ 293.557410] x1 : 0000000000000009 x0 : 000000000000000f
[ 293.562715] Call trace:
[ 293.565154] account_kernel_stack+0x5c/0x1c0
[ 293.569415] put_task_stack+0x108/0x158
[ 293.573243] finish_task_switch+0x158/0x1b0
[ 293.577419] __schedule+0x4b4/0x520
[ 293.580899] schedule+0x74/0x98
[ 293.584032] futex_wait_queue_me+0xb4/0x118
[ 293.588206] futex_wait+0xcc/0x1c8
[ 293.591599] do_futex+0x150/0xf30
[ 293.594904] SyS_futex+0x138/0x218
[ 293.598296] el0_svc_naked+0x34/0x38
[ 293.601865] Code: aa1603e2 52800121 f8736800 91002273 (f9400000)
[ 293.607951] —[ end trace 6bca586e7aca95a8 ]—
[ 293.612611] note: docker-runc[6864] exited with preempt_count 1
[ 296.359387] Unable to handle kernel paging request at virtual address ffff000010d53ce8
[ 296.367308] Mem abort info:
[ 296.370097] Exception class = DABT (current EL), IL = 32 bits
[ 296.376012] SET = 0, FnV = 0
[ 296.379062] EA = 0, S1PTW = 0
[ 296.382197] Data abort info:
[ 296.385068] ISV = 0, ISS = 0x00000007
[ 296.388901] CM = 0, WnR = 0
[ 296.391865] swapper pgtable: 4k pages, 48-bit VAs, pgd = ffff00000a886000
[ 296.398650] [ffff000010d53ce8] *pgd=00000009ff7fe003, *pud=00000009ff7fd003, *pmd=00000009eb821003, *pte=0000000000000000
[ 296.409610] Internal error: Oops: 96000007 [#2] PREEMPT SMP
[ 296.415174] Modules linked in: ath9k ath9k_common ath9k_hw ath rndis_host nf_conntrack_netlink nf_conntrack_ipv6 mac80211 ipt_MASQUERADE ebtable_nat ebtable_filter ebtable_broute cfg80211 cdc_ether xt_u32 xt_time xt_tcpmss xt_string xt_statistic xt_state xt_socket xt_recent xt_quota2 xt_quota xt_psd xt_pkttype xt_physdev xt_owner xt_nat xt_multiport xt_mark xt_mac xt_lscan xt_limit xt_length2 xt_length xt_ipv4options xt_iprange xt_ipp2p xt_iface xt_hl xt_helper xt_hashlimit xt_geoip xt_fuzzy xt_esp xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connlabel xt_connbytes xt_condition xt_comment xt_cluster xt_bpf xt_TRACE xt_TPROXY xt_TEE xt_TCPMSS xt_SYSRQ xt_REDIRECT xt_NFQUEUE xt_NFLOG xt_NETMAP xt_LUA xt_LOGMARK xt_LED xt_IPMARK xt_HL xt_FLOWOFFLOAD xt_DSCP xt_DNETMAP xt_DHCPMAC xt_CT xt_CLASSIFY
[ 296.486501] xt_CHECKSUM xt_DELUDE xt_TARPIT ipt_REJECT xt_CHAOS xt_ACCOUNT usbnet ums_usbat ums_sddr55 ums_sddr09 ums_karma ums_jumpshot ums_isd200 ums_freecom ums_datafab ums_cypress ums_alauda ts_kmp ts_fsm ts_bm rfcomm nfnetlink_queue nfnetlink_log nfnetlink nf_socket_ipv6 nf_socket_ipv4 nf_reject_ipv4 nf_nat_redirect nf_nat_masquerade_ipv4 nf_flow_table_hw nf_flow_table nf_dup_ipv6 nf_dup_ipv4 nf_defrag_ipv6 nf_conntrack_rtcache macvlan iptable_raw iptable_nat iptable_mangle iptable_filter ipt_rpfilter ipt_ah ipt_ECN ipt_CLUSTERIP ip6table_raw ip6t_rpfilter ip_tables hidp hci_uart ebtables ebt_vlan ebt_stp ebt_snat ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_ip ebt_dnat ebt_arpreply ebt_arp ebt_among ebt_802_3 crc_ccitt compat_xtables compat btusb btintel br_netfilter bnep bluetooth
[ 296.557646] sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred i2c_gpio i2c_algo_bit i2c_mux_gpio cryptodev ip6table_mangle ip6table_filter ip6t_REJECT nf_reject_ipv6 nfsv4 nfsv3 nfsd nfs msdos nat46 ip6_tunnel tunnel6 ip_tunnel rpcsec_gss_krb5 auth_rpcgss oid_registry tun lockd sunrpc grace dns_resolver dm_crypt nls_utf8 vxlan udp_tunnel ip6_udp_tunnel ecdh_generic xts algif_skcipher algif_hash af_alg md5 kpp hmac ecb des_generic cts cmac authenc usb_storage xhci_plat_hcd xhci_pci xhci_hcd dwc3 fsl_mph_dr_of ehci_platform ehci_fsl ehci_hcd usbcore usb_common mii
[ 296.615067] Process exe (pid: 7115, stack limit = 0xffff000011248000)
[ 296.621501] CPU: 3 PID: 7115 Comm: exe Tainted: G D 4.14.195 #0
[ 296.628541] Hardware name: LS1046A RDB Board (DT)
[ 296.633235] task: ffff80096a2ba240 task.stack: ffff000011248000
[ 296.639152] pc : futex_wake+0x78/0x160
[ 296.642893] lr : futex_wake+0x74/0x160
[ 296.646633] sp : ffff00001124b9f0 pstate : 40400145
[ 296.651501] x29: ffff00001124b9f0 x28: ffff80096a2ba240
[ 296.656806] x27: ffff8009693eaac0 x26: 0000000000000000
[ 296.662112] x25: 0000000000000001 x24: 00000000ffffffff
[ 296.667418] x23: ffff00000b5b8a84 x22: 0000000000000000
[ 296.672723] x21: ffff00001124ba48 x20: ffff00000b5b8a88
[ 296.678028] x19: ffff00000a70a000 x18: 0000000000000007
[ 296.683332] x17: 000000000000000e x16: 0000000000000068
[ 296.688638] x15: 000000000000004c x14: 0000000000000033
[ 296.693943] x13: 0000000000000019 x12: 0000000000000001
[ 296.699248] x11: ffff000008ac3620 x10: 0000000000000910
[ 296.704553] x9 : ffff00001124bb40 x8 : ffff80096a2babb0
[ 296.709858] x7 : 0000000000000000 x6 : ffff00000a70b000
[ 296.715164] x5 : 00000000281abead x4 : 00000000000003ff
[ 296.720469] x3 : 0000000000000000 x2 : ffff000010d53ce8
[ 296.725774] x1 : 0000000001010101 x0 : ffff00000b5b8a84
[ 296.731079] Call trace:
[ 296.733518] futex_wake+0x78/0x160
[ 296.736910] do_futex+0x174/0xf30
[ 296.740216] SyS_futex+0x138/0x218
[ 296.743609] mm_release+0x150/0x198
[ 296.747089] exit_mm_release+0x24/0x30
[ 296.750829] do_exit+0x220/0x918
[ 296.754048] SyS_exit_group+0x0/0x10
[ 296.757615] get_signal+0x514/0x5a8
[ 296.761096] do_signal+0x6c/0x578
[ 296.764401] do_notify_resume+0x80/0x250
[ 296.768315] work_pending+0x8/0x10
[ 296.771710] Code: 91001017 aa1703e0 94246b76 f8408e82 (f85e8453)
[ 296.777796] —[ end trace 6bca586e7aca95a9 ]—
[ 296.782435] note: exe[7115] exited with preempt_count 1
[ 296.787663] Fixing recursive fault but reboot is needed!

It looks to me like the issue is in docker-runc??? But something has been tainted…

This is my process table. Mr. 7307 is clearly stuck…

root@OpenWrt:~# ps aux
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.2 0.0 3000 2116 ? Ss 02:07 0:07 /sbin/procd
root 2 0.0 0.0 0 0 ? S 02:07 0:00 [kthreadd]
root 4 0.0 0.0 0 0 ? I< 02:07 0:00 [kworker/0:0H]
root 6 0.0 0.0 0 0 ? I< 02:07 0:00 [mm_percpu_wq]
root 7 0.0 0.0 0 0 ? S 02:07 0:00 [ksoftirqd/0]
root 8 0.0 0.0 0 0 ? I 02:07 0:00 [rcu_preempt]
root 9 0.0 0.0 0 0 ? I 02:07 0:00 [rcu_sched]
root 10 0.0 0.0 0 0 ? I 02:07 0:00 [rcu_bh]
root 11 0.0 0.0 0 0 ? S 02:07 0:00 [migration/0]
root 12 0.0 0.0 0 0 ? S 02:07 0:00 [cpuhp/0]
root 13 0.0 0.0 0 0 ? S 02:07 0:00 [cpuhp/1]
root 14 0.0 0.0 0 0 ? S 02:07 0:00 [migration/1]
root 15 0.0 0.0 0 0 ? S 02:07 0:00 [ksoftirqd/1]
root 16 0.0 0.0 0 0 ? I 02:07 0:00 [kworker/1:0]
root 17 0.0 0.0 0 0 ? I< 02:07 0:00 [kworker/1:0H]
root 18 0.0 0.0 0 0 ? S 02:07 0:00 [cpuhp/2]
root 19 0.0 0.0 0 0 ? S 02:07 0:00 [migration/2]
root 20 0.0 0.0 0 0 ? S 02:07 0:00 [ksoftirqd/2]
root 22 0.0 0.0 0 0 ? I< 02:07 0:00 [kworker/2:0H]
root 23 0.0 0.0 0 0 ? S 02:07 0:00 [cpuhp/3]
root 24 0.0 0.0 0 0 ? S 02:07 0:00 [migration/3]
root 25 0.0 0.0 0 0 ? S 02:07 0:00 [ksoftirqd/3]
root 27 0.0 0.0 0 0 ? I< 02:07 0:00 [kworker/3:0H]
root 28 0.0 0.0 0 0 ? I< 02:07 0:00 [netns]
root 33 0.0 0.0 0 0 ? I 02:07 0:00 [kworker/u8:2]
root 43 0.0 0.0 0 0 ? I 02:07 0:00 [kworker/3:1]
root 64 0.0 0.0 0 0 ? I 02:07 0:01 [kworker/0:1]
root 75 0.0 0.0 0 0 ? I 02:07 0:00 [kworker/2:1]
root 446 0.0 0.0 0 0 ? S 02:07 0:00 [khungtaskd]
root 447 0.0 0.0 0 0 ? S 02:07 0:00 [oom_reaper]
root 448 0.0 0.0 0 0 ? I< 02:07 0:00 [writeback]
root 450 0.0 0.0 0 0 ? S 02:07 0:00 [kcompactd0]
root 451 0.0 0.0 0 0 ? SN 02:07 0:00 [ksmd]
root 452 0.0 0.0 0 0 ? SN 02:07 0:00 [khugepaged]
root 453 0.0 0.0 0 0 ? I< 02:07 0:00 [crypto]
root 454 0.0 0.0 0 0 ? I< 02:07 0:00 [kintegrityd]
root 456 0.0 0.0 0 0 ? I< 02:07 0:00 [kblockd]
root 501 0.0 0.0 0 0 ? I< 02:07 0:00 [ata_sff]
root 528 0.0 0.0 0 0 ? I< 02:07 0:00 [md]
root 549 0.0 0.0 0 0 ? I< 02:07 0:00 [watchdogd]
root 699 0.0 0.0 0 0 ? S 02:07 0:00 [kauditd]
root 704 0.0 0.0 0 0 ? S 02:07 0:00 [kswapd0]
root 707 0.0 0.0 0 0 ? I< 02:07 0:00 [xfsalloc]
root 708 0.0 0.0 0 0 ? I< 02:07 0:00 [xfs_mru_cache]
root 714 0.0 0.0 0 0 ? I< 02:07 0:00 [pencrypt]
root 716 0.0 0.0 0 0 ? I< 02:07 0:00 [pdecrypt]
root 730 0.0 0.0 0 0 ? I< 02:07 0:00 [kthrotld]
root 894 0.0 0.0 0 0 ? S 02:07 0:00 [scsi_eh_0]
root 895 0.0 0.0 0 0 ? I< 02:07 0:00 [scsi_tmf_0]
root 1948 0.0 0.0 0 0 ? I< 02:07 0:00 [vfio-irqfd-clea]
root 1984 0.0 0.0 0 0 ? I< 02:07 0:00 [dm_bufio_cache]
root 2020 0.0 0.0 0 0 ? I< 02:07 0:00 [ipv6_addrconf]
root 2597 0.0 0.0 2376 1696 ? S 02:07 0:00 /sbin/ubusd
root 2615 0.0 0.0 2052 288 ? S 02:07 0:00 /sbin/urngd
root 2703 0.0 0.0 0 0 ? I< 02:07 0:00 [rpciod]
root 2704 0.0 0.0 0 0 ? I< 02:07 0:00 [xprtiod]
root 2736 0.0 0.0 0 0 ? I< 02:07 0:00 [nfsiod]
root 2771 0.0 0.0 0 0 ? I< 02:07 0:00 [cryptodev_queue]
root 3144 0.0 0.0 0 0 ? S< 02:07 0:00 [krfcommd]
root 3486 0.0 0.0 0 0 ? I< 02:07 0:00 [cfg80211]
root 3819 0.0 0.0 0 0 ? I< 02:07 0:00 [kworker/0:1H]
rpc 4015 0.0 0.0 2716 1764 ? S 02:07 0:00 /usr/sbin/rpcbind -f -w
root 4049 0.0 0.0 2780 2040 ? S 02:07 0:00 /sbin/netifd
root 4060 0.0 0.0 0 0 ? I< 02:07 0:00 [kworker/1:1H]
root 4063 0.0 0.0 0 0 ? I< 02:07 0:00 [kworker/2:1H]
root 4065 0.0 0.0 0 0 ? I< 02:07 0:00 [kworker/3:1H]
root 4113 0.0 0.0 5908 4548 ? S 02:07 0:00 /usr/sbin/sshd -D
root 4157 0.0 0.0 2932 1120 ? Ss 02:07 0:00 /usr/bin/dbus-daemon --system
nobody 4236 0.0 0.0 3660 2588 ? S 02:07 0:00 avahi-daemon: running [OpenWrt.local]
root 4252 0.0 0.0 0 0 ? I 02:07 0:00 [kworker/0:2]
root 4296 0.0 0.0 4588 2944 ? S 02:07 0:00 /usr/bin/bluetoothd -n
dnsmasq 5243 0.0 0.0 2560 1900 ? S 02:07 0:00 /usr/sbin/dnsmasq -C /var/etc/dnsmasq.conf.cfg01411c -k -x /var/run/dnsmasq/dnsmasq.cfg01411c.pid
root 5537 0.0 0.0 0 0 ? I< 02:49 0:00 [kdmflush]
root 5539 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5540 0.0 0.0 0 0 ? I< 02:49 0:00 [kcryptd_io]
root 5542 0.0 0.0 0 0 ? I< 02:49 0:00 [kcryptd]
root 5543 0.0 0.0 0 0 ? S 02:49 0:00 [dmcrypt_write]
root 5544 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5558 0.0 0.0 0 0 ? I< 02:49 0:00 [kdmflush]
root 5560 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5564 0.0 0.0 0 0 ? I< 02:49 0:00 [kdmflush]
root 5566 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5570 0.0 0.0 0 0 ? I< 02:49 0:00 [kdmflush]
root 5571 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5575 0.0 0.0 0 0 ? I< 02:49 0:00 [kdmflush]
root 5576 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5580 0.0 0.0 0 0 ? I< 02:49 0:00 [kdmflush]
root 5581 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5585 0.0 0.0 0 0 ? I< 02:49 0:00 [kdmflush]
root 5586 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5590 0.0 0.0 0 0 ? I< 02:49 0:00 [kdmflush]
root 5592 0.0 0.0 0 0 ? I< 02:49 0:00 [bioset]
root 5610 0.0 0.0 0 0 ? I< 02:49 0:00 [kworker/u9:2]
root 5617 0.0 0.0 0 0 ? I< 02:49 0:00 [kworker/u9:3]
root 5621 0.0 0.0 0 0 ? S 02:49 0:00 [jbd2/dm-5-8]
root 5622 0.0 0.0 0 0 ? I< 02:49 0:00 [ext4-rsv-conver]
root 5637 0.0 0.0 0 0 ? S 02:49 0:00 [jbd2/dm-7-8]
root 5638 0.0 0.0 0 0 ? I< 02:49 0:00 [ext4-rsv-conver]
root 5665 0.0 0.0 0 0 ? S 02:49 0:00 [jbd2/dm-1-8]
root 5666 0.0 0.0 0 0 ? I< 02:49 0:00 [ext4-rsv-conver]
root 5680 0.0 0.0 0 0 ? S 02:49 0:00 [jbd2/dm-2-8]
root 5681 0.0 0.0 0 0 ? I< 02:49 0:00 [ext4-rsv-conver]
root 5692 0.0 0.0 0 0 ? I 02:49 0:00 [kworker/u8:3]
root 5694 0.8 0.4 520756 36004 ? Sl 02:49 0:04 docker-containerd
root 5708 0.2 0.8 724756 71796 ? Sl 02:50 0:01 dockerd
root 5716 0.6 0.5 554676 43092 ? Ssl 02:50 0:03 docker-containerd --config /var/run/docker/containerd/containerd.toml
root 6854 0.0 0.0 0 0 ? I 02:51 0:00 [kworker/3:2]
root 6943 0.0 0.0 0 0 ? I 02:51 0:00 [kworker/1:2]
root 7184 0.0 0.0 0 0 ? I 02:51 0:00 [kworker/2:2]
root 7196 0.1 0.0 7528 4104 ? Sl 02:51 0:00 docker-containerd-shim -namespace moby -workdir /var/lib/docker/containerd/daemon/io.containerd.runtime.v1.linux/moby/2d5ca5fd4ef02b8a5715ddb3a371f92
root 7218 0.3 0.0 0 0 ? Ds 02:51 0:01 [hello]
root 7260 0.0 0.0 0 0 ? X 02:54 0:00 [docker-runc]
root 7266 0.0 0.0 0 0 ? I 02:54 0:00 [kworker/0:3]
root 7267 0.0 0.0 5908 4708 ? Ss 02:54 0:00 sshd: root@pts/1
root 7270 0.0 0.0 3548 2004 pts/1 Ss 02:54 0:00 -ash
root 7271 0.0 0.0 0 0 ? I 02:54 0:00 [kworker/u8:0]
root 7307 0.0 0.3 38696 24472 pts/1 Sl+ 02:56 0:00 docker run --rm --network none hw1
root 7318 0.0 0.0 3548 1740 ttyS0 Ss 02:57 0:00 -ash
root 7326 0.0 0.0 2948 1632 ttyS0 R+ 02:58 0:00 ps aux

Please suggest a debug approach?

Thanks for your help!