Периодическое зависание контроллера

Программное обеспечение
1

Добрый день! Имеется контроллер Wirenboard 7.3.4B/3 b.677, версия прошивки 2310 Stable. Проблема в том, что контроллер периодически зависает (раз в несколько дней). При этом в Debug Console следующее содержимое:

[61853.612536] rcu: INFO: rcu_sched self-detected stall on CPU
[61853.618134] rcu:     3-...!: (8343 ticks this GP) idle=81e/1/0x40000002 softirq=2713559/2713559 fqs=0 
[61853.627171]  (t=8404 jiffies g=9748009 q=11710)
[61853.631704] rcu: rcu_sched kthread starved for 8404 jiffies! g9748009 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
[61853.641956] rcu:     Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[61853.650906] rcu: RCU grace-period kthread stack dump:
[61853.655958] task:rcu_sched       state:R  running task     stack:    0 pid:   12 ppid:     2 flags:0x00000000
[61853.665876] Backtrace: 
[61853.668349] [<c0a10c90>] (__schedule) from [<c0a116dc>] (schedule+0x6c/0xe0)
[61853.675409]  r10:c107c2c0 r9:c156a000 r8:c115e960 r7:c1003d00 r6:c156bec4 r5:c156a000
[61853.683235]  r4:c1544fc0
[61853.685787] [<c0a11670>] (schedule) from [<c0a1588c>] (schedule_timeout+0xa8/0x1a4)
[61853.693466]  r5:c1003d00 r4:005dcb87
[61853.697075] [<c0a157e4>] (schedule_timeout) from [<c01a8ddc>] (rcu_gp_kthread+0x658/0x115c)
[61853.705432]  r7:c1003d00 r6:00000001 r5:00000001 r4:00000000
[61853.711104] [<c01a8784>] (rcu_gp_kthread) from [<c014a710>] (kthread+0x168/0x16c)
[61853.718611]  r7:c156a000
[61853.721172] [<c014a5a8>] (kthread) from [<c0100114>] (ret_from_fork+0x14/0x20)
[61853.728396] Exception stack(0xc156bfb0 to 0xc156bff8)
[61853.733451] bfa0:                                     00000000 00000000 00000000 00000000
[61853.741627] bfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[61853.749825] bfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[61853.756478]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014a5a8
[61853.764336]  r4:c14f1cc0
[61853.766897] NMI backtrace for cpu 3
[61853.770401] CPU: 3 PID: 869 Comm: RTW_CMD_THREAD Not tainted 5.10.35-wb159 #1
[61853.777532] Hardware name: Allwinner sun8i Family
[61853.782256] Backtrace: 
[61853.784760] [<c0a05218>] (dump_backtrace) from [<c0a054c0>] (show_stack+0x20/0x24)
[61853.792359]  r7:ffffffff r6:60010193 r5:00000000 r4:c10e4998
[61853.798059] [<c0a054a0>] (show_stack) from [<c0a08e30>] (dump_stack+0xb4/0xd4)
[61853.805318] [<c0a08d7c>] (dump_stack) from [<c057fbf4>] (nmi_cpu_backtrace+0xd0/0xfc)
[61853.813179]  r9:c0d44e0c r8:c0b01ff4 r7:00000000 r6:00000003 r5:00000000 r4:00000003
[61853.820949] [<c057fb24>] (nmi_cpu_backtrace) from [<c057fd14>] (nmi_trigger_cpumask_backtrace+0xf4/0x13c)
[61853.830535]  r5:c100590c r4:c010e660
[61853.834157] [<c057fc20>] (nmi_trigger_cpumask_backtrace) from [<c010f824>] (arch_trigger_cpumask_backtrace+0x20/0x24)
[61853.844788]  r9:c0d44e0c r8:c115dd15 r7:c1004f58 r6:c107c2c0 r5:c107c2c0 r4:00000003
[61853.852580] [<c010f804>] (arch_trigger_cpumask_backtrace) from [<c0a06d30>] (rcu_dump_cpu_stacks+0x104/0x13c)
[61853.862538] [<c0a06c2c>] (rcu_dump_cpu_stacks) from [<c01aa3ac>] (rcu_sched_clock_irq+0x7f8/0xa84)
[61853.871533]  r10:2de32000 r9:c1003d00 r8:c0f9e140 r7:c115e940 r6:00000000 r5:eedd0140
[61853.879369]  r4:c107c2c0
[61853.881924] [<c01a9bb4>] (rcu_sched_clock_irq) from [<c01b4a90>] (update_process_times+0x6c/0x8c)
[61853.890823]  r10:eedc9990 r9:60010193 r8:c6e70000 r7:c6e71dc8 r6:00003841 r5:c6e70000
[61853.898676]  r4:00000000
[61853.901252] [<c01b4a24>] (update_process_times) from [<c01c94c0>] (tick_sched_handle+0x64/0x68)
[61853.909969]  r5:65167b79 r4:eedc9990
[61853.913586] [<c01c945c>] (tick_sched_handle) from [<c01c9a90>] (tick_sched_timer+0x8c/0x128)
[61853.922039] [<c01c9a04>] (tick_sched_timer) from [<c01b57d4>] (__hrtimer_run_queues+0xf8/0x3f8)
[61853.930745]  r9:60010193 r8:c6e70000 r7:00000000 r6:c01c9a04 r5:eedc9640 r4:eedc9680
[61853.938497] [<c01b56dc>] (__hrtimer_run_queues) from [<c01b68d4>] (hrtimer_interrupt+0x134/0x354)
[61853.947375]  r10:eedc9718 r9:eedc96f0 r8:eedc96c8 r7:6516795b r6:00003841 r5:60010193
[61853.955226]  r4:eedc9640
[61853.957802] [<c01b67a0>] (hrtimer_interrupt) from [<c07ab824>] (arch_timer_handler_phys+0x38/0x40)
[61853.966785]  r10:f0895000 r9:c6e71dc8 r8:c14e0000 r7:c14e4940 r6:0000001c r5:c1005924
[61853.974644]  r4:c14dfc00
[61853.977226] [<c07ab7ec>] (arch_timer_handler_phys) from [<c0194324>] (handle_percpu_devid_irq+0x9c/0x244)
[61853.986834] [<c0194288>] (handle_percpu_devid_irq) from [<c018d930>] (__handle_domain_irq+0x8c/0xe0)
[61853.995995]  r7:00000001 r6:00000000 r5:00000000 r4:c0f9cc34
[61854.001702] [<c018d8a4>] (__handle_domain_irq) from [<c010149c>] (gic_handle_irq+0x8c/0xa0)
[61854.010083]  r9:c6e71dc8 r8:f080200c r7:c0f9cc40 r6:f0802000 r5:c10e4ae8 r4:c1005924
[61854.017868] [<c0101410>] (gic_handle_irq) from [<c0100af0>] (__irq_svc+0x70/0x98)
[61854.025379] Exception stack(0xc6e71dc8 to 0xc6e71e10)
[61854.030445] 1dc0:                   bf267054 00000000 0000da2b 0000da2a f0896578 f22095c0
[61854.038646] 1de0: f0896ab8 f0895000 f0896980 f220eeac f0895000 c6e71e2c c6e71e18 c6e71e18
[61854.046845] 1e00: c0a16d00 c0a16d2c 80010013 ffffffff
[61854.051932]  r9:c6e70000 r8:f0896980 r7:c6e71dfc r6:ffffffff r5:80010013 r4:c0a16d2c
[61854.060155] [<c0a16cdc>] (_raw_spin_lock_bh) from [<bf267054>] (rtw_free_stainfo+0x54/0x378 [8723bu])
[61854.069408]  r5:f22095c0 r4:f0896578
[61854.073557] [<bf267000>] (rtw_free_stainfo [8723bu]) from [<bf269948>] (expire_timeout_chk+0xe4/0x488 [8723bu])
[61854.083677]  r10:f0895000 r9:f0896000 r8:f0896980 r7:f0896ac8 r6:f0896ab8 r5:f22095c0
[61854.091531]  r4:f220f468
[61854.094654] [<bf269864>] (expire_timeout_chk [8723bu]) from [<bf23eddc>] (dynamic_chk_wk_hdl+0x64/0x68 [8723bu])
[61854.104867]  r10:c6e70000 r9:f0896488 r8:f0898000 r7:f0896488 r6:f08964a8 r5:f0895000
[61854.112720]  r4:f0895000
[61854.115838] [<bf23ed78>] (dynamic_chk_wk_hdl [8723bu]) from [<bf23f2b0>] (rtw_drvextra_cmd_hdl+0xb0/0x350 [8723bu])
[61854.126280]  r5:f0895000 r4:c331c200
[61854.130419] [<bf23f200>] (rtw_drvextra_cmd_hdl [8723bu]) from [<bf23ca3c>] (rtw_cmd_thread+0x18c/0x3a8 [8723bu])
[61854.140618]  r9:f0896488 r8:f0898000 r7:f0896488 r6:f08964a8 r5:f0895000 r4:c2e72100
[61854.148796] [<bf23c8b0>] (rtw_cmd_thread [8723bu]) from [<c014a710>] (kthread+0x168/0x16c)
[61854.157107]  r10:c3691814 r9:f0895000 r8:bf23c8b0 r7:c6e70000 r6:00000000 r5:c2811780
[61854.164963]  r4:c320a8c0
[61854.167537] [<c014a5a8>] (kthread) from [<c0100114>] (ret_from_fork+0x14/0x20)
[61854.174779] Exception stack(0xc6e71fb0 to 0xc6e71ff8)
[61854.179861] 1fa0:                                     00000000 00000000 00000000 00000000
[61854.188069] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[61854.196252] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[61854.202895]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014a5a8
[61854.210754]  r4:c2811780
hostnamectl
[61872.307167] systemd[1]: systemd-logind.service: Watchdog timeout (limit 3min)!
[61872.314752] systemd[1]: systemd-logind.service: Killing process 29050 (systemd-logind) with signal SIGABRT.
hostnamectl
[61897.710067] systemd[1]: wb-connection-manager.service: Main process exited, code=exited, status=1/FAILURE
[61897.722360] systemd[1]: wb-connection-manager.service: Failed with result 'exit-code'.
[61897.735529] systemd[1]: wb-connection-manager.service: Consumed 11min 5.137s CPU time.
[61899.809211] systemd[1]: wb-connection-manager.service: Scheduled restart job, restart counter is at 2.
[61899.822946] systemd[1]: Stopped Network connections management service for Wiren Board devices.
[61899.832498] systemd[1]: wb-connection-manager.service: Consumed 11min 5.137s CPU time.
[61899.860243] systemd[1]: Started Network connections management service for Wiren Board devices.
ifconfig
[61916.642615] rcu: INFO: rcu_sched self-detected stall on CPU
[61916.648214] rcu:     3-...!: (14587 ticks this GP) idle=81e/1/0x40000002 softirq=2713559/2713559 fqs=0 
[61916.657336]  (t=14707 jiffies g=9748009 q=13167)
[61916.661952] rcu: rcu_sched kthread starved for 14707 jiffies! g9748009 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
[61916.672283] rcu:     Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[61916.681226] rcu: RCU grace-period kthread stack dump:
[61916.686271] task:rcu_sched       state:R  running task     stack:    0 pid:   12 ppid:     2 flags:0x00000000
[61916.696180] Backtrace: 
[61916.698644] [<c0a10c90>] (__schedule) from [<c0a116dc>] (schedule+0x6c/0xe0)
[61916.705689]  r10:c107c2c0 r9:c156a000 r8:c115e960 r7:c1003d00 r6:c156bec4 r5:c156a000
[61916.713509]  r4:c1544fc0
[61916.716051] [<c0a11670>] (schedule) from [<c0a1588c>] (schedule_timeout+0xa8/0x1a4)
[61916.723699]  r5:c1003d00 r4:005dcb87
[61916.727282] [<c0a157e4>] (schedule_timeout) from [<c01a8ddc>] (rcu_gp_kthread+0x658/0x115c)
[61916.735624]  r7:c1003d00 r6:00000001 r5:00000001 r4:00000000
[61916.741286] [<c01a8784>] (rcu_gp_kthread) from [<c014a710>] (kthread+0x168/0x16c)
[61916.748759]  r7:c156a000
[61916.751297] [<c014a5a8>] (kthread) from [<c0100114>] (ret_from_fork+0x14/0x20)
[61916.758510] Exception stack(0xc156bfb0 to 0xc156bff8)
[61916.763556] bfa0:                                     00000000 00000000 00000000 00000000
[61916.771724] bfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[61916.779890] bfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[61916.786499]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014a5a8
[61916.794317]  r4:c14f1cc0
[61916.796851] NMI backtrace for cpu 3
[61916.800342] CPU: 3 PID: 869 Comm: RTW_CMD_THREAD Not tainted 5.10.35-wb159 #1
[61916.807464] Hardware name: Allwinner sun8i Family
[61916.812161] Backtrace: 
[61916.814616] [<c0a05218>] (dump_backtrace) from [<c0a054c0>] (show_stack+0x20/0x24)
[61916.822178]  r7:ffffffff r6:60010193 r5:00000000 r4:c10e4998
[61916.827837] [<c0a054a0>] (show_stack) from [<c0a08e30>] (dump_stack+0xb4/0xd4)
[61916.835059] [<c0a08d7c>] (dump_stack) from [<c057fbf4>] (nmi_cpu_backtrace+0xd0/0xfc)
[61916.842882]  r9:c0d44e0c r8:c0b01ff4 r7:00000000 r6:00000003 r5:00000000 r4:00000003
[61916.850620] [<c057fb24>] (nmi_cpu_backtrace) from [<c057fd14>] (nmi_trigger_cpumask_backtrace+0xf4/0x13c)
[61916.860173]  r5:c100590c r4:c010e660
[61916.863753] [<c057fc20>] (nmi_trigger_cpumask_backtrace) from [<c010f824>] (arch_trigger_cpumask_backtrace+0x20/0x24)
[61916.874351]  r9:c0d44e0c r8:c115dd15 r7:c1004f58 r6:c107c2c0 r5:c107c2c0 r4:00000003
[61916.882090] [<c010f804>] (arch_trigger_cpumask_backtrace) from [<c0a06d30>] (rcu_dump_cpu_stacks+0x104/0x13c)
[61916.891997] [<c0a06c2c>] (rcu_dump_cpu_stacks) from [<c01aa3ac>] (rcu_sched_clock_irq+0x7f8/0xa84)
[61916.900950]  r10:2de32000 r9:c1003d00 r8:c0f9e140 r7:c115e940 r6:00000000 r5:eedd0140
[61916.908768]  r4:c107c2c0
[61916.911306] [<c01a9bb4>] (rcu_sched_clock_irq) from [<c01b4a90>] (update_process_times+0x6c/0x8c)
[61916.920169]  r10:eedc9990 r9:60010193 r8:c6e70000 r7:c6e71dc8 r6:00003850 r5:c6e70000
[61916.927987]  r4:00000000
[61916.930526] [<c01b4a24>] (update_process_times) from [<c01c94c0>] (tick_sched_handle+0x64/0x68)
[61916.939212]  r5:11f7f52c r4:eedc9990
[61916.942790] [<c01c945c>] (tick_sched_handle) from [<c01c9a90>] (tick_sched_timer+0x8c/0x128)
[61916.951221] [<c01c9a04>] (tick_sched_timer) from [<c01b57d4>] (__hrtimer_run_queues+0xf8/0x3f8)
[61916.959910]  r9:60010193 r8:c6e70000 r7:00000000 r6:c01c9a04 r5:eedc9640 r4:eedc9680
[61916.967646] [<c01b56dc>] (__hrtimer_run_queues) from [<c01b68d4>] (hrtimer_interrupt+0x134/0x354)
[61916.976510]  r10:eedc9718 r9:eedc96f0 r8:eedc96c8 r7:11f7f2bb r6:00003850 r5:60010193
[61916.984328]  r4:eedc9640
[61916.986867] [<c01b67a0>] (hrtimer_interrupt) from [<c07ab824>] (arch_timer_handler_phys+0x38/0x40)
[61916.995817]  r10:f0895000 r9:c6e71dc8 r8:c14e0000 r7:c14e4940 r6:0000001c r5:c1005924
[61917.003634]  r4:c14dfc00
[61917.006172] [<c07ab7ec>] (arch_timer_handler_phys) from [<c0194324>] (handle_percpu_devid_irq+0x9c/0x244)
[61917.015729] [<c0194288>] (handle_percpu_devid_irq) from [<c018d930>] (__handle_domain_irq+0x8c/0xe0)
[61917.024851]  r7:00000001 r6:00000000 r5:00000000 r4:c0f9cc34
[61917.030507] [<c018d8a4>] (__handle_domain_irq) from [<c010149c>] (gic_handle_irq+0x8c/0xa0)
[61917.038849]  r9:c6e71dc8 r8:f080200c r7:c0f9cc40 r6:f0802000 r5:c10e4ae8 r4:c1005924
[61917.046584] [<c0101410>] (gic_handle_irq) from [<c0100af0>] (__irq_svc+0x70/0x98)
[61917.054056] Exception stack(0xc6e71dc8 to 0xc6e71e10)
[61917.059104] 1dc0:                   bf267054 00000000 0000da2b 0000da2a f0896578 f22095c0
[61917.067272] 1de0: f0896ab8 f0895000 f0896980 f220eeac f0895000 c6e71e2c c6e71e18 c6e71e18
[61917.075438] 1e00: c0a16d00 c0a16d2c 80010013 ffffffff
[61917.080486]  r9:c6e70000 r8:f0896980 r7:c6e71dfc r6:ffffffff r5:80010013 r4:c0a16d2c
[61917.088622] [<c0a16cdc>] (_raw_spin_lock_bh) from [<bf267054>] (rtw_free_stainfo+0x54/0x378 [8723bu])
[61917.097833]  r5:f22095c0 r4:f0896578
[61917.101725] [<bf267000>] (rtw_free_stainfo [8723bu]) from [<bf269948>] (expire_timeout_chk+0xe4/0x488 [8723bu])
[61917.111803]  r10:f0895000 r9:f0896000 r8:f0896980 r7:f0896ac8 r6:f0896ab8 r5:f22095c0
[61917.119622]  r4:f220f468
[61917.122492] [<bf269864>] (expire_timeout_chk [8723bu]) from [<bf23eddc>] (dynamic_chk_wk_hdl+0x64/0x68 [8723bu])
[61917.132657]  r10:c6e70000 r9:f0896488 r8:f0898000 r7:f0896488 r6:f08964a8 r5:f0895000
[61917.140477]  r4:f0895000
[61917.143313] [<bf23ed78>] (dynamic_chk_wk_hdl [8723bu]) from [<bf23f2b0>] (rtw_drvextra_cmd_hdl+0xb0/0x350 [8723bu])
[61917.153733]  r5:f0895000 r4:c331c200
[61917.157592] [<bf23f200>] (rtw_drvextra_cmd_hdl [8723bu]) from [<bf23ca3c>] (rtw_cmd_thread+0x18c/0x3a8 [8723bu])
[61917.167756]  r9:f0896488 r8:f0898000 r7:f0896488 r6:f08964a8 r5:f0895000 r4:c2e72100
[61917.175661] [<bf23c8b0>] (rtw_cmd_thread [8723bu]) from [<c014a710>] (kthread+0x168/0x16c)
[61917.183918]  r10:c3691814 r9:f0895000 r8:bf23c8b0 r7:c6e70000 r6:00000000 r5:c2811780
[61917.191736]  r4:c320a8c0
[61917.194273] [<c014a5a8>] (kthread) from [<c0100114>] (ret_from_fork+0x14/0x20)
[61917.201485] Exception stack(0xc6e71fb0 to 0xc6e71ff8)
[61917.206531] 1fa0:                                     00000000 00000000 00000000 00000000
[61917.214700] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[61917.222867] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[61917.229476]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014a5a8
[61917.237295]  r4:c2811780
Failed to query system properties: Transport endpoint is not connected
root@wirenboard-AWOG2OPM:~# hostnamectl
[61957.807296] systemd[1]: systemd-journald.service: State 'stop-watchdog' timed out. Killing.
[61957.816233] systemd[1]: systemd-journald.service: Killing process 29042 (systemd-journal) with signal SIGKILL.
[61962.557282] systemd[1]: systemd-logind.service: State 'stop-watchdog' timed out. Killing.
[61962.566059] systemd[1]: systemd-logind.service: Killing process 29050 (systemd-logind) with signal SIGKILL.
ifconfig
[61976.717310] systemd[1]: Stopping WB yandex Client Service...
[61979.672694] rcu: INFO: rcu_sched self-detected stall on CPU
[61979.678292] rcu:     3-...!: (20832 ticks this GP) idle=81e/1/0x40000002 softirq=2713559/2713559 fqs=0 
[61979.687415]  (t=21010 jiffies g=9748009 q=13492)
[61979.692031] rcu: rcu_sched kthread starved for 21010 jiffies! g9748009 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
[61979.702361] rcu:     Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
[61979.711304] rcu: RCU grace-period kthread stack dump:
[61979.716349] task:rcu_sched       state:R  running task     stack:    0 pid:   12 ppid:     2 flags:0x00000000
[61979.726258] Backtrace: 
[61979.728722] [<c0a10c90>] (__schedule) from [<c0a116dc>] (schedule+0x6c/0xe0)
[61979.735765]  r10:c107c2c0 r9:c156a000 r8:c115e960 r7:c1003d00 r6:c156bec4 r5:c156a000
[61979.743583]  r4:c1544fc0
[61979.746123] [<c0a11670>] (schedule) from [<c0a1588c>] (schedule_timeout+0xa8/0x1a4)
[61979.753770]  r5:c1003d00 r4:005dcb87
[61979.757350] [<c0a157e4>] (schedule_timeout) from [<c01a8ddc>] (rcu_gp_kthread+0x658/0x115c)
[61979.765692]  r7:c1003d00 r6:00000001 r5:00000001 r4:00000000
[61979.771350] [<c01a8784>] (rcu_gp_kthread) from [<c014a710>] (kthread+0x168/0x16c)
[61979.778822]  r7:c156a000
[61979.781358] [<c014a5a8>] (kthread) from [<c0100114>] (ret_from_fork+0x14/0x20)
[61979.788570] Exception stack(0xc156bfb0 to 0xc156bff8)
[61979.793617] bfa0:                                     00000000 00000000 00000000 00000000
[61979.801784] bfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[61979.809951] bfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[61979.816560]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014a5a8
[61979.824378]  r4:c14f1cc0
[61979.826913] NMI backtrace for cpu 3
[61979.830404] CPU: 3 PID: 869 Comm: RTW_CMD_THREAD Not tainted 5.10.35-wb159 #1
[61979.837526] Hardware name: Allwinner sun8i Family
[61979.842223] Backtrace: 
[61979.844679] [<c0a05218>] (dump_backtrace) from [<c0a054c0>] (show_stack+0x20/0x24)
[61979.852241]  r7:ffffffff r6:60010193 r5:00000000 r4:c10e4998
[61979.857899] [<c0a054a0>] (show_stack) from [<c0a08e30>] (dump_stack+0xb4/0xd4)
[61979.865119] [<c0a08d7c>] (dump_stack) from [<c057fbf4>] (nmi_cpu_backtrace+0xd0/0xfc)
[61979.872942]  r9:c0d44e0c r8:c0b01ff4 r7:00000000 r6:00000003 r5:00000000 r4:00000003
[61979.880679] [<c057fb24>] (nmi_cpu_backtrace) from [<c057fd14>] (nmi_trigger_cpumask_backtrace+0xf4/0x13c)
[61979.890233]  r5:c100590c r4:c010e660
[61979.893814] [<c057fc20>] (nmi_trigger_cpumask_backtrace) from [<c010f824>] (arch_trigger_cpumask_backtrace+0x20/0x24)
[61979.904409]  r9:c0d44e0c r8:c115dd15 r7:c1004f58 r6:c107c2c0 r5:c107c2c0 r4:00000003
[61979.912146] [<c010f804>] (arch_trigger_cpumask_backtrace) from [<c0a06d30>] (rcu_dump_cpu_stacks+0x104/0x13c)
[61979.922050] [<c0a06c2c>] (rcu_dump_cpu_stacks) from [<c01aa3ac>] (rcu_sched_clock_irq+0x7f8/0xa84)
[61979.930999]  r10:2de32000 r9:c1003d00 r8:c0f9e140 r7:c115e940 r6:00000000 r5:eedd0140
[61979.938818]  r4:c107c2c0
[61979.941354] [<c01a9bb4>] (rcu_sched_clock_irq) from [<c01b4a90>] (update_process_times+0x6c/0x8c)
[61979.950217]  r10:eedc9990 r9:60010193 r8:c6e70000 r7:c6e71dc8 r6:0000385e r5:c6e70000
[61979.958034]  r4:00000000
[61979.960571] [<c01b4a24>] (update_process_times) from [<c01c94c0>] (tick_sched_handle+0x64/0x68)
[61979.969257]  r5:bed96e63 r4:eedc9990
[61979.972834] [<c01c945c>] (tick_sched_handle) from [<c01c9a90>] (tick_sched_timer+0x8c/0x128)
[61979.981264] [<c01c9a04>] (tick_sched_timer) from [<c01b57d4>] (__hrtimer_run_queues+0xf8/0x3f8)
[61979.989953]  r9:60010193 r8:c6e70000 r7:00000000 r6:c01c9a04 r5:eedc9640 r4:eedc9680
[61979.997688] [<c01b56dc>] (__hrtimer_run_queues) from [<c01b68d4>] (hrtimer_interrupt+0x134/0x354)
[61980.006551]  r10:eedc9718 r9:eedc96f0 r8:eedc96c8 r7:bed96c1b r6:0000385e r5:60010193
[61980.014368]  r4:eedc9640
[61980.016905] [<c01b67a0>] (hrtimer_interrupt) from [<c07ab824>] (arch_timer_handler_phys+0x38/0x40)
[61980.025855]  r10:f0895000 r9:c6e71dc8 r8:c14e0000 r7:c14e4940 r6:0000001c r5:c1005924
[61980.033673]  r4:c14dfc00
[61980.036212] [<c07ab7ec>] (arch_timer_handler_phys) from [<c0194324>] (handle_percpu_devid_irq+0x9c/0x244)
[61980.045769] [<c0194288>] (handle_percpu_devid_irq) from [<c018d930>] (__handle_domain_irq+0x8c/0xe0)
[61980.054890]  r7:00000001 r6:00000000 r5:00000000 r4:c0f9cc34
[61980.060546] [<c018d8a4>] (__handle_domain_irq) from [<c010149c>] (gic_handle_irq+0x8c/0xa0)
[61980.068888]  r9:c6e71dc8 r8:f080200c r7:c0f9cc40 r6:f0802000 r5:c10e4ae8 r4:c1005924
[61980.076626] [<c0101410>] (gic_handle_irq) from [<c0100af0>] (__irq_svc+0x70/0x98)
[61980.084100] Exception stack(0xc6e71dc8 to 0xc6e71e10)
[61980.089148] 1dc0:                   bf267054 00000000 0000da2b 0000da2a f0896578 f22095c0
[61980.097318] 1de0: f0896ab8 f0895000 f0896980 f220eeac f0895000 c6e71e2c c6e71e18 c6e71e18
[61980.105485] 1e00: c0a16d00 c0a16d2c 80010013 ffffffff
[61980.110534]  r9:c6e70000 r8:f0896980 r7:c6e71dfc r6:ffffffff r5:80010013 r4:c0a16d2c
[61980.118662] [<c0a16cdc>] (_raw_spin_lock_bh) from [<bf267054>] (rtw_free_stainfo+0x54/0x378 [8723bu])
[61980.127874]  r5:f22095c0 r4:f0896578
[61980.131783] [<bf267000>] (rtw_free_stainfo [8723bu]) from [<bf269948>] (expire_timeout_chk+0xe4/0x488 [8723bu])
[61980.141862]  r10:f0895000 r9:f0896000 r8:f0896980 r7:f0896ac8 r6:f0896ab8 r5:f22095c0
[61980.149680]  r4:f220f468
[61980.152510] [<bf269864>] (expire_timeout_chk [8723bu]) from [<bf23eddc>] (dynamic_chk_wk_hdl+0x64/0x68 [8723bu])
[61980.162675]  r10:c6e70000 r9:f0896488 r8:f0898000 r7:f0896488 r6:f08964a8 r5:f0895000
[61980.170493]  r4:f0895000
[61980.173332] [<bf23ed78>] (dynamic_chk_wk_hdl [8723bu]) from [<bf23f2b0>] (rtw_drvextra_cmd_hdl+0xb0/0x350 [8723bu])
[61980.183756]  r5:f0895000 r4:c331c200
[61980.187656] [<bf23f200>] (rtw_drvextra_cmd_hdl [8723bu]) from [<bf23ca3c>] (rtw_cmd_thread+0x18c/0x3a8 [8723bu])
[61980.197822]  r9:f0896488 r8:f0898000 r7:f0896488 r6:f08964a8 r5:f0895000 r4:c2e72100
[61980.205717] [<bf23c8b0>] (rtw_cmd_thread [8723bu]) from [<c014a710>] (kthread+0x168/0x16c)
[61980.213975]  r10:c3691814 r9:f0895000 r8:bf23c8b0 r7:c6e70000 r6:00000000 r5:c2811780
[61980.221794]  r4:c320a8c0
[61980.224331] [<c014a5a8>] (kthread) from [<c0100114>] (ret_from_fork+0x14/0x20)
[61980.231543] Exception stack(0xc6e71fb0 to 0xc6e71ff8)
[61980.236589] 1fa0:                                     00000000 00000000 00000000 00000000
[61980.244758] 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[61980.252926] 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000
[61980.259536]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014a5a8
[61980.267354]  r4:c2811780

При этом контроллер пропадает из локальной сети и в целом перестает каким-либо образом функционировать. Помогает только сброс питания, если питание не сбрасывать, то он так и будет часами висеть в этом зависшем состоянии.
Из дополнительного ПО стоит Zabbix Agent, Home Assistant и кастомный сервис для управления Алисой. При этом стороннее ПО отключал, оставляя только Zabbix Agent, чтобы отслеживать зависании контроллера, это никак не помогло. Понижал версию прошивки (изначально была 2401 Stable), это тоже не помогло. Отключал базу данных mosquitto из Errata списка, это тоже не помогло. Есть множество других контроллеров с точно таким же ПО, там таких проблем нет.
В чем может быть проблема и как можно ее исправить?

3

Добрый день.
Рекомендую для проверки сделать factory reset на самый свежий testing релиз - ну и не устанавливая никакого ПО проверить - будет ли воспроизводиться.

4

А почему на testing релиз, а не stable?

5

Наиболее свежий, показательный.

6

Хорошо, попробую

7

Добрый день! Сделал все как Вы сказали, сделал factory reset, поставил последний testing релиз. С вайренборда все сторонее ПО убрал. Не успел от контроллера уйти, он уже завис. В debug console следующее содержимое:

0c5387d  Table: 440bc06a  DAC: 00000051
[  418.621281] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.35-wb168 #1
[  418.621283] Hardware name: Allwinner sun8i Family
[  418.621285] Backtrace: 
[  418.621295] [<c0a0e1f8>] (dump_backtrace) from [<c0a0e4a0>] (show_stack+0x20/0x24)
[  418.621300]  r7:ffffffff r6:600e0193 r5:00000000 r4:c10e4a58
[  418.621306] [<c0a0e480>] (show_stack) from [<c0a11e10>] (dump_stack+0xb4/0xd4)
[  418.621311] [<c0a11d5c>] (dump_stack) from [<c0108a88>] (show_regs+0x1c/0x20)
[  418.621316]  r9:c1001c88 r8:c14e0000 r7:00000001 r6:00000000 r5:c1001c88 r4:00000000
[  418.621319] [<c0108a6c>] (show_regs) from [<c057fbdc>] (nmi_cpu_backtrace+0xb8/0xfc)
[  418.621323] [<c057fb24>] (nmi_cpu_backtrace) from [<c010eb3c>] (do_handle_IPI+0x50/0x344)
[  418.621325]  r5:c14e4000 r4:00000007
[  418.621328] [<c010eaec>] (do_handle_IPI) from [<c010ee58>] (ipi_handler+0x28/0x30)
[  418.621331]  r9:c1001c88 r8:c14e0000 r7:00000001 r6:2ddf6000 r5:c14e4000 r4:00000017
[  418.621335] [<c010ee30>] (ipi_handler) from [<c019455c>] (handle_percpu_devid_fasteoi_ipi+0x90/0x160)
[  418.621338] [<c01944cc>] (handle_percpu_devid_fasteoi_ipi) from [<c018d930>] (__handle_domain_irq+0x8c/0xe0)
[  418.621341]  r7:00000001 r6:c1001ec8 r5:00000000 r4:c0f9cc34
[  418.621344] [<c018d8a4>] (__handle_domain_irq) from [<c010149c>] (gic_handle_irq+0x8c/0xa0)
[  418.621349]  r9:c1001c88 r8:f080200c r7:c0f9cc40 r6:f0802000 r5:c10e4ba8 r4:c1005924
[  418.621353] [<c0101410>] (gic_handle_irq) from [<c0100af0>] (__irq_svc+0x70/0x98)
[  418.621355] Exception stack(0xc1001c88 to 0xc1001cd0)
[  418.621359] 1c80:                   bf2be410 00000000 0000359a 00003598 f089e980 c4088452
[  418.621362] 1ca0: f089e980 c35f4060 f089e968 f091aa24 f089d000 c1001cec c1001cd8 c1001cd8
[  418.621366] 1cc0: c0a20040 c0a2006c 800e0113 ffffffff
[  418.621371]  r9:c1000000 r8:f089e968 r7:c1001cbc r6:ffffffff r5:800e0113 r4:c0a2006c
[  418.621374] [<c0a2001c>] (_raw_spin_lock_bh) from [<bf2be410>] (rtw_get_stainfo+0x98/0x118 [8723bu])
[  418.621376]  r5:c4088452 r4:00000002
[  418.621380] [<bf2be378>] (rtw_get_stainfo [8723bu]) from [<bf306374>] (update_recvframe_phyinfo+0xc4/0x244 [8723bu])
[  418.621383]  r8:f08a2000 r7:c35f4060 r6:f089d000 r5:c4088448 r4:f091a9c0
[  418.621390] [<bf3062b0>] (update_recvframe_phyinfo [8723bu]) from [<bf3070ec>] (rtl8723bu_recv_tasklet+0x3a0/0x474 [8723bu])
[  418.621395]  r9:00000118 r8:c35f4048 r7:f091a910 r6:00000000 r5:00000118 r4:f091a9c0
[  418.621402] [<bf306d4c>] (rtl8723bu_recv_tasklet [8723bu]) from [<c012bb18>] (tasklet_action_common.constprop.0+0x84/0x12c)
[  418.621408]  r10:00000040 r9:00000000 r8:00000006 r7:eed882dc r6:f089e8cc r5:00000000
[  418.621412]  r4:f089e8c8
[  418.621416] [<c012ba94>] (tasklet_action_common.constprop.0) from [<c012bbe8>] (tasklet_action+0x28/0x30)
[  418.621419]  r9:c1000000 r8:00000100 r7:c115e620 r6:00000006 r5:00000007 r4:c1003098
[  418.621422] [<c012bbc0>] (tasklet_action) from [<c010163c>] (__do_softirq+0x18c/0x4a8)
[  418.621425] [<c01014b0>] (__do_softirq) from [<c012b920>] (irq_exit+0xd0/0x128)
[  418.621430]  r10:c0f57f58 r9:c1001ec8 r8:c14e0000 r7:00000001 r6:00000000 r5:00000000
[  418.621433]  r4:ffffe000
[  418.621439] [<c012b850>] (irq_exit) from [<c018d934>] (__handle_domain_irq+0x90/0xe0)
[  418.621444]  r5:00000000 r4:c0f9cc34
[  418.621449] [<c018d8a4>] (__handle_domain_irq) from [<c010149c>] (gic_handle_irq+0x8c/0xa0)
[  418.621454]  r9:c1001ec8 r8:f080200c r7:c0f9cc40 r6:f0802000 r5:c10e4ba8 r4:c1005924
[  418.621459] [<c0101410>] (gic_handle_irq) from [<c0100af0>] (__irq_svc+0x70/0x98)
[  418.621462] Exception stack(0xc1001ec8 to 0xc1001f10)
[  418.621465] 1ec0:                   00000000 001d3c34 eed941c4 c011b2c0 c115f2a0 00000000
[  418.621468] 1ee0: c1004f54 c1004f9c c115dea9 c0d41e44 c0f57f58 c1001f24 c1001f28 c1001f18
[  418.621470] 1f00: c01087c4 c01087c8 600e0013 ffffffff
[  418.621475]  r9:c1000000 r8:c115dea9 r7:c1001efc r6:ffffffff r5:600e0013 r4:c01087c8
[  418.621481] [<c0108780>] (arch_cpu_idle) from [<c0a1fa80>] (default_idle_call+0x50/0x11c)
[  418.621486] [<c0a1fa30>] (default_idle_call) from [<c015f0a8>] (do_idle+0x10c/0x16c)
[  418.621491]  r5:00000000 r4:c1000000
[  418.621496] [<c015ef9c>] (do_idle) from [<c015f3e8>] (cpu_startup_entry+0x28/0x30)
[  418.621501]  r9:00000035 r8:eedda3c0 r7:c1004f00 r6:00000000 r5:c0f57f58 r4:000000d8
[  418.621504] [<c015f3c0>] (cpu_startup_entry) from [<c0a18b90>] (rest_init+0xbc/0xc4)
[  418.621507] [<c0a18ad4>] (rest_init) from [<c0f00c9c>] (arch_call_rest_init+0x18/0x1c)
[  418.621509]  r5:c0f57f58 r4:c1172078
[  418.621512] [<c0f00c84>] (arch_call_rest_init) from [<c0f01514>] (start_kernel+0x7fc/0x844)
[  418.621517] [<c0f00d18>] (start_kernel) from [<00000000>] (0x0)
[  418.621540] NMI backtrace for cpu 2
[  419.108695] CPU: 2 PID: 933 Comm: RTW_CMD_THREAD Not tainted 5.10.35-wb168 #1
[  419.115823] Hardware name: Allwinner sun8i Family
[  419.120523] Backtrace: 
[  419.122992] [<c0a0e1f8>] (dump_backtrace) from [<c0a0e4a0>] (show_stack+0x20/0x24)
[  419.130555]  r7:ffffffff r6:60000193 r5:00000000 r4:c10e4a58
[  419.136214] [<c0a0e480>] (show_stack) from [<c0a11e10>] (dump_stack+0xb4/0xd4)
[  419.143435] [<c0a11d5c>] (dump_stack) from [<c057fbf4>] (nmi_cpu_backtrace+0xd0/0xfc)
[  419.151259]  r9:c0d45dcc r8:c0b01ff0 r7:00000000 r6:00000002 r5:00000000 r4:00000002
[  419.158998] [<c057fb24>] (nmi_cpu_backtrace) from [<c057fd14>] (nmi_trigger_cpumask_backtrace+0xf4/0x13c)
[  419.168551]  r5:c100590c r4:c010e660
[  419.172130] [<c057fc20>] (nmi_trigger_cpumask_backtrace) from [<c010f824>] (arch_trigger_cpumask_backtrace+0x20/0x24)
[  419.182726]  r9:c0d45dcc r8:c115df15 r7:c1004f58 r6:c107c380 r5:c107c380 r4:00000002
[  419.190466] [<c010f804>] (arch_trigger_cpumask_backtrace) from [<c0a0fd10>] (rcu_dump_cpu_stacks+0x104/0x13c)
[  419.200374] [<c0a0fc0c>] (rcu_dump_cpu_stacks) from [<c01aa3ac>] (rcu_sched_clock_irq+0x7f8/0xa84)
[  419.209324]  r10:2de1e000 r9:c1003d00 r8:c0f9e140 r7:c115eb60 r6:00000000 r5:eedbc140
[  419.217142]  r4:c107c380
[  419.219679] [<c01a9bb4>] (rcu_sched_clock_irq) from [<c01b4a90>] (update_process_times+0x6c/0x8c)
[  419.228543]  r10:eedb5990 r9:00000061 r8:74b75680 r7:c3d0bdc8 r6:00000061 r5:c3d0a000
[  419.236360]  r4:00000000
[  419.238898] [<c01b4a24>] (update_process_times) from [<c01c94c0>] (tick_sched_handle+0x64/0x68)
[  419.247584]  r5:75500c36 r4:eedb5990
[  419.251163] [<c01c945c>] (tick_sched_handle) from [<c01c9a90>] (tick_sched_timer+0x8c/0x128)
[  419.259596] [<c01c9a04>] (tick_sched_timer) from [<c01b57d4>] (__hrtimer_run_queues+0xf8/0x3f8)
[  419.268287]  r9:60000193 r8:c3d0a000 r7:00000000 r6:c01c9a04 r5:eedb5640 r4:eedb5680
[  419.276024] [<c01b56dc>] (__hrtimer_run_queues) from [<c01b68d4>] (hrtimer_interrupt+0x134/0x354)
[  419.284888]  r10:eedb5718 r9:eedb56f0 r8:eedb56c8 r7:754fff31 r6:00000061 r5:60000193
[  419.292706]  r4:eedb5640
[  419.295247] [<c01b67a0>] (hrtimer_interrupt) from [<c07ac714>] (arch_timer_handler_phys+0x38/0x40)
[  419.304197]  r10:f089d000 r9:c3d0bdc8 r8:c14e0000 r7:c14e4940 r6:0000001c r5:c1005924
[  419.312016]  r4:c14dfc00
[  419.314555] [<c07ac6dc>] (arch_timer_handler_phys) from [<c0194324>] (handle_percpu_devid_irq+0x9c/0x244)
[  419.324118] [<c0194288>] (handle_percpu_devid_irq) from [<c018d930>] (__handle_domain_irq+0x8c/0xe0)
[  419.333240]  r7:00000001 r6:00000000 r5:00000000 r4:c0f9cc34
[  419.338900] [<c018d8a4>] (__handle_domain_irq) from [<c010149c>] (gic_handle_irq+0x8c/0xa0)
[  419.347243]  r9:c3d0bdc8 r8:f080200c r7:c0f9cc40 r6:f0802000 r5:c10e4ba8 r4:c1005924
[  419.354980] [<c0101410>] (gic_handle_irq) from [<c0100af0>] (__irq_svc+0x70/0x98)
[  419.362452] Exception stack(0xc3d0bdc8 to 0xc3d0be10)
[  419.367500] bdc0:                   bf2be054 00000000 00000868 00000867 f089e578 f2207bc8
[  419.375668] bde0: f089eab8 f089d000 f089e980 f2203484 f089d000 c3d0be2c c3d0be18 c3d0be18
[  419.383834] be00: c0a20040 c0a2006c 80000013 ffffffff
[  419.388883]  r9:c3d0a000 r8:f089e980 r7:c3d0bdfc r6:ffffffff r5:80000013 r4:c0a2006c
[  419.397010] [<c0a2001c>] (_raw_spin_lock_bh) from [<bf2be054>] (rtw_free_stainfo+0x54/0x378 [8723bu])
[  419.406222]  r5:f2207bc8 r4:f089e578
[  419.410123] [<bf2be000>] (rtw_free_stainfo [8723bu]) from [<bf2c0948>] (expire_timeout_chk+0xe4/0x488 [8723bu])
[  419.420201]  r10:f089d000 r9:f089e000 r8:f089e980 r7:f089eac8 r6:f089eab8 r5:f2207bc8
[  419.428020]  r4:f2203a40
[  419.430873] [<bf2c0864>] (expire_timeout_chk [8723bu]) from [<bf295ddc>] (dynamic_chk_wk_hdl+0x64/0x68 [8723bu])
[  419.441039]  r10:c3d0a000 r9:f089e488 r8:f08a0000 r7:f089e488 r6:f089e4a8 r5:f089d000
[  419.448856]  r4:f089d000
[  419.451692] [<bf295d78>] (dynamic_chk_wk_hdl [8723bu]) from [<bf2962b0>] (rtw_drvextra_cmd_hdl+0xb0/0x350 [8723bu])
[  419.462112]  r5:f089d000 r4:c284d200
[  419.465981] [<bf296200>] (rtw_drvextra_cmd_hdl [8723bu]) from [<bf293a3c>] (rtw_cmd_thread+0x18c/0x3a8 [8723bu])
[  419.476145]  r9:f089e488 r8:f08a0000 r7:f089e488 r6:f089e4a8 r5:f089d000 r4:c31f6f40
[  419.484037] [<bf2938b0>] (rtw_cmd_thread [8723bu]) from [<c014a710>] (kthread+0x168/0x16c)
[  419.492295]  r10:c3c4b814 r9:f089d000 r8:bf2938b0 r7:c3d0a000 r6:00000000 r5:c34e5ac0
[  419.500114]  r4:c3406380
[  419.502652] [<c014a5a8>] (kthread) from [<c0100114>] (ret_from_fork+0x14/0x20)
[  419.509865] Exception stack(0xc3d0bfb0 to 0xc3d0bff8)
[  419.514911] bfa0:                                     00000000 00000000 00000000 00000000
[  419.523079] bfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[  419.531245] bfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[  419.537855]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:c014a5a8
[  419.545673]  r4:c34e5ac0
[  419.548214] Sending NMI from CPU 2 to CPUs 3:
[  419.555451] NMI backtrace for cpu 3
[  419.555457] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 5.10.35-wb168 #1
[  419.555460] Hardware name: Allwinner sun8i Family
[  419.555462] PC is at _raw_spin_lock_bh+0x50/0x64
[  419.555464] LR is at _raw_spin_lock_bh+0x24/0x64
[  419.555467] pc : [<c0a2006c>]    lr : [<c0a20040>]    psr: 80000113
[  419.555470] sp : c1573968  ip : c1573968  fp : c157397c
[  419.555472] r10: c1573ab4  r9 : f08d4b48  r8 : f089e968
[  419.555475] r7 : f089e578  r6 : f089e980  r5 : c1573986  r4 : f089e980
[  419.555478] r3 : 00003598  r2 : 00003599  r1 : 00000000  r0 : bf2be410
[  419.555481] Flags: Nzcv  IRQs on  FIQs on  Mode SVC_32  ISA ARM  Segment none
[  419.555483] Control: 10c5387d  Table: 4423806a  DAC: 00000051
[  419.555486] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 5.10.35-wb168 #1
[  419.555488] Hardware name: Allwinner sun8i Family
[  419.555490] Backtrace: 
[  419.555498] [<c0a0e1f8>] (dump_backtrace) from [<c0a0e4a0>] (show_stack+0x20/0x24)
[  419.555501]  r7:ffffffff r6:60000193 r5:00000000 r4:c10e4a58
[  419.555504] [<c0a0e480>] (show_stack) from [<c0a11e10>] (dump_stack+0xb4/0xd4)
[  419.555506] [<c0a11d5c>] (dump_stack) from [<c0108a88>] (show_regs+0x1c/0x20)
[  419.555509]  r9:c1573918 r8:c14e0000 r7:00000001 r6:00000003 r5:c1573918 r4:00000003
[  419.555512] [<c0108a6c>] (show_regs) from [<c057fbdc>] (nmi_cpu_backtrace+0xb8/0xfc)
[  419.555516] [<c057fb24>] (nmi_cpu_backtrace) from [<c010eb3c>] (do_handle_IPI+0x50/0x344)
[  419.555518]  r5:c14e4000 r4:00000007
[  419.555521] [<c010eaec>] (do_handle_IPI) from [<c010ee58>] (ipi_handler+0x28/0x30)
[  419.555524]  r9:c1573918 r8:c14e0000 r7:00000001 r6:2de32000 r5:c14e4000 r4:00000017
[  419.555527] [<c010ee30>] (ipi_handler) from [<c019455c>] (handle_percpu_devid_fasteoi_ipi+0x90/0x160)
[  419.555531] [<c01944cc>] (handle_percpu_devid_fasteoi_ipi) from [<c018d930>] (__handle_domain_irq+0x8c/0xe0)
[  419.555533]  r7:00000001 r6:c1573f30 r5:00000000 r4:c0f9cc34
[  419.555536] [<c018d8a4>] (__handle_domain_irq) from [<c010149c>] (gic_handle_irq+0x8c/0xa0)
[  419.555540]  r9:c1573918 r8:f080200c r7:c0f9cc40 r6:f0802000 r5:c10e4ba8 r4:c1005924
[  419.555542] [<c0101410>] (gic_handle_irq) from [<c0100af0>] (__irq_svc+0x70/0x98)
[  419.555545] Exception stack(0xc1573918 to 0xc1573960)
[  419.555548] 3900:                                                       bf2be410 00000000
[  419.555551] 3920: 00003599 00003598 f089e980 c1573986 f089e980 f089e578 f089e968 f08d4b48
[  419.555554] 3940: c1573ab4 c157397c c1573968 c1573968 c0a20040 c0a2006c 80000113 ffffffff
[  419.555557]  r9:c1572000 r8:f089e968 r7:c157394c r6:ffffffff r5:80000113 r4:c0a2006c
[  419.555560] [<c0a2001c>] (_raw_spin_lock_bh) from [<bf2be410>] (rtw_get_stainfo+0x98/0x118 [8723bu])
[  419.555563]  r5:c1573986 r4:00000003
[  419.555566] [<bf2be378>] (rtw_get_stainfo [8723bu]) from [<bf2c2fd4>] (rtw_xmit_classifier+0x48/0x10c [8723bu])
[  419.555569]  r8:c43b4a80 r7:f089e578 r6:c31f0080 r5:f089d000 r4:f08d4b40
[  419.555573] [<bf2c2f8c>] (rtw_xmit_classifier [8723bu]) from [<bf2c30b0>] (rtw_xmitframe_enqueue+0x18/0x24 [8723bu])
[  419.555575]  r6:f089e578 r5:f08d4b40 r4:f089d000
[  419.555579] [<bf2c3098>] (rtw_xmitframe_enqueue [8723bu]) from [<bf305eb0>] (rtl8723bu_hal_xmit+0xe0/0x130 [8723bu])
[  419.555582] [<bf305dd0>] (rtl8723bu_hal_xmit [8723bu]) from [<bf2e6890>] (rtw_hal_xmit+0x28/0x34 [8723bu])
[  419.555585]  r9:f08d4b48 r8:c43b4a80 r7:f089e578 r6:00000000 r5:f089d000 r4:f08d4b40
[  419.555588] [<bf2e6868>] (rtw_hal_xmit [8723bu]) from [<bf2c432c>] (rtw_xmit+0xb4c/0xe88 [8723bu])
[  419.555592] [<bf2c37e0>] (rtw_xmit [8723bu]) from [<bf2dd25c>] (_rtw_xmit_entry+0xf4/0x380 [8723bu])
[  419.555595]  r10:c1573b30 r9:c1006420 r8:c0f9cc2c r7:c324ee00 r6:00000000 r5:c43b4a80
[  419.555597]  r4:f089d000
[  419.555600] [<bf2dd168>] (_rtw_xmit_entry [8723bu]) from [<bf2dd508>] (rtw_xmit_entry+0x20/0x2c [8723bu])
[  419.555603]  r10:c1573b30 r9:c1006420 r8:c0f9cc2c r7:c324ee00 r6:00000000 r5:c284c000
[  419.555605]  r4:c43b4a80
[  419.555608] [<bf2dd4e8>] (rtw_xmit_entry [8723bu]) from [<c08486c8>] (dev_hard_start_xmit+0x118/0x274)
[  419.555612] [<c08485b0>] (dev_hard_start_xmit) from [<c0890530>] (sch_direct_xmit+0x114/0x2f0)
[  419.555615]  r10:c3270c00 r9:00000003 r8:00000000 r7:c284c000 r6:c324ee00 r5:c43b4a80
[  419.555617]  r4:c3270c00
[  419.555620] [<c089041c>] (sch_direct_xmit) from [<c0890884>] (__qdisc_run+0x178/0x664)
[  419.555623]  r9:c43b4a80 r8:00000001 r7:c324ee00 r6:00000040 r5:c43b4a80 r4:00000001
[  419.555626] [<c089070c>] (__qdisc_run) from [<c0848ca0>] (__dev_queue_xmit+0x3a0/0x8dc)
[  419.555629]  r10:0000002a r9:c284c000 r8:c4497100 r7:c324ee00 r6:00000000 r5:c3270c00
[  419.555631]  r4:c43b4a80
[  419.555634] [<c0848900>] (__dev_queue_xmit) from [<c08491f8>] (dev_queue_xmit+0x1c/0x20)
[  419.555637]  r10:c31cda00 r9:c284c000 r8:01010101 r7:012aa8c0 r6:c43b4a80 r5:00000000
[  419.555639]  r4:c43b4a80
[  419.555642] [<c08491dc>] (dev_queue_xmit) from [<c0907a44>] (arp_xmit+0xb4/0xc0)
[  419.555644] [<c0907990>] (arp_xmit) from [<c0907af8>] (arp_send_dst+0xa8/0xc8)
[  419.555646]  r5:00000000 r4:00000000
[  419.555649] [<c0907a50>] (arp_send_dst) from [<c0907c14>] (arp_solicit+0xfc/0x208)                     
[  419.555652]  r6:00000001 r5:00000000 r4:c40c7c00                                                       
[  419.555655] [<c0907b18>] (arp_solicit) from [<c08533b4>] (neigh_probe+0x74/0x9c)                       
[  419.555658]  r10:eedc8540 r9:00000004 r8:c40c7c14 r7:c40c7c00 r6:00000000 r5:c43b4d80                  
[  419.555660]  r4:c40c7c00                                                                               
[  419.555663] [<c0853340>] (neigh_probe) from [<c0856128>] (neigh_timer_handler+0x264/0x358)
[  419.555665]  r5:c40c7c18 r4:c40c7c30
[  419.555668] [<c0855ec4>] (neigh_timer_handler) from [<c01b3bd4>] (call_timer_fn+0x50/0x1b4)
[  419.555671]  r9:00000000 r8:ffffdc38 r7:00000100 r6:c0855ec4 r5:c40c7c30 r4:c115ede0
[  419.555674] [<c01b3b84>] (call_timer_fn) from [<c01b3fc0>] (__run_timers.part.0+0x288/0x368)
[  419.555677]  r9:00000000 r8:ffffdc38 r7:c115ede0 r6:00000000 r5:c1573dec r4:c40c7c30
[  419.555680] [<c01b3d38>] (__run_timers.part.0) from [<c01b40e8>] (run_timer_softirq+0x48/0x78)
[  419.555683]  r10:00000282 r9:c1572000 r8:00000100 r7:c115e620 r6:00000001 r5:00000002
[  419.555685]  r4:c1003d00
[  419.555688] [<c01b40a0>] (run_timer_softirq) from [<c010163c>] (__do_softirq+0x18c/0x4a8)
[  419.555690]  r5:00000002 r4:c1003084
[  419.555693] [<c01014b0>] (__do_softirq) from [<c012b920>] (irq_exit+0xd0/0x128)
[  419.555696]  r10:00000000 r9:c1573f30 r8:c14e0000 r7:00000001 r6:00000000 r5:00000000
[  419.555698]  r4:ffffe000
[  419.555701] [<c012b850>] (irq_exit) from [<c018d934>] (__handle_domain_irq+0x90/0xe0)
[  419.555703]  r5:00000000 r4:c0f9cc34
[  419.555706] [<c018d8a4>] (__handle_domain_irq) from [<c010149c>] (gic_handle_irq+0x8c/0xa0)
[  419.555709]  r9:c1573f30 r8:f080200c r7:c0f9cc40 r6:f0802000 r5:c10e4ba8 r4:c1005924
[  419.555712] [<c0101410>] (gic_handle_irq) from [<c0100af0>] (__irq_svc+0x70/0x98)
[  419.555715] Exception stack(0xc1573f30 to 0xc1573f78)
[  419.555718] 3f20:                                     00000000 00072f00 eedd01c4 c011b2c0
[  419.555721] 3f40: c115f2a0 00000003 c1004f54 c1004f9c c115dea9 c0d41e44 00000000 c1573f8c
[  419.555724] 3f60: c1573f90 c1573f80 c01087c4 c01087c8 60000013 ffffffff
[  419.555727]  r9:c1572000 r8:c115dea9 r7:c1573f64 r6:ffffffff r5:60000013 r4:c01087c8
[  419.555730] [<c0108780>] (arch_cpu_idle) from [<c0a1fa80>] (default_idle_call+0x50/0x11c)
[  419.555733] [<c0a1fa30>] (default_idle_call) from [<c015f0a8>] (do_idle+0x10c/0x16c)
[  419.555735]  r5:00000003 r4:c1572000
[  419.555738] [<c015ef9c>] (do_idle) from [<c015f3e8>] (cpu_startup_entry+0x28/0x30)
[  419.555741]  r9:410fc075 r8:4000406a r7:c1172448 r6:10c0387d r5:00000003 r4:00000091
[  419.555744] [<c015f3c0>] (cpu_startup_entry) from [<c010f3ec>] (secondary_start_kernel+0x164/0x170)
[  419.555747] [<c010f288>] (secondary_start_kernel) from [<401019ec>] (0x401019ec)
[  419.555749]  r5:00000051 r4:4156406a
8

Информация о релизе

image
image772×574 61.5 KB

9

Информация с зависшего контроллера

root@wirenboard-AWOG2OPM:~# ifconfig
dbg0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 1a:55:89:a2:69:43  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.1.35  netmask 255.255.255.0  broadcast 192.168.1.255
        inet6 fe80::91e6:edc6:344b:9864  prefixlen 64  scopeid 0x20<link>
        inet6 fdab:3bd7:7a9a:0:5d9f:e37d:6e28:4820  prefixlen 64  scopeid 0x0<global>
        ether 00:85:01:01:02:ab  txqueuelen 1000  (Ethernet)
        RX packets 37012  bytes 3953085 (3.7 MiB)
        RX errors 0  dropped 17358  overruns 0  frame 0
        TX packets 28906  bytes 3860417 (3.6 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 65  base 0x5000  

eth1: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether 00:85:01:01:07:ad  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 64  

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 8339  bytes 498192 (486.5 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 8339  bytes 498192 (486.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

wlan0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.42.1  netmask 255.255.255.0  broadcast 192.168.42.255
        inet6 fe80::c63c:b0ff:fe5f:b4a2  prefixlen 64  scopeid 0x20<link>
        ether c4:3c:b0:5f:b4:a2  txqueuelen 1000  (Ethernet)
        RX packets 8  bytes 0 (0.0 B)
        RX errors 0  dropped 12  overruns 0  frame 0
        TX packets 14  bytes 884 (884.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

wlan1: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether c6:3c:b0:5f:b4:a2  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 19  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

root@wirenboard-AWOG2OPM:~# uptime
 08:55:59 up 46 min,  1 user,  load average: 7.23, 7.64, 7.56

root@wirenboard-AWOG2OPM:~# vmstat
procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
13  1      0 1306588  12668 258988    0    0    34    22  981 1006  5 51 12 32  0

top - 08:57:42 up 47 min,  1 user,  load average: 8.06, 7.69, 7.58
Tasks: 164 total,  15 running, 147 sleeping,   0 stopped,   2 zombie
%Cpu(s):  5.0 us, 58.0 sy,  0.0 ni,  0.0 id, 37.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :   2013.0 total,   1261.0 free,    485.1 used,    266.9 buff/cache
MiB Swap:    256.0 total,    256.0 free,      0.0 used.   1467.8 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND    
  933 root      20   0       0      0      0 R 100.0   0.0  44:20.48 RTW_CMD_T+ 
 1908 root      20   0 1085616  28152  13136 S   5.2   1.4   3:13.72 wb-rules   
 1670 root      20   0   95096  10392   6204 S   2.3   0.5   1:09.70 wb-mqtt-s+ 
  294 message+  20   0    6440   3292   2532 S   1.3   0.2   0:13.73 dbus-daem+ 
  417 root      20   0   64044  12580  10408 S   1.3   0.6   0:17.47 NetworkMa+ 
 1560 root      20   0   24880  12140   7608 S   1.3   0.6   0:15.15 python3    
26850 root      20   0    9380   2736   2200 R   1.0   0.1   0:00.36 top        
 1883 root      20   0   64876  20568  11356 S   0.7   1.0   0:05.62 python3    
 1973 root      20   0   64220   6244   5552 S   0.7   0.3   0:18.14 wb-mqtt-g+ 
 4787 root      20   0   63864   4260   3888 S   0.7   0.2   0:04.05 main       
   12 root      20   0       0      0      0 I   0.3   0.0   0:04.91 rcu_sched  
   81 root      20   0       0      0      0 I   0.3   0.0   0:09.43 kworker/u+ 
  137 root      20   0   51448  23076  22280 S   0.3   1.1   0:07.38 systemd-j+ 
 1769 mosquit+  20   0   11832   7232   4852 S   0.3   0.4   0:15.81 mosquitto  
 1817 root      20   0   29824  14524   6252 S   0.3   0.7   0:02.19 wb-device+ 
 1840 root      20   0   65212   6412   5312 S   0.3   0.3   0:20.69 main       
 1878 root      20   0   29728  13108   6892 S   0.3   0.6   0:22.93 wb-metric
10

Судя по логу из консоли и потреблению процессом - подозреваю странную работу Wi-Fi модуля.
Попробуйте, для проверки отключить wi-fi интерфейсы и выгрузить модуль

rmmod 8723bu
11

Выполнил данную команду, посмотрим поможет ли

12

Модуль точно выгрузился, его нет в выводе lsmod?

13

Выгрузился

root@wirenboard-AWOG2OPM:~# lsmod
Module                  Size  Used by
usb_f_rndis            28672  2
u_ether                24576  1 usb_f_rndis
usb_f_mass_storage     49152  2
libcomposite           57344  10 usb_f_mass_storage,usb_f_rndis
nft_reject_ipv4        16384  2
nf_reject_ipv4         16384  1 nft_reject_ipv4
nft_reject             16384  1 nft_reject_ipv4
nft_ct                 20480  1
nft_masq               16384  1
nft_chain_nat          16384  1
nf_tables             196608  29 nft_ct,nft_reject,nft_reject_ipv4,nft_chain_nat,nft_masq
nfnetlink              20480  1 nf_tables
nf_nat_h323            20480  0
nf_conntrack_h323      61440  1 nf_nat_h323
nf_nat_pptp            16384  0
nf_conntrack_pptp      16384  1 nf_nat_pptp
nf_nat_tftp            16384  0
nf_conntrack_tftp      16384  1 nf_nat_tftp
nf_nat_sip             20480  0
nf_conntrack_sip       36864  1 nf_nat_sip
nf_nat_irc             16384  0
nf_conntrack_irc       16384  1 nf_nat_irc
nf_nat_ftp             16384  0
nf_conntrack_ftp       16384  1 nf_nat_ftp
nf_nat                 45056  8 nf_nat_pptp,nf_nat_h323,nf_nat_sip,nf_nat_irc,nft_chain_nat,nft_masq,nf_nat_ftp,nf_nat_tftp
nf_conntrack          122880  15 nft_ct,nf_nat_pptp,nf_conntrack_sip,nf_conntrack_irc,nf_nat_h323,nf_conntrack_ftp,nf_nat_sip,nf_conntrack_tftp,nf_nat_irc,nf_conntrack_pptp,nft_masq,nf_nat_ftp,nf_conntrack_h323,nf_nat_tftp,nf_nat
nf_defrag_ipv6         20480  1 nf_conntrack
libcrc32c              16384  3 nf_conntrack,nf_tables,nf_nat
nf_defrag_ipv4         16384  1 nf_conntrack
pinctrl_mcp23s08_i2c    16384  88
pinctrl_mcp23s08       16384  1 pinctrl_mcp23s08_i2c
cmac                   16384  1
bnep                   20480  2
rtl8xxxu              106496  0
mac80211              909312  1 rtl8xxxu
libarc4                16384  1 mac80211
8723bu                909312  0
btusb                  49152  0
btrtl                  16384  1 btusb
btbcm                  16384  1 btusb
btintel                24576  1 btusb
bluetooth             425984  28 btrtl,btintel,bnep,btbcm,btusb
cfg80211              790528  3 8723bu,mac80211,rtl8xxxu
ecdh_generic           16384  2 bluetooth
ecc                    36864  1 ecdh_generic
rfkill                 32768  6 bluetooth,cfg80211
sunxi                  20480  0
phy_generic            16384  2 sunxi
musb_hdrc             118784  1 sunxi
udc_core               57344  5 usb_f_mass_storage,musb_hdrc,u_ether,usb_f_rndis,libcomposite
w1_gpio                16384  0
wire                   40960  1 w1_gpio
fuse                  126976  1
ip_tables              24576  0
14

Нет. Либо контроллер перезапускался после выгрузки.

15

Подскажите, пожалуйста, получилось ли отключить Wi-Fi?
Не могли бы Вы еще раз прислать логи.

16

Вроде да

root@wirenboard-AWOG2OPM:~# rmmod 8723bu
root@wirenboard-AWOG2OPM:~# lsmod
Module                  Size  Used by
usb_f_rndis            28672  2
u_ether                24576  1 usb_f_rndis
usb_f_mass_storage     49152  2
libcomposite           57344  10 usb_f_mass_storage,usb_f_rndis
nft_reject_ipv4        16384  0
nf_reject_ipv4         16384  1 nft_reject_ipv4
nft_reject             16384  1 nft_reject_ipv4
nft_ct                 20480  0
nft_masq               16384  0
nft_chain_nat          16384  0
nf_tables             196608  5 nft_ct,nft_reject,nft_reject_ipv4,nft_chain_nat,nft_masq
nfnetlink              20480  1 nf_tables
nf_nat_h323            20480  0
nf_conntrack_h323      61440  1 nf_nat_h323
nf_nat_pptp            16384  0
nf_conntrack_pptp      16384  1 nf_nat_pptp
nf_nat_tftp            16384  0
nf_conntrack_tftp      16384  1 nf_nat_tftp
nf_nat_sip             20480  0
nf_conntrack_sip       36864  1 nf_nat_sip
nf_nat_irc             16384  0
nf_conntrack_irc       16384  1 nf_nat_irc
nf_nat_ftp             16384  0
nf_conntrack_ftp       16384  1 nf_nat_ftp
nf_nat                 45056  8 nf_nat_pptp,nf_nat_h323,nf_nat_sip,nf_nat_irc,nft_chain_nat,nft_masq,nf_nat_ftp,nf_nat_tftp
nf_conntrack          122880  15 nft_ct,nf_nat_pptp,nf_conntrack_sip,nf_conntrack_irc,nf_nat_h323,nf_conntrack_ftp,nf_nat_sip,nf_conntrack_tftp,nf_nat_irc,nf_conntrack_pptp,nft_masq,nf_nat_ftp,nf_conntrack_h323,nf_nat_tftp,nf_nat
nf_defrag_ipv6         20480  1 nf_conntrack
libcrc32c              16384  3 nf_conntrack,nf_tables,nf_nat
nf_defrag_ipv4         16384  1 nf_conntrack
pinctrl_mcp23s08_i2c    16384  88
pinctrl_mcp23s08       16384  1 pinctrl_mcp23s08_i2c
cmac                   16384  1
bnep                   20480  2
rtl8xxxu              106496  0
mac80211              909312  1 rtl8xxxu
libarc4                16384  1 mac80211
btusb                  49152  0
btrtl                  16384  1 btusb
btbcm                  16384  1 btusb
btintel                24576  1 btusb
cfg80211              790528  2 mac80211,rtl8xxxu
bluetooth             425984  28 btrtl,btintel,bnep,btbcm,btusb
ecdh_generic           16384  2 bluetooth
ecc                    36864  1 ecdh_generic
rfkill                 32768  4 bluetooth,cfg80211
sunxi                  20480  0
phy_generic            16384  2 sunxi
musb_hdrc             118784  1 sunxi
udc_core               57344  5 usb_f_mass_storage,musb_hdrc,u_ether,usb_f_rndis,libcomposite
w1_gpio                16384  0
wire                   40960  1 w1_gpio
fuse                  126976  1
ip_tables              24576  0
root@wirenboard-AWOG2OPM:~# rmmod 8723bu
rmmod: ERROR: Module 8723bu is not currently loaded
17

Давайте мы бесплатно поменяем вам оборудование. Курьер привезёт новое оборудование и заберёт старое:

WB7- 1 шт.

Для возврата напишите, пожалуйста, письмо на info@wirenboard.com.
В письме укажите:

  • ссылку на эту тему,
  • серийный номер устройства, его комплектацию (установленные модули расширения),
  • (для курьера) ваш действующий телефон, адрес доставки, ФИО получателя.
18

Контроллер уже меняли, результат замены - проблема вернулась, а старый вайренборд проверили и написали это: “Исследование замененного контроллера, ABX62CH - не выявило аппаратных проблем”

19

Один и тот же контроллер, но в одном месте воспроизводится - причем часто. В другом (у нас) - нет. Давайте найдем фактор, который разнится.
Можете дать доступ к контроллеру, включив его в облако и выслав приглашение на support@wirenboard.com ?

20

Отправил приглашение на support@wirenboard.com от vadim-nik0@mail.ru

21

Подключился, смотрю.