diag_output_ADBQW3WQ_2025-10-09-03.12.24.zip (507,6 КБ)
Приветствую всех! Помогите разобраться новичку с отваливанием MQTT
diag_output_ADBQW3WQ_2025-10-09-03.12.24.zip (507,6 КБ)
Приветствую всех! Помогите разобраться новичку с отваливанием MQTT
Добрый день.
Обратите внимание на лог:
Oct 08 11:10:01 wirenboard-ADBQW3WQ mosquitto[1734]: 1759921801: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 08 11:10:01 wirenboard-ADBQW3WQ mosquitto[1734]: 1759921801: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-adc (p2, c0, k60).
Oct 08 11:10:01 wirenboard-ADBQW3WQ mosquitto[1734]: 1759921801: Client wb-adc disconnected due to out of memory.
Ну и за пару минут
|$SYS/broker/messages/received|11508|
|$SYS/broker/messages/sent|41039|
При этом (зачем?) в настройках mosquitto включен persistence.
В общем советую подписаться на весь брокер и посмотреть - что туда так активно публикует. Ну и выключить persistence.
Persistence включен, т.к. без него после перезагрузки контролера терялись устройства в HA, добавленные через WB Engine. Подскажите, как подписаться на весь брокер. Может wb-map3e столько сообщений слать?
Заранее благодарю.
Рекомендую выключить. Как минимум для проверки.
mosquitto_sub -v -t "#" например
Не думаю. Точнее - как раз подписка и покажет.
Запустил mosquitto_sub -v -t “#”, бесконечно мелькают сообщения с map3e
Насколько я вижу начинается с
Oct 10 02:49:24 wirenboard-ADBQW3WQ NetworkManager[474]: <info> [1760064564.9733] manager: (veth4a22346): new Veth device (/org/freedesktop/NetworkManager/Devices/15)
Oct 10 02:49:24 wirenboard-ADBQW3WQ wb-mqtt-serial[439124]: INFO: [modbus] Continuous read enabled [slave_id is 83]
Oct 10 02:49:24 wirenboard-ADBQW3WQ wb-mqtt-serial[439124]: INFO: [modbus] Init setup register "disable legacy input mode control": <modbus:83:holding: 5><-- 0 (0x0)
Oct 10 02:49:24 wirenboard-ADBQW3WQ kernel: br-b3cba76b30e2: port 3(vethda1ea82) entered disabled state
Oct 10 02:49:25 wirenboard-ADBQW3WQ wb-mqtt-serial[439124]: INFO: [modbus] Init setup register "Mode": <modbus:83:holding: 9><-- 0 (0x0)
Oct 10 02:49:25 wirenboard-ADBQW3WQ kernel: vethda1ea82 (unregistering): left allmulticast mode
Oct 10 02:49:25 wirenboard-ADBQW3WQ kernel: vethda1ea82 (unregistering): left promiscuous mode
И затем
Oct 10 02:49:26 wirenboard-ADBQW3WQ kernel: br-b3cba76b30e2: port 4(veth39a3f26) entered disabled state
Oct 10 02:49:26 wirenboard-ADBQW3WQ kernel: vethd075d01: renamed from eth0
Oct 10 02:49:26 wirenboard-ADBQW3WQ NetworkManager[474]: <info> [1760064566.0690] manager: (vethd075d01): new Veth device (/org/freedesktop/NetworkManager/Devices/16)
Oct 10 02:49:26 wirenboard-ADBQW3WQ kernel: br-b3cba76b30e2: port 4(veth39a3f26) entered disabled state
Oct 10 02:49:26 wirenboard-ADBQW3WQ kernel: veth39a3f26 (unregistering): left allmulticast mode
Oct 10 02:49:26 wirenboard-ADBQW3WQ kernel: veth39a3f26 (unregistering): left promiscuous mode
Oct 10 02:49:26 wirenboard-ADBQW3WQ kernel: br-b3cba76b30e2: port 4(veth39a3f26) entered disabled state
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: run-docker-netns-39f98551a0f8.mount: Succeeded.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: Unmounted /run/docker/netns/39f98551a0f8.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: mnt-data-.docker-overlay2-08d369a702b6447205f5bfa9619caf9a40e138491345b6eec9b9bf45a4bbc9cb-merged.mount: Succeeded.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: Unmounted /mnt/data/.docker/overlay2/08d369a702b6447205f5bfa9619caf9a40e138491345b6eec9b9bf45a4bbc9cb/merged.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: wb-mqtt-metrics.service: Succeeded.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: Stopped metrics sender.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: wb-mqtt-metrics.service: Consumed 9min 41.274s CPU time.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: Stopping Mosquitto MQTT Broker...
Oct 10 02:49:26 wirenboard-ADBQW3WQ mosquitto[283862]: 1760064566: mosquitto version 2.0.20 terminating
Oct 10 02:49:26 wirenboard-ADBQW3WQ wb-mqtt-serial[439124]: WARNING: [mqtt] connection lost
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: mosquitto.service: Succeeded.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: Stopped Mosquitto MQTT Broker.
Oct 10 02:49:26 wirenboard-ADBQW3WQ systemd[1]: mosquitto.service: Consumed 11min 42.337s CPU time.
Oct 10 02:49:27 wirenboard-ADBQW3WQ wb-mqtt-serial[439124]: WARNING: [backend] Unable to cleanup topic '/devices/wb-mr6c_83/controls/K4/meta/order': timed out
Oct 10 02:49:27 wirenboard-ADBQW3WQ wb-mqtt-serial[439124]: WARNING: [backend] Unable to publish, no connection to broker
То есть, интерфейсы docker меняясь рушат сеть.
Для проверки - отключите запуск контейнеров docker.
С моей точки зрения просто “перезапускать” без анализа логов совершенно бессмыссленно.
Для примера, поведение после перезапуска:
Oct 09 18:34:04 wirenboard-ADBQW3WQ systemd[1]: Started Mosquitto MQTT Broker.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-mqtt-knx (p2, c0, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-mqtt-db (p2, c0, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from 127.0.0.1:56312 on port 1883.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-mqtt-metrics-7H3OrUvk (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from 127.0.0.1:56312 as wb-gpio (p2, c0, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-adc (p2, c0, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-modbus (p2, c0, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-diag-collect-MolEy1kc (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as confed-wirenboard-ADBQW3WQ-1908 (p2, c1, k30).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-w1 (p2, c0, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-mqtt-logs (p2, c0, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as auto-770A2144-DBF2-6E04-8F70-C92D81451E9F (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-rules-engine-wirenboard-ADBQW3WQ-9847 (p2, c1, k30).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as connections-virtual-devices-3L95Sq0a (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as wb-device-manager-wC5GtgNe (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from 127.0.0.1:56324 on port 1883.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from 127.0.0.1:56324 as mqttjs_c020388f (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as auto-9B10DDA0-F5B5-FBEC-85E9-E2EBB37619B5 (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: Client auto-9B10DDA0-F5B5-FBEC-85E9-E2EBB37619B5 disconnected.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as auto-F63D0986-D214-15B4-5D8E-2ABA8C2810C3 (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: Client auto-F63D0986-D214-15B4-5D8E-2ABA8C2810C3 disconnected.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as auto-D5B8E2DD-50ED-BEE2-94D3-BE50A05B2A17 (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: Client auto-D5B8E2DD-50ED-BEE2-94D3-BE50A05B2A17 disconnected.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: New client connected from /var/run/mosquitto/mosquitto.sock:0 as auto-AA4D1727-D84C-07F0-F37D-31248B7C518F (p2, c1, k60).
Oct 09 18:34:05 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034845: Client auto-AA4D1727-D84C-07F0-F37D-31248B7C518F disconnected.
Oct 09 18:34:14 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034854: New connection from 172.18.0.2:34071 on port 1883.
Oct 09 18:34:14 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034854: New client connected from 172.18.0.2:34071 as 7q5p9k86XIfuTDrHr3cJHw (p2, c1, k60).
Oct 09 18:34:17 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034857: New connection from 172.18.0.5:49844 on port 1883.
Oct 09 18:34:17 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034857: New client connected from 172.18.0.5:49844 as nodered83a86448afdc8ffc (p5, c1, k60).
Oct 09 18:35:08 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034908: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 18:35:08 wirenboard-ADBQW3WQ mosquitto[144565]: 1760034908: New client connected from /var/run/mosquitto/mosquitto.sock:0 as rules-wirenboard-ADBQW3WQ-9847 (p2, c1, k30).
Oct 09 22:28:07 wirenboard-ADBQW3WQ mosquitto[144565]: 1760048887: Client wb-modbus disconnected due to out of memory.
Oct 09 22:28:08 wirenboard-ADBQW3WQ mosquitto[144565]: 1760048888: Client rules-wirenboard-ADBQW3WQ-9847 disconnected due to out of memory.
Oct 09 22:28:08 wirenboard-ADBQW3WQ mosquitto[144565]: 1760048888: New connection from /var/run/mosquitto/mosquitto.sock:0 on port 0.
Oct 09 22:28:08 wirenboard-ADBQW3WQ mosquitto[144565]: 1760048888: New client connected from /var/run/mosquitto/mosquitto.sock:0 as rules-wirenboard-ADBQW3WQ-9847 (p2, c1, k30).
Oct 09 22:28:08 wirenboard-ADBQW3WQ systemd[1]: mosquitto.service: Main process exited, code=exited, status=255/EXCEPTION
Сервис перезапустился - тут же кто-то из вновь подключенных напубликовал в него до “out of memory”.
Как уже писал - просто перезапускать не имеет смысла. Можно по одному останавливать источники публикаций, да и пробовать перезапускать. Тогда будет понятно, после остановки чего запустился - тот и (высоковероятно) виновник.
Если в текущей конфигурации брокеру не достаточно настроенной памяти (тоже может быть, но редко встречался) - имеет смысл поднять лимиты.
Добрый день.
Получилось найти источник публикаций?
Приветствую! Отказался от Portainer, сейчас все хорошо
Ну отлично, рад.