lora-network-services endless restart loop

[changamire@gmail.com]

Hi,

We have a Conduit gateway on the AU915 frequency, running firmware version 1.7.2 and with an LTE SIM providing WAN connectivity.
The WAN connection is strictly firewalled, with connectivity only open to an HTTPS endpoint to which a NodeRED application on the gateway connects to. Interestingly, on a completely open network connection, we do not see the behavior described below – it is only when operating with the firewalled WAN connection.
The issue we see is that after being powered on, devices can successfully connect to the gateway, and traffic flows from the NodeRED application to the backend. After some time (1 or 2 hours), the lora-network-server appears to go into an endless loop of trying to restart. This renders the gateway unusable.

Just prior to entering this loop, the following log output is observed

Anyone have any ideas what may be the issue here – is the ‘Failed to unlock mutex’ significant here?

2019-06-21T16:22:20.488771+08:00 localhost lora-network-server: Upstream UDP backup this: 160384 last: 152832
2019-06-21T16:22:54.643251+08:00 localhost lora-network-server: DB backup 50 / 58 complete
2019-06-21T16:22:54.710943+08:00 localhost lora-network-server: DB backup 58 / 58 complete
2019-06-21T16:22:54.712200+08:00 localhost lora-network-server: Database backup ok.
2019-06-21T16:22:57.262105+08:00 localhost gpsd[597]: gpsd:WARN: PPS:/dev/pps0 unchanged state, ppsmonitor sleeps 10
2019-06-21T16:23:20.878877+08:00 localhost lora-network-server: Upstream UDP backup this: 163904 last: 160384
2019-06-21T16:23:20.879232+08:00 localhost lora-network-server: Upstream UDP backup this: 163904 last: 160384
2019-06-21T16:23:20.879494+08:00 localhost lora-network-server: Upstream UDP backup detected, restarting network server… (163904 0.0.0.0:1780#012)
2019-06-21T16:23:21.117188+08:00 localhost lora-network-server: Shutdown signal received 15
2019-06-21T16:23:21.118093+08:00 localhost lora-network-server: Lock| Failed to unlock mutex
2019-06-21T16:23:29.894173+08:00 localhost Successfully wrote Lora Network Server configuration file: /var/config/lora/lora-network-server.conf
2019-06-21T16:23:32.723466+08:00 localhost lora-network-server: Lora Network Server started, Version: 2.2.18 GwSerial: 20199727
2019-06-21T16:23:32.724390+08:00 localhost lora-network-server: Configured network-lead-time is below the minimum, setting to 500 ms.
2019-06-21T16:23:32.861148+08:00 localhost lora-network-server: Lora Card AP 1: MTAC-LORA-H-915 MTAC-LORA-1.5

[Author]

Posts