Phones lose registration, nothing logged

We are experiencing intermittent outages on an asterisk 1.6.2.16.2 (from source) system using Grandstream GXP20xxx phones. All the phones show not registered and nothing shows up in /var/log/asterisk/full. You can connect to the system via Freepbx or CLI but everything looks normal.

Rebooting the phones does nothing. The only way to bring the system back to life is to restart/reboot it.

At other times the phones randomly lose their registration and rebooting them fixes the problem. All the phones are on the same subnet as the PBX with no firewall between them. When the phones go down the PCs and other devices on the network do NOT so I don’t think it’s a bad switch or router.

Has anyone seen these symptoms before or know of a fix?

The log excerpt below is a snapshot from a few minutes before the outage until I logged onto FreePBX from my laptop. The system/phones quit at 15:23 and I didn’t get to check in until about 16:00

[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:6] Set(“DAHDI/2-1”, “LOOPCNT=2”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:7] Set(“DAHDI/2-1”, “ITER=1”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:8] GotoIf(“DAHDI/2-1”, “1?continue”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Goto (macro-record-enable,s,13)
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:13] Set(“DAHDI/2-1”, “ITER=2”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:14] GotoIf(“DAHDI/2-1”, “1?begin”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Goto (macro-record-enable,s,8)
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:8] GotoIf(“DAHDI/2-1”, “1?continue”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Goto (macro-record-enable,s,13)
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:13] Set(“DAHDI/2-1”, “ITER=3”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:14] GotoIf(“DAHDI/2-1”, “0?begin”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:15] GotoIf(“DAHDI/2-1”, “0?IN”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-record-enable:16] ExecIf(“DAHDI/2-1”, “1?MacroExit()”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [7015@ext-group:13] Set(“DAHDI/2-1”, “RingGroupMethod=ringall”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [7015@ext-group:14] Macro(“DAHDI/2-1”, “dial,12,tTrwW,6000-6030”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-dial:1] GotoIf(“DAHDI/2-1”, “1?dial”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Goto (macro-dial,s,3)
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-dial:3] AGI(“DAHDI/2-1”, “dialparties.agi”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – Launched AGI Script /var/lib/asterisk/agi-bin/dialparties.agi
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: dialparties.agi: Starting New Dialparties.agi
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: dialparties.agi: Caller ID name is ‘CINCINNATI,OH’ number is ‘5133013347’
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: dialparties.agi: Methodology of ring is ‘ringall’
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: Added extension 6000 to extension map
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: Added extension 6030 to extension map
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: Extension 6000 cf is disabled
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: Extension 6030 cf is disabled
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: Extension 6000 do not disturb is disabled
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: Extension 6030 do not disturb is disabled
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: > dialparties.agi: extnum 6000 has: cw: 1; hascfb: 0 [] hascfu: 0 []
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: dbset CALLTRACE/6000 to 5133013347
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: > dialparties.agi: extnum 6030 has: cw: 1; hascfb: 0 [] hascfu: 0 []
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: dbset CALLTRACE/6030 to 5133013347
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – dialparties.agi: Filtered ARG3: 6000-6030
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: > dialparties.agi: NODEST: 7015 adding M(auto-blkvm) to dialopts: tTrwWM(auto-blkvm)
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: > dialparties.agi: NODEST: 7015 blkvm enabled macro already in dialopts: tTrwWM(auto-blkvm)
[Jul 19 15:22:57] VERBOSE[15592] res_agi.c: – <DAHDI/2-1>AGI Script dialparties.agi completed, returning 0
[Jul 19 15:22:57] VERBOSE[15592] pbx.c: – Executing [s@macro-dial:7] Dial(“DAHDI/2-1”, “SIP/6000&SIP/6030,12,tTrwWM(auto-blkvm)”) in new stack
[Jul 19 15:22:57] VERBOSE[15592] netsock.c: == Using SIP RTP TOS bits 184
[Jul 19 15:22:57] VERBOSE[15592] netsock.c: == Using SIP RTP CoS mark 5
[Jul 19 15:22:57] VERBOSE[15592] netsock.c: == Using SIP VRTP TOS bits 136
[Jul 19 15:22:57] VERBOSE[15592] netsock.c: == Using SIP VRTP CoS mark 6
[Jul 19 15:59:36] VERBOSE[16038] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 15:59:36] VERBOSE[16038] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 15:59:42] VERBOSE[16039] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 15:59:43] VERBOSE[16039] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 15:59:43] VERBOSE[16049] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 15:59:43] VERBOSE[16049] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 15:59:50] VERBOSE[16051] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 15:59:52] VERBOSE[16051] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 15:59:58] VERBOSE[16082] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 15:59:59] VERBOSE[16082] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 16:00:05] VERBOSE[16092] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 16:00:06] VERBOSE[16092] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 16:00:12] VERBOSE[16101] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 16:00:14] VERBOSE[16101] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 16:00:14] VERBOSE[16110] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 16:00:14] VERBOSE[16110] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 16:00:20] VERBOSE[16112] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 16:00:21] VERBOSE[16112] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 16:00:27] VERBOSE[16121] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 16:00:28] VERBOSE[16121] manager.c: == Manager ‘admin’ logged off from 127.0.0.1
[Jul 19 16:00:34] VERBOSE[16130] manager.c: == Manager ‘admin’ logged on from 127.0.0.1
[Jul 19 16:00:36] VERBOSE[16130] manager.c: == Manager ‘admin’ logged off from 127.0.0.1