Hi there;
We suddenly have no inbound or outbound calling. Last night, some module updates were performed, but we’ve rolled back to backups from the previous day, as well as the beginning of the month and the problems persist.
Calls do appear to be coming through here is a sample of the logs (I have redacted the phone numbers with xxCALLERxx and xxxDESTxxx:
[2017-06-01 19:27:14] VERBOSE[2707][C-0000002a] sig_pri.c: Accepting call from 'xxCALLERxx' to 'xxxDESTxxx' on channel 0/1, span 1
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:1] Set("DAHDI/i1/xxCALLERxx-16", "__DIRECTION=INBOUND") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:2] Gosub("DAHDI/i1/xxCALLERxx-16", "sub-record-check,s,1(in,xxxDESTxxx,never)") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:1] GotoIf("DAHDI/i1/xxCALLERxx-16", "0?initialized") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:2] Set("DAHDI/i1/xxCALLERxx-16", "__REC_STATUS=INITIALIZED") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:3] Set("DAHDI/i1/xxCALLERxx-16", "NOW=1496345234") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:4] Set("DAHDI/i1/xxCALLERxx-16", "__DAY=01") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:5] Set("DAHDI/i1/xxCALLERxx-16", "__MONTH=06") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:6] Set("DAHDI/i1/xxCALLERxx-16", "__YEAR=2017") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:7] Set("DAHDI/i1/xxCALLERxx-16", "__TIMESTR=20170601-192714") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:8] Set("DAHDI/i1/xxCALLERxx-16", "__FROMEXTEN=unknown") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:9] Set("DAHDI/i1/xxCALLERxx-16", "__MON_FMT=wav") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:10] NoOp("DAHDI/i1/xxCALLERxx-16", "Recordings initialized") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:11] ExecIf("DAHDI/i1/xxCALLERxx-16", "0?Set(ARG3=dontcare)") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:12] Set("DAHDI/i1/xxCALLERxx-16", "REC_POLICY_MODE_SAVE=") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:13] ExecIf("DAHDI/i1/xxCALLERxx-16", "0?Set(REC_STATUS=NO)") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:14] GotoIf("DAHDI/i1/xxCALLERxx-16", "2?checkaction") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx_builtins.c: Goto (sub-record-check,s,17)
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:17] GotoIf("DAHDI/i1/xxCALLERxx-16", "1?sub-record-check,in,1") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx_builtins.c: Goto (sub-record-check,in,1)
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:1] NoOp("DAHDI/i1/xxCALLERxx-16", "Inbound Recording Check to xxxDESTxxx") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:2] Set("DAHDI/i1/xxCALLERxx-16", "FROMEXTEN=unknown") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:3] ExecIf("DAHDI/i1/xxCALLERxx-16", "10?Set(FROMEXTEN=xxCALLERxx)") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:4] Gosub("DAHDI/i1/xxCALLERxx-16", "recordcheck,1(never,in,xxxDESTxxx)") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:1] NoOp("DAHDI/i1/xxCALLERxx-16", "Starting recording check against never") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:2] Goto("DAHDI/i1/xxCALLERxx-16", "never") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx_builtins.c: Goto (sub-record-check,recordcheck,14)
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:14] Set("DAHDI/i1/xxCALLERxx-16", "__REC_POLICY_MODE=NEVER") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:15] Goto("DAHDI/i1/xxCALLERxx-16", "stoprec") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx_builtins.c: Goto (sub-record-check,recordcheck,25)
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:25] NoOp("DAHDI/i1/xxCALLERxx-16", "Stopping recording: in, xxxDESTxxx") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:26] Set("DAHDI/i1/xxCALLERxx-16", "__REC_STATUS=STOPPED") in new stack
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Executing [[email protected]:27] System("DAHDI/i1/xxCALLERxx-16", "/stoprecording.php "DAHDI/i1/xxCALLERxx-16"") in new stack
[2017-06-01 19:27:14] WARNING[4354][C-0000002a] app_system.c: Unable to execute '/stoprecording.php "DAHDI/i1/xxCALLERxx-16"'
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] pbx.c: Spawn extension (sub-record-check, recordcheck, 27) exited non-zero on 'DAHDI/i1/xxCALLERxx-16'
[2017-06-01 19:27:14] VERBOSE[4354][C-0000002a] chan_dahdi.c: Hungup 'DAHDI/i1/xxCALLERxx-16'
This log repeats 4 times per call.
The caller hears a long pause, and then a busy tone.
We are at a loss as to how to get more information to even start troubleshooting this. Any ideas?