All of a sudden outbound route is busy congested

All of a sudden the outbound route (PSTN) is busy congested, for no apparent reason whatsoever. I’ve checked the routes, the dahdi status etc. but I see no reason for the system to go ‘down’ all of a sudden. Any help is appreciated.

Executing [4…@from-internal:1] Macro(“SIP/3390-00000001”, “user-callerid,LIMIT,”) in new stack
– Executing [[email protected]:1] Set(“SIP/3390-00000001”, “TOUCH_MONITOR=1379598686.2”) in new stack
– Executing [[email protected]:2] Set(“SIP/3390-00000001”, “AMPUSER=3390”) in new stack
– Executing [[email protected]:3] GotoIf(“SIP/3390-00000001”, “0?report”) in new stack
– Executing [[email protected]:4] ExecIf(“SIP/3390-00000001”, “1?Set(REALCALLERIDNUM=3390)”) in new stack
– Executing [[email protected]:5] Set(“SIP/3390-00000001”, “AMPUSER=3390”) in new stack
– Executing [[email protected]:6] Set(“SIP/3390-00000001”, “AMPUSERCIDNAME=bryan”) in new stack
– Executing [[email protected]:7] GotoIf(“SIP/3390-00000001”, “0?report”) in new stack
– Executing [[email protected]:8] Set(“SIP/3390-00000001”, “AMPUSERCID=3390”) in new stack
– Executing [[email protected]:9] Set(“SIP/3390-00000001”, “__DIAL_OPTIONS=Ttr”) in new stack
– Executing [[email protected]:10] Set(“SIP/3390-00000001”, “CALLERID(all)=“bryan” <3390>”) in new stack
– Executing [[email protected]:11] GotoIf(“SIP/3390-00000001”, “0?limit”) in new stack
– Executing [[email protected]:12] ExecIf(“SIP/3390-00000001”, “1?Set(GROUP(concurrency_limit)=3390)”) in new stack
– Executing [[email protected]:13] ExecIf(“SIP/3390-00000001”, “0?Set(CHANNEL(language)=)”) in new stack
– Executing [[email protected]:14] GosubIf(“SIP/3390-00000001”, “7?sub-ccss,s,1(from-internal,4…)”) in new stack
– Executing [[email protected]:1] ExecIf(“SIP/3390-00000001”, “0?Return()”) in new stack
– Executing [[email protected]:2] Set(“SIP/3390-00000001”, “CCSS_SETUP=TRUE”) in new stack
– Executing [[email protected]:3] GosubIf(“SIP/3390-00000001”, “0?monitor_config,1(from-internal,4…):monitor_default,1(from-internal,4…)”) in new stack
– Executing [[email protected]:1] GotoIf(“SIP/3390-00000001”, “0?is_exten”) in new stack
– Executing [[email protected]:2] StackPop(“SIP/3390-00000001”, “”) in new stack
– Executing [[email protected]:3] Return(“SIP/3390-00000001”, “FALSE”) in new stack
– Executing [[email protected]:15] GotoIf(“SIP/3390-00000001”, “1?continue”) in new stack
– Goto (macro-user-callerid,s,28)
– Executing [[email protected]:28] Set(“SIP/3390-00000001”, “CALLERID(number)=3390”) in new stack
– Executing [[email protected]:29] Set(“SIP/3390-00000001”, “CALLERID(name)=bryan”) in new stack
– Executing [[email protected]:30] Set(“SIP/3390-00000001”, “CDR(cnum)=3390”) in new stack
– Executing [[email protected]:31] Set(“SIP/3390-00000001”, “CDR(cnam)=bryan”) in new stack
– Executing [[email protected]:32] Set(“SIP/3390-00000001”, “CHANNEL(language)=en”) in new stack
– Executing [4…@from-internal:2] Set(“SIP/3390-00000001”, “MOHCLASS=default”) in new stack
– Executing [4…@from-internal:3] Set(“SIP/3390-00000001”, “_NODEST=”) in new stack
– Executing [4…@from-internal:4] Gosub(“SIP/3390-00000001”, “sub-record-check,s,1(out,4…,)”) in new stack
– Executing [[email protected]:1] Set(“SIP/3390-00000001”, “REC_POLICY_MODE_SAVE=”) in new stack
– Executing [[email protected]:2] GotoIf(“SIP/3390-00000001”, “1?check”) in new stack
– Goto (sub-record-check,s,7)
– Executing [[email protected]:7] Set(“SIP/3390-00000001”, “__MON_FMT=wav”) in new stack
– Executing [[email protected]:8] GotoIf(“SIP/3390-00000001”, “1?next”) in new stack
– Goto (sub-record-check,s,11)
– Executing [[email protected]:11] ExecIf(“SIP/3390-00000001”, “0?Return()”) in new stack
– Executing [[email protected]:12] ExecIf(“SIP/3390-00000001”, “0?Set(__REC_POLICY_MODE=)”) in new stack
– Executing [[email protected]:13] GotoIf(“SIP/3390-00000001”, “0?out,1”) in new stack
– Executing [[email protected]:14] Set(“SIP/3390-00000001”, “__REC_STATUS=INITIALIZED”) in new stack
– Executing [[email protected]:15] Set(“SIP/3390-00000001”, “NOW=1379598686”) in new stack
– Executing [[email protected]:16] Set(“SIP/3390-00000001”, “__DAY=19”) in new stack
– Executing [[email protected]:17] Set(“SIP/3390-00000001”, “__MONTH=09”) in new stack
– Executing [[email protected]:18] Set(“SIP/3390-00000001”, “__YEAR=2013”) in new stack
– Executing [[email protected]:19] Set(“SIP/3390-00000001”, “__TIMESTR=20130919-105126”) in new stack
– Executing [[email protected]:20] Set(“SIP/3390-00000001”, “__FROMEXTEN=3390”) in new stack
– Executing [[email protected]:21] Set(“SIP/3390-00000001”, “__CALLFILENAME=out-4…-3390-20130919-105126-1379598686.2”) in new stack
– Executing [[email protected]:22] Goto(“SIP/3390-00000001”, “out,1”) in new stack
– Goto (sub-record-check,out,1)
– Executing [[email protected]:1] ExecIf(“SIP/3390-00000001”, “1?Set(__REC_POLICY_MODE=dontcare)”) in new stack
– Executing [[email protected]:2] GosubIf(“SIP/3390-00000001”, “0?record,1(exten,4…,3390)”) in new stack
– Executing [[email protected]:3] Return(“SIP/3390-00000001”, “”) in new stack
– Executing [4…@from-internal:5] Macro(“SIP/3390-00000001”, “dialout-trunk,1,4…,off”) in new stack
– Executing [[email protected]:1] Set(“SIP/3390-00000001”, “DIAL_TRUNK=1”) in new stack
– Executing [[email protected]:2] GosubIf(“SIP/3390-00000001”, “0?sub-pincheck,s,1()”) in new stack
– Executing [[email protected]:3] GotoIf(“SIP/3390-00000001”, “0?disabletrunk,1”) in new stack
– Executing [[email protected]:4] Set(“SIP/3390-00000001”, “DIAL_NUMBER=4…”) in new stack
– Executing [[email protected]:5] Set(“SIP/3390-00000001”, “DIAL_TRUNK_OPTIONS=Ttr”) in new stack
– Executing [[email protected]:6] Set(“SIP/3390-00000001”, “OUTBOUND_GROUP=OUT_1”) in new stack
– Executing [[email protected]:7] GotoIf(“SIP/3390-00000001”, “1?nomax”) in new stack
– Goto (macro-dialout-trunk,s,9)
– Executing [[email protected]:9] GotoIf(“SIP/3390-00000001”, “0?skipoutcid”) in new stack
– Executing [[email protected]:10] Set(“SIP/3390-00000001”, “DIAL_TRUNK_OPTIONS=Tt”) in new stack
– Executing [[email protected]:11] Macro(“SIP/3390-00000001”, “outbound-callerid,1”) in new stack
– Executing [[email protected]:1] ExecIf(“SIP/3390-00000001”, “0?Set(CALLERPRES()=)”) in new stack
– Executing [[email protected]:2] ExecIf(“SIP/3390-00000001”, “0?Set(REALCALLERIDNUM=3390)”) in new stack
– Executing [[email protected]:3] GotoIf(“SIP/3390-00000001”, “1?normcid”) in new stack
– Goto (macro-outbound-callerid,s,6)
– Executing [[email protected]:6] Set(“SIP/3390-00000001”, “USEROUTCID=”) in new stack
– Executing [[email protected]:7] Set(“SIP/3390-00000001”, “EMERGENCYCID=”) in new stack
– Executing [[email protected]:8] Set(“SIP/3390-00000001”, “TRUNKOUTCID=”) in new stack
– Executing [[email protected]:9] GotoIf(“SIP/3390-00000001”, “1?trunkcid”) in new stack
– Goto (macro-outbound-callerid,s,14)
– Executing [[email protected]:14] ExecIf(“SIP/3390-00000001”, “0?Set(CALLERID(all)=)”) in new stack
– Executing [[email protected]:15] ExecIf(“SIP/3390-00000001”, “0?Set(CALLERID(all)=)”) in new stack
– Executing [[email protected]:16] ExecIf(“SIP/3390-00000001”, “0?Set(CALLERID(all)=)”) in new stack
– Executing [[email protected]:17] ExecIf(“SIP/3390-00000001”, “0?Set(CALLERPRES()=prohib_passed_screen)”) in new stack
– Executing [[email protected]:18] Set(“SIP/3390-00000001”, “CDR(outbound_cnum)=3390”) in new stack
– Executing [[email protected]:19] Set(“SIP/3390-00000001”, “CDR(outbound_cnam)=bryan”) in new stack
– Executing [[email protected]:12] GosubIf(“SIP/3390-00000001”, “0?sub-flp-1,s,1()”) in new stack
– Executing [[email protected]:13] Set(“SIP/3390-00000001”, “OUTNUM=4…”) in new stack
– Executing [[email protected]:14] Set(“SIP/3390-00000001”, “custom=DAHDI/g0”) in new stack
– Executing [[email protected]:15] ExecIf(“SIP/3390-00000001”, “0?Set(DIAL_TRUNK_OPTIONS=M(setmusic^default)Tt)”) in new stack
– Executing [[email protected]:16] ExecIf(“SIP/3390-00000001”, “0?Set(DIAL_TRUNK_OPTIONS=TtM(confirm))”) in new stack
– Executing [[email protected]:17] Macro(“SIP/3390-00000001”, “dialout-trunk-predial-hook,”) in new stack
– Executing [[email protected]:1] MacroExit(“SIP/3390-00000001”, “”) in new stack
– Executing [[email protected]:18] GotoIf(“SIP/3390-00000001”, “0?bypass,1”) in new stack
– Executing [[email protected]:19] ExecIf(“SIP/3390-00000001”, “1?Set(CONNECTEDLINE(num,i)=4…)”) in new stack
– Executing [[email protected]:20] ExecIf(“SIP/3390-00000001”, “1?Set(CONNECTEDLINE(name,i)=CID:3390)”) in new stack
– Executing [[email protected]:21] GotoIf(“SIP/3390-00000001”, “0?customtrunk”) in new stack
– Executing [[email protected]:22] Dial(“SIP/3390-00000001”, “DAHDI/g0/4…,300,Tt”) in new stack
– Called DAHDI/g0/4…
– Hanging up on ‘DAHDI/5-1’
– Hungup ‘DAHDI/5-1’
== Everyone is busy/congested at this time (1:0/0/1)
– Executing [[email protected]:23] NoOp(“SIP/3390-00000001”, “Dial failed for some reason with DIALSTATUS = CHANUNAVAIL and HANGUPCAUSE = 0”) in new stack
– Executing [[email protected]:24] GotoIf(“SIP/3390-00000001”, “0?continue,1:s-CHANUNAVAIL,1”) in new stack
– Goto (macro-dialout-trunk,s-CHANUNAVAIL,1)
– Executing [[email protected]:1] Set(“SIP/3390-00000001”, “RC=0”) in new stack
– Executing [[email protected]:2] Goto(“SIP/3390-00000001”, “0,1”) in new stack
– Goto (macro-dialout-trunk,0,1)
– Executing [[email protected]:1] Goto(“SIP/3390-00000001”, “continue,1”) in new stack
– Goto (macro-dialout-trunk,continue,1)
– Executing [[email protected]:1] NoOp(“SIP/3390-00000001”, “TRUNK Dial failed due to CHANUNAVAIL HANGUPCAUSE: 0 - failing through to other trunks”) in new stack
– Executing [[email protected]:2] Set(“SIP/3390-00000001”, “CALLERID(number)=3390”) in new stack
– Executing [4…@from-internal:6] Macro(“SIP/3390-00000001”, “outisbusy,”) in new stack
– Executing [[email protected]:1] Progress(“SIP/3390-00000001”, “”) in new stack
– Executing [[email protected]:2] GotoIf(“SIP/3390-00000001”, “0?emergency,1”) in new stack
– Executing [[email protected]:3] GotoIf(“SIP/3390-00000001”, “0?intracompany,1”) in new stack
– Executing [[email protected]:4] Playback(“SIP/3390-00000001”, “all-circuits-busy-now&pls-try-call-later, noanswer”) in new stack
– <SIP/3390-00000001> Playing ‘all-circuits-busy-now.ulaw’ (language ‘en’)
– <SIP/3390-00000001> Playing ‘pls-try-call-later.ulaw’ (language ‘en’)
– Executing [[email protected]:5] Congestion(“SIP/3390-00000001”, “20”) in new stack
[2013-09-19 10:51:33] WARNING[2562][C-00000001]: channel.c:4816 ast_prod: Prodding channel ‘SIP/3390-00000001’ failed
== Spawn extension (macro-outisbusy, s, 5) exited non-zero on ‘SIP/3390-00000001’ in macro ‘outisbusy’
== Spawn extension (from-internal, 4…, 6) exited non-zero on ‘SIP/3390-00000001’
– Executing [[email protected]:1] Hangup(“SIP/3390-00000001”, “”) in new stack
== Spawn extension (from-internal, h, 1) exited non-zero on ‘SIP/3390-00000001’

I have no idea what might have happened.

Sorry for posting the whole log probably the things with most relevance are:

– Executing [[email protected]:23] NoOp(“SIP/3390-00000001”, “Dial failed for some reason with DIALSTATUS = CHANUNAVAIL and HANGUPCAUSE = 0”) in new stack

Executing [[email protected]:1] NoOp(“SIP/3390-00000001”, “TRUNK Dial failed due to CHANUNAVAIL HANGUPCAUSE: 0 - failing through to other trunks”) in new stack