Busy, Disconnected or No Longer In Service

JMart · April 7, 2017, 2:06pm

Hi All,
I’m running 13.0.190.7. For maybe 6 months or so I’ve not had any issues. Now every day when I get to work and make my test call into the server it does one of three things. It mostly gives one of the number you’re calling is not in service messages or it will ring a few times then go to a busy signal. Rebooting the server so far has always straightened this out.

How can I figure out what’s causing the problem. I hate the idea that folks may call after hours and get the impression that we’re out of business.

Thank You,
John

cynjut · April 7, 2017, 2:52pm

Time to start parsing through the /var/log/asterisk/full logs.

Something is causing your system to go away in one form or another.

If I was a betting man, I’d start with either your Internet router/switch/firewall or your network switch where your phones are connected.

You should be able to see stuff crashing at some point during the night. From there, the analysis can begin. Until you know what’s dying, though, there’s no point in conjecture.

JMart · April 7, 2017, 3:42pm

Hey Dave,
I’m looking at these log files, but as you may have guessed - I don’t know what I’m seeing. Would you mind having a look? I can’t find any sensitive information in the log files, so I guess it’s okay to post one or two of them here. I also can’t figure out how I would attach a log file to this post.

Thank You,
John

cynjut · April 7, 2017, 5:31pm

Before you post a ton of log listings to the forum, might I suggest that you comb through them looking for “WARNING” and “ERROR” on some of the lines. Also, look around for things that say “UNREACHABLE”. Those are going to give you some indication of a problem.

If you can’t find a lot of that kind of stuff, look for indications that the system has restarted. If you can find some of that, you should find a cause close by. If you don’t, note the time and look in the file “/var/log/messages” at the same time and see if your machine had some other catastrophic failure at about the same time.

Also, a lot of the lines are going to be repeated over and over again (“admin” login and logout, for example) - and we don’t probably need to see those.

In general, and I know you don’t know what “in general” looks like yet, you are looking for stuff that doesn’t look like the stuff around it. Look at the logs for things that don’t look “the same” as the rest of the stuff around it and then read what it says. You should look for things that say stuff like “Oh my gawd - we’re all going to die!” Focus on that kind of stuff.

JMart · April 7, 2017, 6:31pm

Dave. Thank you.

I have gathered up all the warning and error messages. I see at times that certain cofig files are no available or not found. But stuff like this festival.conf? I really don’t know…

[2017-04-06 14:45:06] ERROR[1717] config_options.c:Unabletoloadconfigfileacl.conf'
[2017-04-06 14:45:10] ERROR[1717] config_options.c:Unabletoloadconfigfilestatsd.conf'
[2017-04-06 14:45:10] ERROR[1717] res_sorcery_config.c:Unabletoloadconfigfilepjproject.conf'
[2017-04-06 14:45:12] ERROR[1717] res_pjsip_config_wizard.c:Unabletoloadconfigfilepjsip_wizard.conf'
[2017-04-06 14:45:12] ERROR[1717] res_pjsip_config_wizard.c:Unabletoloadconfigfilepjsip_wizard.conf'
[2017-04-06 14:45:12] ERROR[1717] res_pjsip_config_wizard.c:Unabletoloadconfigfilepjsip_wizard.conf'
[2017-04-06 14:45:12] ERROR[1717] config_options.c:Unabletoloadconfigfilexmpp.conf'
[2017-04-06 14:45:13] ERROR[1717] config_options.c:Unabletoloadconfigfilehep.conf'
[2017-04-06 14:45:13] ERROR[1717] res_calendar.c:Unabletoloadconfigcalendar.conf
[2017-04-06 14:45:13] ERROR[1717] pbx_lua.c:Errorloadingextensions.lua:cannotopen/etc/asterisk/extensions.lua'forreading:Nosuchfileordirectory
[2017-04-06 14:45:14] ERROR[1717] res_config_sqlite.c:Unabletoloadres_config_sqlite.conf
[2017-04-06 14:45:14] ERROR[1717] res_pjsip_config_wizard.c:Unabletoloadconfigfilepjsip_wizard.conf'
[2017-04-06 14:45:14] ERROR[1717] chan_ooh323.c:Can'tloadooh323configfile,OOH323Disabled
[2017-04-06 14:45:15] ERROR[1717] chan_mobile.c:NoBluetoothdevicesfound.Notloadingmodule.
[2017-04-06 14:45:15] ERROR[1717] config_options.c:Unabletoloadconfigfilemotif.conf'
[2017-04-06 14:45:15] ERROR[1717] chan_motif.c:Unabletoreadconfigfilemotif.conf.Moduleloadedbutnotrunning.
[2017-04-06 14:45:15] ERROR[1717] res_pjsip_config_wizard.c:Unabletoloadconfigfilepjsip_wizard.conf'
[2017-04-06 14:45:16] ERROR[1717] config_options.c:Unabletoloadconfigfileagents.conf'
[2017-04-06 14:45:16] ERROR[1717] app_agent_pool.c:Unabletoloadconfig.Notloadingmodule.
[2017-04-06 14:45:17] ERROR[1717] cdr_syslog.c:Unabletoloadcdr_syslog.conf.NotloggingcustomCSVCDRstosyslog.
[2017-04-06 14:45:17] ERROR[1717] chan_unistim.c:Unabletoloadconfigunistim.conf
[2017-04-06 14:45:17] ERROR[1717] chan_phone.c:Unabletoloadconfigphone.conf
[2017-04-06 14:45:17] ERROR[1717] app_amd.c:Configurationfileamd.confmissing.
[2017-04-06 14:45:17] ERROR[1717] pbx_dundi.c:Unabletoloadconfigdundi.conf
[2017-04-06 14:45:04] WARNING[1717] loader.c:Errorloadingmodulechan_local.so':/usr/lib/asterisk/modules/chan_local.so:cannotopensharedobjectfile:Nosuchfileordirectory
[2017-04-06 14:45:04] WARNING[1717] res_odbc.c:Thepooling',shared_connections',limit',andidlecheck'optionswerereplacedbymax_connections'.Seeres_odbc.conf.sample.
[2017-04-06 14:45:04] WARNING[1717] res_odbc.c:Thepooling',shared_connections',limit',andidlecheck'optionswerereplacedbymax_connections'.Seeres_odbc.conf.sample.
[2017-04-06 14:45:05] WARNING[1717] presencestate.c:NoproviderfoundforlabelCustomPresence
[2017-04-06 14:45:05] WARNING[1717] presencestate.c:NoproviderfoundforlabelCustomPresence
[2017-04-06 14:45:05] WARNING[1717] presencestate.c:NoproviderfoundforlabelCustomPresence
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline3099of/etc/asterisk/extensions_additional.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline3100of/etc/asterisk/extensions_additional.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline3101of/etc/asterisk/extensions_additional.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline3137of/etc/asterisk/extensions_additional.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline3138of/etc/asterisk/extensions_additional.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline127ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline128ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline129ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline130ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline131ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline132ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline133ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline146ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline147ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx_config.c:Theuseof_.'foranextensionisstronglydiscouragedandcanhaveunexpectedbehavior.Pleaseuse_X.'insteadatline148ofextensions.conf
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-internal-xfer'triestoincludenonexistentcontextfrom-internal-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-internal-noxfer'triestoincludenonexistentcontextfrom-internal-noxfer-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-pstn'triestoincludenonexistentcontextfrom-pstn-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-internal-noxfer-additional'triestoincludenonexistentcontextfrom-internal-noxfer-additional-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-internal-additional'triestoincludenonexistentcontextfrom-internal-additional-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsipstation-welcome'triestoincludenonexistentcontextsipstation-welcome-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-pinsets'triestoincludenonexistentcontextmacro-pinsets-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfunc-apply-sipheaders'triestoincludenonexistentcontextfunc-apply-sipheaders-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfunc-set-sipheader'triestoincludenonexistentcontextfunc-set-sipheader-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-dial-one'triestoincludenonexistentcontextmacro-dial-one-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-hangupcall'triestoincludenonexistentcontextmacro-hangupcall-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-blkvm-check'triestoincludenonexistentcontextmacro-blkvm-check-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-blkvm-clr'triestoincludenonexistentcontextmacro-blkvm-clr-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-blkvm-set'triestoincludenonexistentcontextmacro-blkvm-set-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-blkvm-setifempty'triestoincludenonexistentcontextmacro-blkvm-setifempty-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextoriginate-skipvm'triestoincludenonexistentcontextoriginate-skipvm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-simple-dial'triestoincludenonexistentcontextmacro-simple-dial-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-exten-vm'triestoincludenonexistentcontextmacro-exten-vm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-vm'triestoincludenonexistentcontextmacro-vm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-block-cf'triestoincludenonexistentcontextmacro-block-cf-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-setmusic'triestoincludenonexistentcontextmacro-setmusic-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-dial-confirm'triestoincludenonexistentcontextmacro-dial-confirm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-dahdi'triestoincludenonexistentcontextfrom-dahdi-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-zaptel'triestoincludenonexistentcontextfrom-zaptel-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-outbound-callerid'triestoincludenonexistentcontextmacro-outbound-callerid-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-user-callerid'triestoincludenonexistentcontextmacro-user-callerid-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-privacy-mgr'triestoincludenonexistentcontextmacro-privacy-mgr-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-dialout-trunk'triestoincludenonexistentcontextmacro-dialout-trunk-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsub-pincheck'triestoincludenonexistentcontextsub-pincheck-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-auto-blkvm'triestoincludenonexistentcontextmacro-auto-blkvm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-auto-confirm'triestoincludenonexistentcontextmacro-auto-confirm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-confirm'triestoincludenonexistentcontextmacro-confirm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsub-presencestate-display'triestoincludenonexistentcontextsub-presencestate-display-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextbad-number'triestoincludenonexistentcontextbad-number-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-blackhole'triestoincludenonexistentcontextapp-blackhole-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextoutrt-2'triestoincludenonexistentcontextoutrt-2-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextoutbound-allroutes'triestoincludenonexistentcontextoutbound-allroutes-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-prepend-cid'triestoincludenonexistentcontextmacro-prepend-cid-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-trunk-sip-Flowroute'triestoincludenonexistentcontextfrom-trunk-sip-Flowroute-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-trunk'triestoincludenonexistentcontextext-trunk-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-did-catchall'triestoincludenonexistentcontextext-did-catchall-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-did'triestoincludenonexistentcontextext-did-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-test'triestoincludenonexistentcontextext-test-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-chanspy'triestoincludenonexistentcontextapp-chanspy-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-pickup'triestoincludenonexistentcontextapp-pickup-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfindmefollow-ringallv2'triestoincludenonexistentcontextfindmefollow-ringallv2-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-local-confirm'triestoincludenonexistentcontextext-local-confirm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-dial'triestoincludenonexistentcontextmacro-dial-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-userlogonoff'triestoincludenonexistentcontextapp-userlogonoff-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-blacklist-last'triestoincludenonexistentcontextapp-blacklist-last-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-blacklist-remove'triestoincludenonexistentcontextapp-blacklist-remove-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-blacklist-add-invalid'triestoincludenonexistentcontextapp-blacklist-add-invalid-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-blacklist-add'triestoincludenonexistentcontextapp-blacklist-add-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-blacklist-check'triestoincludenonexistentcontextapp-blacklist-check-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-blacklist'triestoincludenonexistentcontextapp-blacklist-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-vmmain'triestoincludenonexistentcontextapp-vmmain-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfrom-did-direct-ivr'triestoincludenonexistentcontextfrom-did-direct-ivr-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-local'triestoincludenonexistentcontextext-local-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-dialvm'triestoincludenonexistentcontextapp-dialvm-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextvm-callme'triestoincludenonexistentcontextvm-callme-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextvmnotify-dummy'triestoincludenonexistentcontextvmnotify-dummy-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextvmnotify-main'triestoincludenonexistentcontextvmnotify-main-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-toggle-tc'triestoincludenonexistentcontextmacro-toggle-tc-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contexttimeconditions-toggles'triestoincludenonexistentcontexttimeconditions-toggles-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contexttimeconditions'triestoincludenonexistentcontexttimeconditions-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-speeddial-set'triestoincludenonexistentcontextapp-speeddial-set-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-speeddial'triestoincludenonexistentcontextapp-speeddial-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-speeddial-lookup'triestoincludenonexistentcontextmacro-speeddial-lookup-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsub-rgsetcid'triestoincludenonexistentcontextsub-rgsetcid-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-group'triestoincludenonexistentcontextext-group-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-systemrecording'triestoincludenonexistentcontextmacro-systemrecording-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsystemrecording-gui'triestoincludenonexistentcontextsystemrecording-gui-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-pbdirectory'triestoincludenonexistentcontextapp-pbdirectory-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-parking'triestoincludenonexistentcontextapp-parking-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextpark-hints'triestoincludenonexistentcontextpark-hints-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextpark-return-routing'triestoincludenonexistentcontextpark-return-routing-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextpark-orphan-routing'triestoincludenonexistentcontextpark-orphan-routing-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextpark-dial'triestoincludenonexistentcontextpark-dial-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextparkedcallstimeout'triestoincludenonexistentcontextparkedcallstimeout-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-parked-call'triestoincludenonexistentcontextmacro-parked-call-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-page-stream'triestoincludenonexistentcontextapp-page-stream-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-paging'triestoincludenonexistentcontextapp-paging-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextautoanswer'triestoincludenonexistentcontextautoanswer-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-autoanswer'triestoincludenonexistentcontextmacro-autoanswer-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-intercom-users'triestoincludenonexistentcontextext-intercom-users-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-intercom'triestoincludenonexistentcontextext-intercom-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextoriginate-aa'triestoincludenonexistentcontextoriginate-aa-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-outisbusy'triestoincludenonexistentcontextmacro-outisbusy-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsub-hr24format'triestoincludenonexistentcontextsub-hr24format-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-speakingclock'triestoincludenonexistentcontextapp-speakingclock-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsub-hr12format'triestoincludenonexistentcontextsub-hr12format-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-speakextennum'triestoincludenonexistentcontextapp-speakextennum-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-echo-test-echo'triestoincludenonexistentcontextapp-echo-test-echo-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-echo-test'triestoincludenonexistentcontextapp-echo-test-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-calltrace-perform'triestoincludenonexistentcontextapp-calltrace-perform-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-calltrace'triestoincludenonexistentcontextapp-calltrace-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-hotelwakeup'triestoincludenonexistentcontextapp-hotelwakeup-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsub-fmsetcid'triestoincludenonexistentcontextsub-fmsetcid-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfollowme-sub'triestoincludenonexistentcontextfollowme-sub-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfollowme-check'triestoincludenonexistentcontextfollowme-check-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextfmgrps'triestoincludenonexistentcontextfmgrps-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-findmefollow'triestoincludenonexistentcontextext-findmefollow-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-fmf-toggle'triestoincludenonexistentcontextapp-fmf-toggle-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-featurecodes'triestoincludenonexistentcontextext-featurecodes-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextivr-1'triestoincludenonexistentcontextivr-1-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-did-0002'triestoincludenonexistentcontextext-did-0002-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-did-0001'triestoincludenonexistentcontextext-did-0001-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-fax'triestoincludenonexistentcontextapp-fax-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-fax'triestoincludenonexistentcontextext-fax-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-dnd-hints'triestoincludenonexistentcontextext-dnd-hints-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-dnd-toggle'triestoincludenonexistentcontextapp-dnd-toggle-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-dnd-on'triestoincludenonexistentcontextapp-dnd-on-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-dnd-off'triestoincludenonexistentcontextapp-dnd-off-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextdisa-dial'triestoincludenonexistentcontextdisa-dial-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-dictate-send'triestoincludenonexistentcontextapp-dictate-send-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-dictate-record'triestoincludenonexistentcontextapp-dictate-record-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-pjsip-auto-answer-redirect'triestoincludenonexistentcontextc-x-3-operator-panel-pjsip-auto-answer-redirect-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-pjsip-auto-answer-headers'triestoincludenonexistentcontextc-x-3-operator-panel-pjsip-auto-answer-headers-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-spy'triestoincludenonexistentcontextc-x-3-operator-panel-spy-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-listen-to-recording'triestoincludenonexistentcontextc-x-3-operator-panel-listen-to-recording-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-listen-to-voice-mail'triestoincludenonexistentcontextc-x-3-operator-panel-listen-to-voice-mail-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-park-announce-answer'triestoincludenonexistentcontextc-x-3-operator-panel-park-announce-answer-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-park'triestoincludenonexistentcontextc-x-3-operator-panel-park-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-confbridge'triestoincludenonexistentcontextc-x-3-operator-panel-confbridge-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-meetme'triestoincludenonexistentcontextc-x-3-operator-panel-meetme-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-voice-mail'triestoincludenonexistentcontextc-x-3-operator-panel-voice-mail-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextc-x-3-operator-panel-hold'triestoincludenonexistentcontextc-x-3-operator-panel-hold-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextcidlookup'triestoincludenonexistentcontextcidlookup-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-callwaiting-cwon'triestoincludenonexistentcontextapp-callwaiting-cwon-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-callwaiting-cwoff'triestoincludenonexistentcontextapp-callwaiting-cwoff-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextmacro-one-touch-record'triestoincludenonexistentcontextmacro-one-touch-record-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsub-record-check'triestoincludenonexistentcontextsub-record-check-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextsub-record-cancel'triestoincludenonexistentcontextsub-record-cancel-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextext-cf-hints'triestoincludenonexistentcontextext-cf-hints-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-prompting-on'triestoincludenonexistentcontextapp-cf-prompting-on-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-on'triestoincludenonexistentcontextapp-cf-on-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-unavailable-off'triestoincludenonexistentcontextapp-cf-unavailable-off-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-unavailable-on'triestoincludenonexistentcontextapp-cf-unavailable-on-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-unavailable-prompt-on'triestoincludenonexistentcontextapp-cf-unavailable-prompt-on-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-off-any'triestoincludenonexistentcontextapp-cf-off-any-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-off'triestoincludenonexistentcontextapp-cf-off-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-busy-off'triestoincludenonexistentcontextapp-cf-busy-off-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-busy-off-any'triestoincludenonexistentcontextapp-cf-busy-off-any-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-busy-on'triestoincludenonexistentcontextapp-cf-busy-on-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-busy-prompting-on'triestoincludenonexistentcontextapp-cf-busy-prompting-on-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-cf-toggle'triestoincludenonexistentcontextapp-cf-toggle-custom'
[2017-04-06 14:45:05] WARNING[1717] pbx.c:Contextapp-announcement-1'triestoincludenonexistentcontextapp-announcement-1-custom'
[2017-04-06 14:45:06] WARNING[1717] http.c:Invalidsessionlimit'atline15ofhttp.conf
[2017-04-06 14:45:12] WARNING[1717] res_stun_monitor.c:Unabletoloadconfigres_stun_monitor.conf
[2017-04-06 14:45:13] WARNING[1717] res_digium_phone.c:NoValidDPMALicensefound.Moduleisloadedbutdisabled.Pleasereloadmoduleoncevalidlicenseisinstalled.
[2017-04-06 14:45:13] WARNING[1717] res_pktccops.c:Unabletoloadconfigfileres_pktccops.conf
[2017-04-06 14:45:13] WARNING[1717] loader.c:Errorloadingmoduleres_pjsip_phoneprov_provider.so':/usr/lib/asterisk/modules/res_pjsip_phoneprov_provider.so:undefinedsymbol:ast_phoneprov_add_extension
[2017-04-06 14:45:13] WARNING[1717] loader.c:Moduleres_pjsip_phoneprov_provider.so'couldnotbeloaded.
[2017-04-06 14:45:14] WARNING[1717] loader.c:Errorloadingmoduleres_pjsip_phoneprov_provider.so':/usr/lib/asterisk/modules/res_pjsip_phoneprov_provider.so:undefinedsymbol:ast_phoneprov_add_extension
[2017-04-06 14:45:14] WARNING[1717] loader.c:Moduleres_pjsip_phoneprov_provider.so'couldnotbeloaded.
[2017-04-06 14:45:14] WARNING[1717] loader.c:Errorloadingmoduleres_pjsip_phoneprov_provider.so':/usr/lib/asterisk/modules/res_pjsip_phoneprov_provider.so:undefinedsymbol:ast_phoneprov_add_extension
[2017-04-06 14:45:14] WARNING[1717] loader.c:Moduleres_pjsip_phoneprov_provider.so'couldnotbeloaded.
[2017-04-06 14:45:14] WARNING[1717] loader.c:Errorloadingmoduleres_pjsip_phoneprov_provider.so':/usr/lib/asterisk/modules/res_pjsip_phoneprov_provider.so:undefinedsymbol:ast_phoneprov_add_extension
[2017-04-06 14:45:14] WARNING[1717] loader.c:Moduleres_pjsip_phoneprov_provider.so'couldnotbeloaded.
[2017-04-06 14:45:14] WARNING[1717] loader.c:Errorloadingmoduleres_pjsip_phoneprov_provider.so':/usr/lib/asterisk/modules/res_pjsip_phoneprov_provider.so:undefinedsymbol:ast_phoneprov_add_extension
[2017-04-06 14:45:14] WARNING[1717] loader.c:Moduleres_pjsip_phoneprov_provider.so'couldnotbeloaded.
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!PLEASENOTE:Settingnat'forapeer/userthatdiffersfromtheglobalsettingcanmake
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!thenameofthatpeer/userdiscoverablebyanattacker.Repliesfornon-existentpeers/users
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!willbesenttoadifferentportthanrepliesforanexistingpeer/user.Ifatallpossible,
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!usetheglobalnat'settinganddonotsetnat'perpeer/user.
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!(configcategory='1943'globalforce_rport='Yes'peer/userforce_rport='No')
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!PLEASENOTE:Settingnat'forapeer/userthatdiffersfromtheglobalsettingcanmake
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!thenameofthatpeer/userdiscoverablebyanattacker.Repliesfornon-existentpeers/users
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!willbesenttoadifferentportthanrepliesforanexistingpeer/user.Ifatallpossible,
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!usetheglobalnat'settinganddonotsetnat'perpeer/user.
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!(configcategory='4443'globalforce_rport='Yes'peer/userforce_rport='No')
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!PLEASENOTE:Settingnat'forapeer/userthatdiffersfromtheglobalsettingcanmake
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!thenameofthatpeer/userdiscoverablebyanattacker.Repliesfornon-existentpeers/users
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!willbesenttoadifferentportthanrepliesforanexistingpeer/user.Ifatallpossible,
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!usetheglobalnat'settinganddonotsetnat'perpeer/user.
[2017-04-06 14:45:14] WARNING[1717] chan_sip.c:!!!(configcategory='9999'globalforce_rport='Yes'peer/userforce_rport='No')
[2017-04-06 14:45:15] WARNING[1717] iax2/firmware.c:Erroropeningfirmwaredirectory/var/lib/asterisk/firmware/iax':Nosuchfileordirectory
[2017-04-06 14:45:17] WARNING[1717] res_calendar.c:Calendarsupportdisabled,notloadingicalcalendarmodule
[2017-04-06 14:45:17] WARNING[1717] res_calendar.c:Calendarsupportdisabled,notloadingexchangecalendarmodule
[2017-04-06 14:45:17] WARNING[1717] res_calendar.c:Calendarsupportdisabled,notloadingewscalendarmodule
[2017-04-06 14:45:17] WARNING[1717] res_calendar.c:Calendarsupportdisabled,notloadingcaldavcalendarmodule
[2017-04-06 14:45:17] WARNING[1717] cdr_odbc.c:cdr_odbc:UnabletoloadconfigforODBCCDR's:cdr_odbc.conf
[2017-04-06 14:45:17] WARNING[1717] cdr_manager.c:Failedtoloadconfigurationfile.Modulenotactivated.
[2017-04-06 14:45:17] WARNING[1717] app_festival.c:Nosuchconfigurationfilefestival.conf
[2017-04-06 14:45:17] WARNING[1717] app_followme.c:Nofollowmeconfigfile(followme.conf),sonofollowme
[2017-04-06 14:45:17] WARNING[1717] res_hep_rtcp.c:res_hepisnotloadedorrunning;decliningmoduleload
[2017-04-06 14:45:17] WARNING[1717] app_flite.c:Flite:Unabletoreadconfigfileflite.conf.Usingdefaultsettings
[2017-04-06 14:45:18] WARNING[1717] res_hep_pjsip.c:res_hepisnotloadedorrunning;decliningmoduleload
[2017-04-06 14:45:18] WARNING[1717] app_voicemail.c:maxsilenceshouldbelessthanminsecsoryoumaygetemptymessages
[2017-04-06 14:46:15] WARNING[1801] func_cdr.c:CDRrequiresavalue(CDR(variable)=value)

cynjut · April 7, 2017, 6:53pm

All of that was from the “Apply Changes” you did at 14:45 on the 6th of April this year.

Doesn’t sound like you’re looking at your logs from the middle of the night, unless you’re in the southern hemisphere (it’s day-time here, so it’s night there, right?)

All of these warnings are to be expected - they are warning you about option files that do not exist. They are overly verbose and do not actually have any bearing on the running of the system. There are a few of these that are legit warnings about modules that didn’t start (like the app_followme.c one you see at the end) but even then, it just means that FM/FM didn’t start because there are no FM/FM options defined.

Start looking through yesterday’s file at around 18:00 and look through 06:00 this morning. You were the one that said the problem was first thing in the morning, so start your search at a time that makes sense. It’s a little like the old joke about the guy on his hands and knees looking for his keys under the streetlight “because the light’s better over here.”

JMart · April 7, 2017, 7:12pm

That’s even more concerning as I didn’t make any changes on the 6th. The last thing I did was through the GUI and it was to add a number to the blacklist on the 29th of last month.

The log file that that came from starts at
[2017-04-06 03:12:02]
and ends at
[2017-04-07 03:36:02]

I gave those errors and warnings because that’s all that I found in the file. There are no warnings or errors during the times that I’m thinking the server goes down. I really don’t know for sure when it goes off line

Sometimes we don’t get calls just because we don’t get calls. Then sometimes when we don’t get calls and I phone the server I find that we’re not getting calls because there’s a problem.

I see many of the same Warnings and Errors in the log file this morning at 09:45.

Sorry for any confusion. Thanks for the help.

John

cynjut · April 7, 2017, 7:48pm

OK - you remember when I said that the problem may not be your PBX?

You see these warnings and errors whenever the services reloads. There aren’t many reasons why you’d have a reload, but it can happen.

Log into your asterisk server as root and run “asterisk -vr”

Check your service uptime, and other system status messages. If your server’s uptime is just a few hours, you might be seeing a hardware issue on the server itself. If the server’s uptime is good, but asterisk’s uptime is crappy, then asterisk could be having a problem.

Start looking around your network and make sure all of your devices are working correctly. A bad network switch, a bad cable modem, or a bad firewall or router could all cause the problems you originally identified.

This was never going to be a “look for this one thing and fix it” problem. You are looking at an ill defined problem that you can’t describe or pin point and you’re trying to describe it using a vocabulary that it sounds like you aren’t well trained or familiar with. This was never going to be easy, but that’s why we get paid the big bucks.

JMart · April 7, 2017, 8:11pm

So it’s doing it again now. I phone into the server, it rings three times then goes to a busy signal. I have reset my work group switch and router. Did nothing. There are no new warnings or errors in the full log since way earlier today.

Using putty I run asterisk -vr

	Connected to Asterisk 13.12.1 currently running on localhost (pid = 1787)
[2017-04-07 16:07:16] NOTICE[2112]: chan_sip.c:28263 handle_request_subscribe: Received SIP subscribe for peer without mailbox: 1943
[2017-04-07 16:07:19] NOTICE[2112]: chan_sip.c:28263 handle_request_subscribe: Received SIP subscribe for peer without mailbox: 4443
[2017-04-07 16:08:07] NOTICE[2112]: chan_sip.c:28263 handle_request_subscribe: Received SIP subscribe for peer without mailbox: 4443
[2017-04-07 16:08:11] NOTICE[2112]: chan_sip.c:28263 handle_request_subscribe: Received SIP subscribe for peer without mailbox: 4443
[2017-04-07 16:08:23] NOTICE[2112]: chan_sip.c:28263 handle_request_subscribe: Received SIP subscribe for peer without mailbox: 4443
[2017-04-07 16:09:17] NOTICE[2112]: chan_sip.c:28263 handle_request_subscribe: Received SIP subscribe for peer without mailbox: 1943
[2017-04-07 16:09:23] NOTICE[2112]: chan_sip.c:28263 handle_request_subscribe: Received SIP subscribe for peer without mailbox: 4443
localhost*CLI>

JMart · April 7, 2017, 8:49pm

I found this in the Messages file 16:06 and I noticed it was down at about 16:12
I imagine this is the or a cause??

Apr 7 16:06:03 localhost kernel: tg3 0000:40:00.0: eth0: Link is down
Apr 7 16:06:11 localhost kernel: tg3 0000:40:00.0: eth0: Link is up at 100 Mbps, full duplex
Apr 7 16:06:11 localhost kernel: tg3 0000:40:00.0: eth0: Flow control is on for TX and on for RX

I seem to remember having some issues when setting this server up. Issues having to do with eth0 and bios.

JMart · April 7, 2017, 11:50pm

I found a thread hoping it would help with this
Remove all devices in /etc/udev/rules.d/70-persistant-net.rules then reboot.
No luck.

I have found that when I can’t call inbound, making an outbound call seems to fix the no inbound issue.

My goodness. Someone else must have had this same problem before. What can I do to fix it? Please. Sales are bad enough as is, now when a potential customer calls the phone tells them we’re out of business.

Please. Thank you,
John

cynjut · April 8, 2017, 10:03pm

OK. That sounds like a reasonable smoking gun.

If your ethernet port goes down, you lose your network. If you lose your network, then you have to re-establish your connection before you can receive calls.

Think of it like your playing catch over a fence. You throw the ball back and forth. At some point, the person on the other side doesn’t throw the ball back. What are you supposed to do, keep throwing balls until their backyard fills up?

You have a hardware problem. Find the wire that is connected to your Ethernet0 port. If you can’t troubleshoot at a fine granularity, replace the devices on both ends of that wire, then replace the wire. If you have to hire someone to do the troubleshooting, do that.

Let me repeat. The problem is your network. You need to start replacing stuff. Something is broken in your hardware.

JMart · April 9, 2017, 3:16pm

Hey. I just bypassed the switch which I never used to use. I thought that I had always used the switch, but just found direct cabling to where the server used to be located. So I’ve routed that cable to where the server lives now and have re-established a direct connection to the router. I had forgotten about that.

Also, I used to have a port forward setup in the router and I removed it a year or so ago. I just re-added this rule. Think this could be the problem? It’s working now, but that doesn’t mean that once I turn my back it will continue working…

Thank you,
John

ChadRT · April 9, 2017, 5:31pm

I dont know if it applies here or not but I had the EXACT same problem when I was using an Ethernet Switch that had 802.3az incorporated into it. Once I pressed the button to turn off 802.3az (power saving “green” function) I no longer had the issue!!

JMart · April 9, 2017, 5:51pm

Hey Chad. Thanks a bunch for your input here. I’m using EZXS16W and there’s no power saving option mentioned in the manual. The only button is MDI/MDIX to use port 16 as an up link. I did find IEEE 802.3, IEEE802.3u mentioned as a standard in the manual.

Going back to that previous configuration, it’s been three hours now and inbound is still working. That’s not to say that it will keep working, but it is for now and that’s a good thing. I’ll of course continue checking on the inbound until later this evening and then throughout the day tomorrow. I’ll post back with results.

Thank You all so much for your help with this.

John

EDIT 7:30 pm. So far so good.

JMart · April 10, 2017, 2:42pm

Must have been the switch. The server’s still getting inbound calls. No issues.

JMart · April 11, 2017, 5:01pm

Unless the issue arises again this will be my last update. There have been no problems with inbound calls since getting away from the workgroup switch.

Thanks again for all of your help with this.