Freepbx slow apply config, doesnt appear to be Signatures

Hi, been having an issue where reloading asterisk takes forever. System load is 0.64. I modified the performance logging and added a quick summary of everything. This is the time everything takes. When I manually reload asterisk it takes 1 second. However when Freepbx reloads it, it takes 60 seconds. Any ideas that may help point me in the right direction? I am sort of running out of ideas at this point.

Reload Started
{
“load_astdb”: 0.05140495300293,
“trust_gpg”: 0.014846086502075,
“check_html5”: 0.089977979660034,
“Less Parser Generate Module Styles”: 0.00087594985961914,
“Less Parser Generate Main Styles”: 0.00072503089904785,
“extenconflicts”: 0.0031390190124512,
“listproblems”: 0.71305680274963,
“extmap”: 0.0052900314331055,
“getAllDialplanHooks”: 0.00082802772521973,
“processDialplanHooks”: 1.1574790477753,
“extensions_additional”: 0.26471614837646,
“processFileHooks”: 0.24430990219116,
“Signature Checks”: 0.007105827331543,
“retrieve_conf”: 2.9532420635223,
“Reload Asterisk”: 60.066791057587
}
Reload Complete

Howdy!

Welcome back to the forums. :cowboy_hat_face:

Have you checked DNS for issues ?

Yeah. I thought it wasnt asterisk because I reloaded it earlier without any issue. However I just did another reload and it took forever. Measured the module load times and got this:

Reloading func_talkdetect.so… .003987669 seconds
Reloading func_presencestate.so… .003996871 seconds
Reloading func_sayfiles.so… .003996936 seconds
Reloading res_pjsip_registrar.so… .003999732 seconds
Reloading res_hep_pjsip.so… .004011892 seconds
Reloading chan_console.so… .004015736 seconds
Reloading res_pjsip_session.so… .004015950 seconds
Reloading func_pitchshift.so… .004021470 seconds
Reloading codec_lpc10.so… .004031083 seconds
Reloading app_mf.so… .004031652 seconds
Reloading res_pjsip_dlg_options.so… .004037352 seconds
Reloading res_format_attr_g729.so… .004040076 seconds
Reloading app_playtones.so… .004040897 seconds
Reloading codec_silk.so… .004044789 seconds
Reloading res_chan_stats.so… .004044963 seconds
Reloading func_sprintf.so… .004049539 seconds
Reloading res_stun_monitor.so… .004049929 seconds
Reloading res_format_attr_siren14.so… .004050266 seconds
Reloading res_mwi_devstate.so… .004053348 seconds
Reloading res_resolver_unbound.so… .004053683 seconds
Reloading res_sorcery_memory.so… .004054704 seconds
Reloading func_json.so… .004055167 seconds
Reloading res_pjsip_diversion.so… .004056485 seconds
Reloading res_ari_bridges.so… .004057460 seconds
Reloading res_pjsip_logger.so… .004060228 seconds
Reloading res_timing_dahdi.so… .004060428 seconds
Reloading func_blacklist.so… .004061828 seconds
Reloading res_timing_timerfd.so… .004065667 seconds
Reloading func_lock.so… .004066981 seconds
Reloading codec_opus.so… .004069060 seconds
Reloading codec_resample.so… .004073415 seconds
Reloading func_frame_drop.so… .004073500 seconds
Reloading func_pjsip_endpoint.so… .004073566 seconds
Reloading res_pjsip_sips_contact.so… .004074604 seconds
Reloading format_ilbc.so… .004075438 seconds
Reloading app_milliwatt.so… .004077115 seconds
Reloading func_db.so… .004080257 seconds
Reloading app_jack.so… .004080514 seconds
Reloading app_db.so… .004081626 seconds
Reloading res_tonedetect.so… .004084954 seconds
Reloading res_stasis_answer.so… .004085459 seconds
Reloading func_aes.so… .004086393 seconds
Reloading res_manager_presencestate.so… .004088413 seconds
Reloading res_pjsip_t38.so… .004089022 seconds
Reloading res_pjsip_dialog_info_body_generator.so… .004093130 seconds
Reloading app_macro.so… .004096597 seconds
Reloading func_sysinfo.so… .004097189 seconds
Reloading app_bridgewait.so… .004097307 seconds
Reloading func_sha1.so… .004097334 seconds
Reloading res_hep.so… .004099806 seconds
Reloading codec_alaw.so… .004100427 seconds
Reloading app_record.so… .004100733 seconds
Reloading func_dialplan.so… .004101379 seconds
Reloading func_shell.so… .004101910 seconds
Reloading app_dtmfstore.so… .004106441 seconds
Reloading func_periodic_hook.so… .004106525 seconds
Reloading app_sayunixtime.so… .004107992 seconds
Reloading func_base64.so… .004110496 seconds
Reloading res_pjsip_history.so… .004110759 seconds
Reloading chan_mobile.so… .004112436 seconds
Reloading format_ogg_speex.so… .004112691 seconds
Reloading app_verbose.so… .004113244 seconds
Reloading func_jitterbuffer.so… .004114621 seconds
Reloading res_realtime.so… .004114869 seconds
Reloading res_ari_model.so… .004117138 seconds
Reloading res_ari.so… .004117250 seconds
Reloading res_stasis_snoop.so… .004117282 seconds
Reloading func_callcompletion.so… .004117345 seconds
Reloading res_pjsip_one_touch_record_info.so… .004117675 seconds
Reloading format_mp3.so… .004117933 seconds
Reloading res_ari_recordings.so… .004118377 seconds
Reloading res_odbc.so… .004118492 seconds
Reloading res_config_curl.so… .004118880 seconds
Reloading res_pjsip_xpidf_body_generator.so… .004119626 seconds
Reloading func_iconv.so… .004119665 seconds
Reloading res_statsd.so… .004119961 seconds
Reloading codec_siren14.so… .004121738 seconds
Reloading res_sorcery_realtime.so… .004121868 seconds
Reloading app_image.so… .004121927 seconds
Reloading bridge_builtin_features.so… .004122475 seconds
Reloading res_format_attr_ilbc.so… .004122807 seconds
Reloading res_pjsip_exten_state.so… .004123073 seconds
Reloading chan_motif.so… .004123673 seconds
Reloading app_dial.so… .004127249 seconds
Reloading app_sms.so… .004128295 seconds
Reloading format_ogg_vorbis.so… .004130572 seconds
Reloading res_pjsip_acl.so… .004132612 seconds
Reloading app_disa.so… .004132848 seconds
Reloading format_h264.so… .004133531 seconds
Reloading app_url.so… .004135984 seconds
Reloading res_ari_device_states.so… .004137274 seconds
Reloading res_stasis_recording.so… .004137338 seconds
Reloading bridge_softmix.so… .004138190 seconds
Reloading res_stasis.so… .004139121 seconds
Reloading app_cdr.so… .004140501 seconds
Reloading res_pjsip_callid.so… .004140623 seconds
Reloading func_holdintercept.so… .004140663 seconds
Reloading res_pjsip_config_wizard.so… .004140890 seconds
Reloading func_module.so… .004141101 seconds
Reloading res_security_log.so… .004141242 seconds
Reloading func_groupcount.so… .004141614 seconds
Reloading res_stir_shaken.so… .004142429 seconds
Reloading res_hep_rtcp.so… .004143008 seconds
Reloading res_pjsip_transport_websocket.so… .004144665 seconds
Reloading func_global.so… .004145240 seconds
Reloading cdr_manager.so… .004146204 seconds
Reloading res_stasis_playback.so… .004147420 seconds
Reloading app_followme.so… .004147768 seconds
Reloading res_format_attr_silk.so… .004147844 seconds
Reloading app_dictate.so… .004149255 seconds
Reloading res_rtp_multicast.so… .004149288 seconds
Reloading res_fax.so… .004149896 seconds
Reloading pbx_lua.so… .004150300 seconds
Reloading app_forkcdr.so… .004153152 seconds
Reloading res_config_sqlite.so… .004153512 seconds
Reloading codec_siren7.so… .004154677 seconds
Reloading res_agi.so… .004154921 seconds
Reloading cdr_odbc.so… .004154980 seconds
Reloading res_ari_asterisk.so… .004154998 seconds
Reloading format_wav.so… .004155161 seconds
Reloading res_format_attr_celt.so… .004157328 seconds
Reloading func_enum.so… .004158886 seconds
Reloading func_timeout.so… .004159953 seconds
Reloading chan_rtp.so… .004160770 seconds
Reloading res_http_websocket.so… .004161869 seconds
Reloading res_parking.so… .004163689 seconds
Reloading bridge_builtin_interval_features.so… .004164257 seconds
Reloading func_rand.so… .004164480 seconds
Reloading func_env.so… .004165129 seconds
Reloading app_originate.so… .004165281 seconds
Reloading res_adsi.so… .004165563 seconds
Reloading res_pjsip_dtmf_info.so… .004167639 seconds
Reloading res_ari_endpoints.so… .004168972 seconds
Reloading res_http_media_cache.so… .004171437 seconds
Reloading res_sorcery_memory_cache.so… .004172507 seconds
Reloading res_pjsip_outbound_authenticator_digest.so… .004172908 seconds
Reloading app_readexten.so… .004173403 seconds
Reloading format_pcm.so… .004173458 seconds
Reloading pbx_realtime.so… .004173653 seconds
Reloading func_odbc.so… .004174040 seconds
Reloading res_pjsip_sdp_rtp.so… .004174340 seconds
Reloading format_ogg_opus.so… .004174438 seconds
Reloading app_userevent.so… .004175022 seconds
Reloading app_while.so… .004175833 seconds
Reloading chan_sip.so… .004176748 seconds
Reloading app_confbridge.so… .004176884 seconds
Reloading app_senddtmf.so… .004178144 seconds
Reloading app_nbscat.so… .004180932 seconds
Reloading res_pjsip_rfc3326.so… .004180944 seconds
Reloading res_mutestream.so… .004181134 seconds
Reloading app_controlplayback.so… .004181475 seconds
Reloading res_config_mysql.so… .004181987 seconds
Reloading res_pjsip_path.so… .004183810 seconds
Reloading res_pjsip_outbound_registration.so… .004184308 seconds
Reloading res_speech.so… .004184795 seconds
Reloading res_pjsip_mwi_body_generator.so… .004184873 seconds
Reloading format_vox.so… .004185861 seconds
Reloading codec_a_mu.so… .004186760 seconds
Reloading format_h263.so… .004191626 seconds
Reloading func_scramble.so… .004193678 seconds
Reloading res_calendar.so… .004195185 seconds
Reloading app_mp3.so… .004195191 seconds
Reloading func_devstate.so… .004195876 seconds
Reloading func_pjsip_aor.so… .004196905 seconds
Reloading res_ari_events.so… .004197095 seconds
Reloading chan_dahdi.so… .004197863 seconds
Reloading func_logic.so… .004198464 seconds
Reloading func_vmcount.so… .004199252 seconds
Reloading app_dahdiras.so… .004200472 seconds
Reloading codec_g722.so… .004202134 seconds
Reloading app_dumpchan.so… .004202209 seconds
Reloading app_channelredirect.so… .004202851 seconds
Reloading res_pjsip_send_info.so… .004203282 seconds
Reloading res_convert.so… .004203555 seconds
Reloading app_talkdetect.so… .004203632 seconds
Reloading func_volume.so… .004207101 seconds
Reloading res_format_attr_vp8.so… .004207511 seconds
Reloading res_pktccops.so… .004207989 seconds
Reloading app_system.so… .004208639 seconds
Reloading chan_ooh323.so… .004209598 seconds
Reloading func_channel.so… .004211862 seconds
Reloading app_sf.so… .004212235 seconds
Reloading chan_pjsip.so… .004212759 seconds
Reloading bridge_native_rtp.so… .004214786 seconds
Reloading app_waituntil.so… .004214827 seconds
Reloading res_pjsip_messaging.so… .004215409 seconds
Reloading func_frame_trace.so… .004215432 seconds
Reloading app_directed_pickup.so… .004216180 seconds
Reloading bridge_simple.so… .004217282 seconds
Reloading res_pjsip_nat.so… .004217660 seconds
Reloading res_calendar_caldav.so… .004218045 seconds
Reloading res_smdi.so… .004218242 seconds
Reloading res_pjsip_header_funcs.so… .004219352 seconds
Reloading app_ices.so… .004219825 seconds
Reloading func_speex.so… .004219902 seconds
Reloading res_sorcery_config.so… .004220730 seconds
Reloading app_zapateller.so… .004222660 seconds
Reloading res_pjsip_notify.so… .004224273 seconds
Reloading codec_ilbc.so… .004226278 seconds
Reloading app_celgenuserevent.so… .004228190 seconds
Reloading func_pjsip_contact.so… .004230546 seconds
Reloading res_stasis_device_state.so… .004230684 seconds
Reloading pbx_loopback.so… .004232691 seconds
Reloading res_rtp_asterisk.so… .004234046 seconds
Reloading app_sendtext.so… .004236940 seconds
Reloading res_pjsip_stir_shaken.so… .004238303 seconds
Reloading res_format_attr_h263.so… .004243236 seconds
Reloading codec_g726.so… .004243677 seconds
Reloading func_math.so… .004244208 seconds
Reloading app_morsecode.so… .004244441 seconds
Reloading res_endpoint_stats.so… .004244794 seconds
Reloading func_cdr.so… .004245978 seconds
Reloading res_format_attr_h264.so… .004247370 seconds
Reloading format_sln.so… .004249250 seconds
Reloading app_externalivr.so… .004249882 seconds
Reloading func_callerid.so… .004252114 seconds
Reloading res_pjsip_endpoint_identifier_user.so… .004252423 seconds
Reloading func_srv.so… .004253307 seconds
Reloading pbx_ael.so… .004254495 seconds
Reloading app_page.so… .004254867 seconds
Reloading func_sorcery.so… .004255989 seconds
Reloading res_ael_share.so… .004256649 seconds
Reloading app_attended_transfer.so… .004257446 seconds
Reloading app_exec.so… .004258903 seconds
Reloading func_uri.so… .004261238 seconds
Reloading func_dialgroup.so… .004261917 seconds
Reloading res_curl.so… .004262404 seconds
Reloading res_ari_playbacks.so… .004263790 seconds
Reloading res_xmpp.so… .004264643 seconds
Reloading res_odbc_transaction.so… .004264876 seconds
Reloading res_calendar_icalendar.so… .004267504 seconds
Reloading func_version.so… .004268267 seconds
Reloading cdr_csv.so… .004268344 seconds
Reloading func_md5.so… .004269014 seconds
Reloading chan_phone.so… .004270051 seconds
Reloading res_sorcery_astdb.so… .004270806 seconds
Reloading app_directory.so… .004273739 seconds
Reloading res_limit.so… .004274510 seconds
Reloading app_transfer.so… .004277324 seconds
Reloading func_curl.so… .004278273 seconds
Reloading cel_manager.so… .004278507 seconds
Reloading app_read.so… .004279892 seconds
Reloading format_g719.so… .004282360 seconds
Reloading app_blind_transfer.so… .004282648 seconds
Reloading res_fax_spandsp.so… .004284117 seconds
Reloading app_playback.so… .004285584 seconds
Reloading app_getcpeid.so… .004286348 seconds
Reloading app_bridgeaddchan.so… .004286988 seconds
Reloading func_cut.so… .004290498 seconds
Reloading res_clioriginate.so… .004291659 seconds
Reloading res_calendar_exchange.so… .004292978 seconds
Reloading res_calendar_ews.so… .004293805 seconds
Reloading res_srtp.so… .004295170 seconds
Reloading res_pjsip_pidf_eyebeam_body_supplement.so… .004300024 seconds
Reloading chan_unistim.so… .004300584 seconds
Reloading res_pjsip_outbound_publish.so… .004300720 seconds
Reloading format_g729.so… .004302281 seconds
Reloading res_pjsip_pubsub.so… .004305535 seconds
Reloading func_extstate.so… .004308441 seconds
Reloading res_pjsip_pidf_body_generator.so… .004308623 seconds
Reloading func_hangupcause.so… .004309093 seconds
Reloading res_pjsip_endpoint_identifier_anonymous.so… .004309752 seconds
Reloading app_chanisavail.so… .004311010 seconds
Reloading bridge_holding.so… .004311113 seconds
Reloading app_echo.so… .004311964 seconds
Reloading app_alarmreceiver.so… .004316980 seconds
Reloading res_pjsip_send_to_voicemail.so… .004318413 seconds
Reloading app_authenticate.so… .004318697 seconds
Reloading app_amd.so… .004321050 seconds
Reloading format_g726.so… .004321793 seconds
Reloading app_chanspy.so… .004324851 seconds
Reloading app_reload.so… .004325251 seconds
Reloading codec_gsm.so… .004332695 seconds
Reloading format_gsm.so… .004336400 seconds
Reloading res_pjsip.so… .004338372 seconds
Reloading res_pjsip_authenticator_digest.so… .004339974 seconds
Reloading res_pjsip_mwi.so… .004340719 seconds
Reloading app_flash.so… .004341374 seconds
Reloading res_format_attr_opus.so… .004341934 seconds
Reloading func_config.so… .004342034 seconds
Reloading app_stream_echo.so… .004343119 seconds
Reloading res_ari_channels.so… .004349683 seconds
Reloading format_wav_gsm.so… .004356921 seconds
Reloading app_flite.so… .004372155 seconds
Reloading pbx_config.so… .004376939 seconds
Reloading res_pjsip_publish_asterisk.so… .004377788 seconds
Reloading chan_bridge_media.so… .004383254 seconds
Reloading func_realtime.so… .004383762 seconds
Reloading codec_dahdi.so… .004386804 seconds
Reloading app_test.so… .004389655 seconds
Reloading res_timing_pthread.so… .004390083 seconds
Reloading res_ari_sounds.so… .004391969 seconds
Reloading func_strings.so… .004395234 seconds
Reloading res_pjsip_caller_id.so… .004395689 seconds
Reloading res_manager_devicestate.so… .004400483 seconds
Reloading res_pjsip_refer.so… .004402392 seconds
Reloading app_agent_pool.so… .004402635 seconds
Reloading app_meetme.so… .004406453 seconds
Reloading codec_adpcm.so… .004416858 seconds
Reloading res_pjsip_empty_info.so… .004417975 seconds
Reloading pbx_spool.so… .004418790 seconds
Reloading app_privacy.so… .004421173 seconds
Reloading app_mixmonitor.so… .004422058 seconds
Reloading pbx_dundi.so… .004423755 seconds
Reloading res_ari_applications.so… .004432979 seconds
Reloading format_siren7.so… .004442920 seconds
Reloading res_pjsip_pidf_digium_body_supplement.so… .004452182 seconds
Reloading res_crypto.so… .004453178 seconds
Reloading app_waitforring.so… .004462869 seconds
Reloading res_pjsip_endpoint_identifier_ip.so… .004463505 seconds
Reloading app_stasis.so… .004476505 seconds
Reloading app_mysql.so… .004483567 seconds
Reloading format_g723.so… .004497048 seconds
Reloading app_adsiprog.so… .004498096 seconds
Reloading app_waitforsilence.so… .004514760 seconds
Reloading res_musiconhold.so… .004526725 seconds
Reloading app_queue.so… .004560009 seconds
Reloading chan_skinny.so… .004589899 seconds
Reloading res_format_attr_siren7.so… .004591651 seconds
Reloading res_config_odbc.so… .004600716 seconds
Reloading app_waitforcond.so… .004622243 seconds
Reloading res_pjproject.so… .004741384 seconds
Reloading app_stack.so… .004841372 seconds
Reloading res_monitor.so… .004877463 seconds
Reloading app_speech_utils.so… .004898770 seconds
Reloading cel_odbc.so… .004912926 seconds
Reloading cdr_adaptive_odbc.so… .005000154 seconds
Reloading format_siren14.so… .005034012 seconds
Reloading app_softhangup.so… .005084654 seconds
Reloading codec_ulaw.so… .005093600 seconds
Reloading app_festival.so… .005756331 seconds
Reloading chan_iax2.so… .006258213 seconds
Reloading app_voicemail.so… .006945714 seconds
Reloading codec_ast16_g729.so… 60.043046508 seconds

What version of FreePBX, what version of Asterisk, and how was it installed?

And does “fwconsole sysadmin info” return quickly?

sysadmin info Returns fast.
Asterisk 16.24.1
FreePBX 15.0.37.9

What is the output of “module show like g729” in Asterisk?