Unable to apply configuration

Hello everyone, I’m unable to apply config in my FreePBX distro and all my users are offline.

When trying from the web UI nothing happens it keeps showing “Reloading…” for hours (13 hours) with no feedback or any error message…

I have also tried from the CLI:

“amportal a r” stuck at Reloading FreePBX with no error or output as in the Web UI
asterisk -rx “core reload” also the same
When I tried fwconsole restart it gives me an error “Asterisk is still running and we can’t stop it!”

The dashboard shows this error: “Reload failed because retrieve_conf encountered an error: 143”

I tried tail /var/log/httpd/error_log in another session to see if there is any apache error when trying to apply config, and there is nothing…

I am on FreePBX 13.0.192.19
All digium modules are disabled

Any idea what could be wrong?

Thank you

Have you attempted just a simple reboot of the system??

Some logs would def help us help you. Tail the full log and let’s see what your getting

Dear frankb, thank you for the swift reply.

Yes I tried to restart and it’s the same after a full reboot.

It’s crazy I’m getting nothing but

[2017-11-04 22:20:56] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:20:56] VERBOSE[18181] asterisk.c: Remote UNIX connection disconnected
[2017-11-04 22:20:56] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:20:56] VERBOSE[18310] asterisk.c: Remote UNIX connection disconnected
[2017-11-04 22:20:56] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:20:56] VERBOSE[18332] asterisk.c: Remote UNIX connection disconnected
[2017-11-04 22:20:56] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:20:56] VERBOSE[18353] asterisk.c: Remote UNIX connection disconnected
[2017-11-04 22:21:46] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:22:57] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:22:57] VERBOSE[6125] asterisk.c: Remote UNIX connection disconnected
[2017-11-04 22:22:57] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:22:57] VERBOSE[6265] asterisk.c: Remote UNIX connection disconnected
[2017-11-04 22:22:57] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:22:57] VERBOSE[6284] asterisk.c: Remote UNIX connection disconnected
[2017-11-04 22:22:57] VERBOSE[7147] asterisk.c: Remote UNIX connection
[2017-11-04 22:22:57] VERBOSE[6301] asterisk.c: Remote UNIX connection disconnected

“ps aux | grep asterisk” gives back:

root 1657 0.0 0.0 3040 1020 ? Ss 14:31 0:00 /bin/sh -e -c exec su -s /bin/bash -c ‘stdbuf -oL -eL /usr/local/bin/pnp_server’ asterisk 2>&1 | logger -t sangoma_pnp /bin/sh
root 1659 0.0 0.0 3084 968 ? S 14:31 0:00 su -s /bin/bash -c stdbuf -oL -eL /usr/local/bin/pnp_server asterisk
asterisk 1672 0.0 0.2 11408 2452 ? Ss 14:31 0:00 /usr/bin/python /usr/local/bin/pnp_server
asterisk 1767 0.0 3.8 96200 39780 ? S 14:31 0:04 /usr/sbin/httpd
asterisk 1768 0.0 1.4 71612 15388 ? S 14:31 0:00 /usr/sbin/httpd
asterisk 1769 0.0 7.2 136904 74352 ? S 14:31 0:13 /usr/sbin/httpd
asterisk 1770 0.0 4.6 104136 47632 ? S 14:31 0:10 /usr/sbin/httpd
asterisk 1771 0.0 7.0 136888 72996 ? S 14:31 0:10 /usr/sbin/httpd
asterisk 1772 0.0 4.6 104136 47636 ? S 14:31 0:08 /usr/sbin/httpd
asterisk 1773 0.0 5.5 119744 56932 ? S 14:31 0:09 /usr/sbin/httpd
asterisk 1774 0.0 4.1 97988 42964 ? S 14:31 0:06 /usr/sbin/httpd
root 2150 28.0 0.1 5116 1240 ? S 14:32 134:02 /bin/sh /var/lib/asterisk/bin/wakeup_surveyd
asterisk 5337 0.0 0.1 5116 1252 ? S 22:22 0:00 sh -c /var/lib/asterisk/bin/retrieve_conf 2>&1
asterisk 5343 0.5 6.2 107004 63924 ? S 22:22 0:02 php /var/lib/asterisk/bin/retrieve_conf
asterisk 6927 0.5 3.7 118180 38796 ? Sl 14:32 2:45 /usr/sbin/asterisk -f -U asterisk -G asterisk -vvvg -c
asterisk 12406 0.0 3.5 91832 36304 ? S 15:31 0:01 /usr/sbin/httpd
asterisk 12492 0.0 2.0 102672 21352 ? Ssl 14:32 0:04 PM2 v2.6.1: God Daemon (/home/asterisk/.pm2)
asterisk 17658 0.0 0.1 5116 1260 ? S 15:26 0:00 sh -c /var/lib/asterisk/bin/retrieve_conf 2>&1
asterisk 17664 0.0 6.2 107004 63920 ? S 15:26 0:02 php /var/lib/asterisk/bin/retrieve_conf
asterisk 19432 0.0 0.1 5116 1264 ? S 14:53 0:00 sh -c /var/lib/asterisk/bin/retrieve_conf 2>&1
asterisk 19438 0.0 6.4 109584 66512 ? S 14:53 0:02 php /var/lib/asterisk/bin/retrieve_conf
asterisk 20417 0.0 7.0 135880 72244 ? S 14:33 0:11 /usr/sbin/httpd
asterisk 21549 0.0 5.7 119740 59256 ? S 14:33 0:06 /usr/sbin/httpd
asterisk 21550 0.0 3.7 92868 39052 ? S 14:33 0:04 /usr/sbin/httpd
asterisk 24862 0.0 0.1 5060 1188 ? Ss 22:30 0:00 /bin/sh -c [ -x /var/www/html/admin/modules/dashboard/scheduler.php ] && /var/www/html/admin/modules/dashboard/scheduler.php > /dev/null 2>&1
asterisk 24866 3.6 1.8 62628 19252 ? S 22:30 0:00 php /var/www/html/admin/modules/dashboard/scheduler.php
root 29828 0.0 0.0 4360 756 pts/1 S+ 22:30 0:00 grep asterisk
asterisk 30238 0.0 0.1 5116 1264 ? S 22:19 0:00 sh -c /var/lib/asterisk/bin/retrieve_conf 2>&1
asterisk 30245 0.3 6.2 107004 63920 ? S 22:19 0:02 php /var/lib/asterisk/bin/retrieve_conf
asterisk 30500 0.0 1.2 67256 13104 ? S 22:21 0:00 /usr/sbin/httpd

Thank you again.

You know the info provided is really not leading us anywhere. There has to be something that has caused this. Did you update, run out of disk space, power outage. I mean something has caused your box to suddenly go south.

You have four copies like

asterisk 19432 0.0 0.1 5116 1264 ? S 14:53 0:00 sh -c /var/lib/asterisk/bin/retrieve_conf 2>&1

running , I would kill all those to “startover”

It was caused by an update and deleting an extension, anyway I tried all possibilities downgrading, restoring a backup, delaying asterisk service reload… all were in vain. I had to rebuild the system and restore a near backup…

Thank you, I tried your suggestion and I still weren’t able to reload, had to rebuild the system… Thank you again