Asterisk crashing on boot

I came back from vacation and went through my normal update process (yum update and module update) and now I am unable to start asterisk. I’m running FreePBX 13.0.1beta3.15.

After a fresh reboot if I do /etc/init.d/asterisk status it shows asterisk is not running. If I use fwconsole start to bring it up I get the process terminating.

99%*** stack smashing detected ***: /usr/sbin/asterisk terminated
======= Backtrace: =========
/lib64/libc.so.6(__fortify_fail+0x37)[0x7f866f467527]
/lib64/libc.so.6(__fortify_fail+0x0)[0x7f866f4674f0]
/usr/lib64/asterisk/modules/res_pjsip.so(+0x148c8)[0x7f862da748c8]
======= Memory map: ========
00400000-006aa000 r-xp 00000000 08:02 19008765                           /usr/sbin/asterisk
008aa000-008bd000 rw-p 002aa000 08:02 19008765                           /usr/sbin/asterisk
008bd000-008e3000 rw-p 00000000 00:00 0
00c54000-01d98000 rw-p 00000000 00:00 0                                  [heap]
7f86218bf000-7f86218c4000 r-xp 00000000 08:02 3670044                    /lib64/libnss_dns-2.12.so
7f86218c4000-7f8621ac3000 ---p 00005000 08:02 3670044                    /lib64/libnss_dns-2.12.so
7f8621ac3000-7f8621ac4000 r--p 00004000 08:02 3670044                    /lib64/libnss_dns-2.12.so
7f8621ac4000-7f8621ac5000 rw-p 00005000 08:02 3670044                    /lib64/libnss_dns-2.12.so
7f8621acf000-7f8621ad0000 rw-p 00000000 00:00 0
7f8621ad0000-7f8621ad1000 ---p 00000000 00:00 0
7f8621ad1000-7f8621b4c000 rwxp 00000000 00:00 0
7f8621b4c000-7f8621b4d000 ---p 00000000 00:00 0
7f8621b4d000-7f8621bc8000 rwxp 00000000 00:00 0
7f8621bc8000-7f8621bc9000 ---p 00000000 00:00 0
7f8621bc9000-7f8621c44000 rwxp 00000000 00:00 0
7f8621c44000-7f8621c45000 ---p 00000000 00:00 0
7f8621c45000-7f8621cc0000 rwxp 00000000 00:00 0
7f8621cc0000-7f8627b51000 r--p 00000000 08:02 19010887                   /usr/lib/locale/locale-archive
7f8627b51000-7f8627b52000 ---p 00000000 00:00 0
7f8627b52000-7f8628552000 rwxp 00000000 00:00 0
7f8628552000-7f8628562000 r-xp 00000000 08:02 19006753                   /usr/lib64/libodbcinst.so.2.0.0
7f8628562000-7f8628762000 ---p 00010000 08:02 19006753                   /usr/lib64/libodbcinst.so.2.0.0
7f8628762000-7f8628763000 rw-p 00010000 08:02 19006753                   /usr/lib64/libodbcinst.so.2.0.0
7f8628763000-7f8628779000 r-xp 00000000 08:02 3670916                    /lib64/libnsl-2.12.so
7f8628779000-7f8628978000 ---p 00016000 08:02 3670916                    /lib64/libnsl-2.12.so
7f8628978000-7f8628979000 r--p 00015000 08:02 3670916                    /lib64/libnsl-2.12.so
7f8628979000-7f862897a000 rw-p 00016000 08:02 3670916                    /lib64/libnsl-2.12.so
7f862897a000-7f862897c000 rw-p 00000000 00:00 0
7f862897c000-7f8628ab5000 r-xp 00000000 08:02 131196                     /usr/lib64/mysql/libmysqlclient_r.so.16.0.0
7f8628ab5000-7f8628cb4000 ---p 00139000 08:02 131196                     /usr/lib64/mysql/libmysqlclient_r.so.16.0.0
7f8628cb4000-7f8628d01000 rw-p 00138000 08:02 131196                     /usr/lib64/mysql/libmysqlclient_r.so.16.0.0
7f8628d01000-7f8628d03000 rw-p 00000000 00:00 0
7f8628d03000-7f8628d3a000 r-xp 00000000 08:02 19010732                   /usr/lib64/libmyodbc5-5.1.5.so
7f8628d3a000-7f8628f3a000 ---p 00037000 08:02 19010732                   /usr/lib64/libmyodbc5-5.1.5.so
7f8628f3a000-7f8628f48000 rw-p 00037000 08:02 19010732                   /usr/lib64/libmyodbc5-5.1.5.so
7f8628f48000-7f8628f49000 r-xp 00000000 08:02 19006185                   /usr/lib64/gconv/ISO8859-1.so
7f8628f49000-7f8629149000 ---p 00001000 08:02 19006185                   /usr/lib64/gconv/ISO8859-1.so
7f8629149000-7f862914a000 r--p 00001000 08:02 19006185                   /usr/lib64/gconv/ISO8859-1.so
7f862914a000-7f862914b000 rw-p 00002000 08:02 19006185                   /usr/lib64/gconv/ISO8859-1.so
7f862914b000-7f862915b000 r-xp 00000000 08:02 267071                     /usr/lib64/asterisk/modules/res_pjsip_pubsub.so
7f862915b000-7f862935b000 ---p 00010000 08:02 267071                     /usr/lib64/asterisk/modules/res_pjsip_pubsub.so
7f862935b000-7f862935c000 rw-p 00010000 08:02 267071                     /usr/lib64/asterisk/modules/res_pjsip_pubsub.so
7f862935c000-7f862935e000 r-xp 00000000 08:02 267096                     /usr/lib64/asterisk/modules/res_stasis_answer.so
7f862935e000-7f862955d000 ---p 00002000 08:02 267096                     /usr/lib64/asterisk/modules/res_stasis_answer.so
7f862955d000-7f862955e000 rw-p 00001000 08:02 267096                     /usr/lib64/asterisk/modules/res_stasis_answer.so
7f862955e000-7f862956b000 r-xp 00000000 08:02 267078                     /usr/lib64/asterisk/modules/res_pjsip_session.so
7f862956b000-7f862976a000 ---p 0000d000 08:02 267078                     /usr/lib64/asterisk/modules/res_pjsip_session.so
7f862976a000-7f862976b000 rw-p 0000c000 08:02 267078                     /usr/lib64/asterisk/modules/res_pjsip_session.so
7f862976b000-7f8629785000 r-xp 00000000 08:02 267095                     /usr/lib64/asterisk/modules/res_stasis.so
7f8629785000-7f8629985000 ---p 0001a000 08:02 267095                     /usr/lib64/asterisk/modules/res_stasis.so
7f8629985000-7f8629986000 rw-p 0001a000 08:02 267095                     /usr/lib64/asterisk/modules/res_stasis.so
7f8629986000-7f86299b1000 r-xp 00000000 08:02 19006404                   /usr/lib64/liblua-5.1.so
7f86299b1000-7f8629bb1000 ---p 0002b000 08:02 19006404                   /usr/lib64/liblua-5.1.so
7f8629bb1000-7f8629bb3000 rw-p 0002b000 08:02 19006404                   /usr/lib64/liblua-5.1.so
7f8629bb3000-7f8629bbb000 r-xp 00000000 08:02 266999                     /usr/lib64/asterisk/modules/pbx_lua.so
7f8629bbb000-7f8629dba000 ---p 00008000 08:02 266999                     /usr/lib64/asterisk/modules/pbx_lua.so
7f8629dba000-7f8629dbb000 rw-p 00007000 08:02 266999                     /usr/lib64/asterisk/modules/pbx_lua.so
7f8629dbb000-7f8629dbd000 r-xp 00000000 08:02 267054                     /usr/lib64/asterisk/modules/res_pjsip_log_forwarder.so
7f8629dbd000-7f8629fbc000 ---p 00002000 08:02 267054                     /usr/lib64/asterisk/modules/res_pjsip_log_forwarder.so
7f8629fbc000-7f8629fbd000 rw-p 00001000 08:02 267054                     /usr/lib64/asterisk/modules/res_pjsip_log_forwarder.so
7f8629fbd000-7f8629fc0000 r-xp 00000000 08:02 267089                     /usr/lib64/asterisk/modules/res_sorcery_astdb.so
7f8629fc0000-7f862a1c0000 ---p 00003000 08:02 267089                     /usr/lib64/asterisk/modules/res_sorcery_astdb.so
7f862a1c0000-7f862a1c1000 rw-p 00003000 08:02 267089                     /usr/lib64/asterisk/modules/res_sorcery_astdb.so
7f862a1c1000-7f862a1ce000 r-xp 00000000 08:02 267005                     /usr/lib64/asterisk/modules/res_ari.so
7f862a1ce000-7f862a3cd000 ---p 0000d000 08:02 267005                     /usr/lib64/asterisk/modules/res_ari.so
7f862a3cd000-7f862a3cf000 rw-p 0000c000 08:02 267005                     /usr/lib64/asterisk/modules/res_ari.so
7f862a3cf000-7f862a3d2000 r-xp 00000000 08:02 267101

Any ideas?

1 Like

Can you please follow the steps over at wiki.asterisk.org on getting a backtrace and then share that here so we can see if we need to get a ticket open with Digium or if the issue is on our end.

I ran /usr/sbin/asterisk -vvvvvg -c and generated the core file and followed the instructions.

https://dl.dropboxusercontent.com/u/7981096/backtrace.txt

Hopefully that tells you more than what it tells me.
(Also thank you)

Can you run yum install asterisk13-debuginfo and generate the backtrace one more time please.

Also please open an ticket on issues.freepbx.org as we are gonna need some additional information but we will want to lock down the ticket prior to obtaining the information. By locking the ticket we will be making the ticket private and only viewable by yourself and our team.

Thanks for your help - I installed that, rebooted, and followed the instructions again.

I opened the ticket, FREEPBX-9637, and uploaded the backtrace2 there. I’ll watch that thread for updates.

This should be resolved in the new Asterisk 13 RPMs. Please look for rpms ending with 13.4.0-1.shmz65.1.71.[arch].rpm.

I had to delete a ton of core temp files but after I did that, updated, rebooted and all is right in the world again.

Thank you for your help

@Rosewood Thank you for reporting the issue and providing everything you did to help us track down the problem, it was much appreciated.

1 Like