Asterisk Core Dump

Getting regular Asterisk Core Dumps on new and clean (no configurations) of AsteriskNow 1.7.1 installation using Asterisk 1.6.2.19 and FreePBX 2.8.1. The problem happens when hitting the orange apply button in FreePBX. I’ve been able to reproduce this problem on three different machines with identical hardware and installation. Any idea of where to look for the problem?

The following are the FreePBX modules:

Core 2.8.1.0
DAHDi Config 2.8.0.1
Digium Addons 2.7.0
Feature Code Admin 2.8.0.1
FreePBX Framework 2.8.1.4
System Dashboard 2.8.0.3
Voicemail 2.8.0.0
Follow Me 2.8.0.4
IVR 2.8.0.5
Ring Groups 2.8.0.3
Time Conditions 2.8.0.3
Bulk Phone Restart 2.8.0.1
Info Services 2.8.0.0
Misc Destinations 2.8.0.0
Music on Hold 2.8.0.3
PIN Sets 2.8.0.5
Paging and Intercom 2.8.0.1
Recordings 3.3.10.3
Asterisk CLI 2.8.0.0
Asterisk Info 2.8.0.2
Backup & Restore 2.8.0.7
Custom Applications 2.8.0.1
Java SSH 2.8.0.1
Phonebook 2.8.0.1
Print Extensions 2.8.0.0

The core dump occurs when I hit the apply button. I haven’t even configured any extension or dialplan. I’ve just added the FreePBX modules. I’ve no loaded the following non necessary Asterisk modules:

chan_ooh323.so
chan_skinny.so
chan_h323.so
chan_mgcp.so
chan_gtalk.so
chan_misdn.so
chan_unistim.so
res_config_ldap.so
res_speech.so
res_smdi.so
app_speech_utils
chan_phone.so
app_amd.so
pbx_dundi.so
res_phoneprov.so
app_minivm.so
res_jabber.so
chan_jingle.so

Here’s the GBD output on the core dump
(gdb) bt
#0 0x007be453 in strlen () from /lib/libc.so.6
#1 0x08110dd9 in ast_add_extension2_lockopt ()
#2 0x08111f63 in ast_merge_contexts_and_delete ()
#3 0x00636711 in pbx_load_module () at pbx_config.c:1738
#4 0x080e4e1b in ast_module_reload ()
#5 0x080a4149 in handle_reload ()
#6 0x080a2b18 in ast_cli_command_full ()
#7 0x080f1912 in action_command ()
#8 0x080eebce in process_message ()
#9 0x080efef5 in do_message ()
#10 0x080f0177 in session_do ()
#11 0x0814b51f in handle_tcptls_connection ()
#12 0x08155f0b in dummy_start ()
#13 0x008e0832 in start_thread () from /lib/libpthread.so.0
#14 0x0082045e in clone () from /lib/libc.so.6
(gdb) thread apply all bt

Thread 31 (Thread 3539):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x0081100b in read () from /lib/libc.so.6
#2 0x08164ce1 in read_char ()
#3 0x0815fd45 in ?? ()
#4 0x095bfe50 in ?? ()
#5 0xbfd4f85b in ?? ()
#6 0x00000005 in ?? ()
#7 0xbfd51924 in ?? ()
#8 0x095bfe50 in ?? ()
#9 0x00000000 in ?? ()

Thread 30 (Thread 3543):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x0814a99c in tps_processing_function ()
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 29 (Thread 3544):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x00816753 in poll () from /lib/libc.so.6
#2 0x08076061 in listener ()
#3 0x08155f0b in dummy_start ()
#4 0x008e0832 in start_thread () from /lib/libpthread.so.0
#5 0x0082045e in clone () from /lib/libc.so.6

Thread 28 (Thread 3545):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x0081108b in write () from /lib/libc.so.6
#2 0x007b0e34 in _IO_new_file_write () from /lib/libc.so.6
#3 0x007b0af5 in new_do_write () from /lib/libc.so.6
#4 0x007b0ddf in _IO_new_do_write () from /lib/libc.so.6
#5 0x007b16ce in _IO_new_file_overflow () from /lib/libc.so.6
#6 0x007b0ccc in _IO_new_file_xsputn () from /lib/libc.so.6
#7 0x007a6b4a in fputs () from /lib/libc.so.6
#8 0x080774fb in console_verboser ()
#9 0x080ea5f5 in logger_thread ()
#10 0x08155f0b in dummy_start ()
#11 0x008e0832 in start_thread () from /lib/libpthread.so.0
#12 0x0082045e in clone () from /lib/libc.so.6

Thread 27 (Thread 3546):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x0081100b in read () from /lib/libc.so.6
#2 0x081463f9 in inotify_daemon ()
—Type to continue, or q to quit—
#3 0x08155f0b in dummy_start ()
#4 0x008e0832 in start_thread () from /lib/libpthread.so.0
#5 0x0082045e in clone () from /lib/libc.so.6

Thread 26 (Thread 3547):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x00816753 in poll () from /lib/libc.so.6
#2 0x08155ea3 in ast_wait_for_input ()
#3 0x0814ba51 in ast_tcptls_server_root ()
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 25 (Thread 3548):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x080b1c1c in do_devstate_changes ()
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 24 (Thread 3549):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x0814a99c in tps_processing_function ()
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 23 (Thread 3550):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x00816753 in poll () from /lib/libc.so.6
#2 0x080d0347 in do_parking_thread ()
#3 0x08155f0b in dummy_start ()
#4 0x008e0832 in start_thread () from /lib/libpthread.so.0
#5 0x0082045e in clone () from /lib/libc.so.6

Thread 22 (Thread 3553):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x00564516 in do_timing (arg=0x0) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 21 (Thread 3554):
—Type to continue, or q to quit—
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x0814a99c in tps_processing_function ()
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 20 (Thread 3555):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x0814a99c in tps_processing_function ()
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 19 (Thread 3556):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x007dfd26 in nanosleep () from /lib/libc.so.6
#2 0x00696396 in scan_thread (unused=0x0) at pbx_spool.c:452
#3 0x08155f0b in dummy_start ()
#4 0x008e0832 in start_thread () from /lib/libpthread.so.0
#5 0x0082045e in clone () from /lib/libc.so.6

Thread 18 (Thread 3557):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x007dfd26 in nanosleep () from /lib/libc.so.6
#2 0x00682528 in lock_broker (unused=0x0) at func_lock.c:192
#3 0x08155f0b in dummy_start ()
#4 0x008e0832 in start_thread () from /lib/libpthread.so.0
#5 0x0082045e in clone () from /lib/libc.so.6

Thread 17 (Thread 3560):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x081445ab in sched_run ()
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 16 (Thread 3561):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb774fd18) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb774fd18) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
—Type to continue, or q to quit—
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 15 (Thread 3562):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb7750e68) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb7750e68) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 14 (Thread 3563):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb7751fb8) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb7751fb8) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 13 (Thread 3564):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb7753108) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb7753108) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 12 (Thread 3565):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb7754258) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb7754258) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 11 (Thread 3566):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb77553a8) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb77553a8) at chan_iax2.c:11255
—Type to continue, or q to quit—
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 10 (Thread 3567):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb77564f8) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb77564f8) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 9 (Thread 3568):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb7757648) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb7757648) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 8 (Thread 3569):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb7758798) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb7758798) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 7 (Thread 3570):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x008e4bc5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#2 0x0082cb2d in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libc.so.6
#3 0x075bc6f3 in ast_cond_wait (data=0xb77598e8) at /usr/src/redhat/BUILD/asterisk16-1.6.2.19/include/asterisk/lock.h:1778
#4 iax2_process_thread (data=0xb77598e8) at chan_iax2.c:11255
#5 0x08155f0b in dummy_start ()
#6 0x008e0832 in start_thread () from /lib/libpthread.so.0
#7 0x0082045e in clone () from /lib/libc.so.6

Thread 6 (Thread 3571):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x00816753 in poll () from /lib/libc.so.6
#2 0x080e3814 in ast_io_wait ()
#3 0x0758f7c0 in network_thread (ignore=0x0) at chan_iax2.c:11754
—Type to continue, or q to quit—
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 5 (Thread 3572):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x00816753 in poll () from /lib/libc.so.6
#2 0x00ce82c1 in do_monitor (data=0x0) at chan_dahdi.c:10053
#3 0x08155f0b in dummy_start ()
#4 0x008e0832 in start_thread () from /lib/libpthread.so.0
#5 0x0082045e in clone () from /lib/libc.so.6

Thread 4 (Thread 3573):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x00816753 in poll () from /lib/libc.so.6
#2 0x080e3814 in ast_io_wait ()
#3 0x004ec91e in do_monitor (data=0x0) at chan_sip.c:23278
#4 0x08155f0b in dummy_start ()
#5 0x008e0832 in start_thread () from /lib/libpthread.so.0
#6 0x0082045e in clone () from /lib/libc.so.6

Thread 3 (Thread 3575):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x00816753 in poll () from /lib/libc.so.6
#2 0x08073a4e in monitor_sig_flags ()
#3 0x08155f0b in dummy_start ()
#4 0x008e0832 in start_thread () from /lib/libpthread.so.0
#5 0x0082045e in clone () from /lib/libc.so.6

Thread 2 (Thread 3594):
#0 0x00c8a410 in __kernel_vsyscall ()
#1 0x00816753 in poll () from /lib/libc.so.6
#2 0x08155ea3 in ast_wait_for_input ()
#3 0x080efbd6 in do_message ()
#4 0x080f0177 in session_do ()
#5 0x0814b51f in handle_tcptls_connection ()
#6 0x08155f0b in dummy_start ()
#7 0x008e0832 in start_thread () from /lib/libpthread.so.0
#8 0x0082045e in clone () from /lib/libc.so.6

Thread 1 (Thread 5294):
#0 0x007be453 in strlen () from /lib/libc.so.6
#1 0x08110dd9 in ast_add_extension2_lockopt ()
#2 0x08111f63 in ast_merge_contexts_and_delete ()
#3 0x00636711 in pbx_load_module () at pbx_config.c:1738
#4 0x080e4e1b in ast_module_reload ()
#5 0x080a4149 in handle_reload ()
#6 0x080a2b18 in ast_cli_command_full ()
#7 0x080f1912 in action_command ()
—Type to continue, or q to quit—
#8 0x080eebce in process_message ()
#9 0x080efef5 in do_message ()
#10 0x080f0177 in session_do ()
#11 0x0814b51f in handle_tcptls_connection ()
#12 0x08155f0b in dummy_start ()
#13 0x008e0832 in start_thread () from /lib/libpthread.so.0
#14 0x0082045e in clone () from /lib/libc.so.6

It is reported in a ticket at Asterisk bug tracker: https://issues.asterisk.org/jira/browse/ASTERISK-18103

Unfortunately it was closed due to “not in maintenance”.
I suggest that you post your backtrace to the ticket (if it is possible in a closed ticket.)

UPDATE:
I have added your backtrace to the ticket.

Does FreePBX 2.8.1 properly support Asterisk 1.8 at this point or should I upgrade the Framework to 2.9 in order to do so?

thanks,
Paolo

Can anybody answer if FreePBX framework 2.8.1 supports Asterisk 1.8 or do I need to upgrade to FreePBX framework 2.9?

thanks,
Paolo