Updated to 10.13.66-14 from 10.13.66-13 - Now getting a segmentation fault

I tried both.

Well 3, I tried your original post without the ldconfig and the yum remove(s) at the end.

Then I tried just ldconfig.

And finally your edited post.

And you get the same issue?

Ok run: asterisk-version-switch

Select Asterisk 13

Running asterisk-version-switch and selecting Asterisk 13 fixed the issue.

Thanks for your prompt assistance!

I’ve edited the top post asking people to comment here, hopefully so we can know why this is happening. The asterisk-version-switch command removes and reinstalls all the asterisk RPMS - and it should be exactly the same thing as doing an upgrade.

So, if anyone else is having this problem, PLEASE comment on this post with the output of the command rpm -qa | egrep 'aster|pjpro' before you fix it. If you have time, it would be even better if you could ping either @tm1000 or myself (I’m ‘X-Rob’ in IRC) while your machine is broken so we can figure out what’s going on EXACTLY.

The output will look like this, and to make it look ‘nice’ in the forums, put it underneath three backticks (on a normal us-english keyboard, this is the button immediately to the left of the 1 key)

[root@ipv6 firewall]# rpm -qa | egrep 'aster|pjpro'
asterisk13-core-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-bluetooth-13.10.0-1.shmz65.1.125.x86_64
asterisk13-13.10.0-1.shmz65.1.125.x86_64
asterisk13-odbc-13.10.0-1.shmz65.1.125.x86_64
asterisk-version-switch-3.0.0.0-1.shmz65.1.20.noarch
asterisk-sounds-core-en-alaw-1.4.25-94_centos5.noarch
asterisk-sounds-extra-en-gsm-1.4.14-100_centos5.noarch
asterisk-sounds-core-en-gsm-1.4.25-94_centos5.noarch
asterisk13-addons-core-13.10.0-1.shmz65.1.125.x86_64
pjproject-2.4-9.shmz65.8.13.x86_64
asterisk13-flite-debuginfo-13.10.0-1.shmz65.1.37.x86_64
asterisk13-voicemail-13.10.0-1.shmz65.1.125.x86_64
asterisk13-doc-13.10.0-1.shmz65.1.125.x86_64
asterisk13-dahdi-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-13.10.0-1.shmz65.1.125.x86_64
asterisk13-curl-13.10.0-1.shmz65.1.125.x86_64
asterisk13-debuginfo-13.10.0-1.shmz65.1.125.x86_64
pjproject-debuginfo-2.4-9.shmz65.8.13.x86_64
asterisk-sounds-extra-en-ulaw-1.4.14-100_centos5.noarch
asterisk-sounds-core-en-ulaw-1.4.25-94_centos5.noarch
asterisk13-flite-13.10.0-1.shmz65.1.37.x86_64
asterisk13-addons-mysql-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-ooh323-13.10.0-1.shmz65.1.125.x86_64
asterisk13-resample-13.10.0-1.shmz65.1.125.x86_64
pjproject-devel-2.4-9.shmz65.8.13.x86_64
asterisk-sounds-extra-en-alaw-1.4.14-100_centos5.noarch
[root@ipv6 firewall]#

So for you to paste yours, you would enter this:

```
[root@you ~]# rpm -qa | egrep 'aster|pjpro’
asterisk13-core-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-bluetooth-13.10.0-1.shmz65.1.125.x86_64

[root@you ~]#
```

We have also just seen this. Asterisk is down after a reboot with lots of segfaults. Starting asterisk gives continuous errors:

ERROR[4923]: res_pjsip.c:3464 endpt_send_request: Error 171060 ‘Unsupported transport (PJSIP_EUNSUPTRANSPORT)’ sending OPTIONS request to endpoint 1078

From messages:
/var/log/messages:Jul 26 19:08:28 pbx kernel: asterisk[4883]: segfault at 30 ip 00007f9bfafc0039 sp 00007f9b85beda20 error 4 in libasteriskpj.so.2[7f9bfaf45000+17e000]

Did you read this thread? Plese read this thread first. It details what debug to provide and how to help us. Just posting you have an error helps no one.

I missed the section on please log this, sorry. I ran asterisk-version-switch and it is back running

You skipped the part on us asking for debug.

I have another system where I ran the upgrade scripts from the console. Somewhat different issue, The VoiceMail and VoiceMailMail are missing. In a pinch yesterday I loaded the voicemail odbc module and at least voicemail is working when a call times out but users cannot log into their voicemail.

This may be related as there seems to be a module mismatch. Would you like the debug from that system?

[root@bea-pbx02 ~]# rpm -qa | egrep 'aster|pjpro’
asterisk13-core-13.10.0-1.shmz65.1.117.x86_64
asterisk13-addons-ooh323-13.10.0-1.shmz65.1.117.x86_64
asterisk13-13.10.0-1.shmz65.1.117.x86_64
asterisk13-resample-13.10.0-1.shmz65.1.117.x86_64
pjproject-2.4-9.shmz65.8.13.x86_64
asterisk-sounds-extra-en-alaw-1.4.14-100_centos5.noarch
asterisk-sounds-extra-en-ulaw-1.4.14-100_centos5.noarch
asterisk-sounds-core-en-ulaw-1.4.25-94_centos5.noarch
asterisk13-addons-core-13.10.0-1.shmz65.1.117.x86_64
asterisk13-dahdi-13.10.0-1.shmz65.1.117.x86_64
asterisk13-doc-13.10.0-1.shmz65.1.117.x86_64
asterisk13-voicemail-13.10.0-1.shmz65.1.117.x86_64
asterisk13-flite-13.10.0-1.shmz65.1.37.x86_64
asterisk13-curl-13.10.0-1.shmz65.1.117.x86_64
asterisk13-odbc-13.10.0-1.shmz65.1.117.x86_64
asterisk13-res_digium_phone-2.1.1-1.shmz65.1.29.x86_64
asterisk13-flite-debuginfo-13.10.0-1.shmz65.1.37.x86_64
asterisk-sounds-core-en-gsm-1.4.25-94_centos5.noarch
asterisk-version-switch-3.0.0.0-1.shmz65.1.20.noarch
asterisk-sounds-core-en-alaw-1.4.25-94_centos5.noarch
asterisk-sounds-extra-en-gsm-1.4.14-100_centos5.noarch
asterisk13-addons-mysql-13.10.0-1.shmz65.1.117.x86_64
asterisk13-addons-bluetooth-13.10.0-1.shmz65.1.117.x86_64
asterisk13-addons-13.10.0-1.shmz65.1.117.x86_64

This was only the .13 script. Running the .14 now

This was already fixed over the weekend for voicemail. You should unload odbc. You’ll make it worse.

Ok, So I just reproduced the problem running the .14 script.

What do you need? I have about an hour before this needs to be back online.

[root@bea-pbx02 ~]# grep “segfault” /var/log/messages
Jul 26 23:25:24 bea-pbx02 kernel: asterisk[43587]: segfault at 30 ip 00007f5b75944039 sp 00007f5b0830aa20 error 4 in libasteriskpj.so.2[7f5b758c9000+17e000]
Jul 26 23:25:30 bea-pbx02 kernel: asterisk[43856]: segfault at 30 ip 00007fa3c8987039 sp 00007fa34f3faa20 error 4 in libasteriskpj.so.2[7fa3c890c000+17e000]
Jul 26 23:25:37 bea-pbx02 kernel: asterisk[43982]: segfault at 30 ip 00007fefb1672039 sp 00007fef3c17ca20 error 4 in libasteriskpj.so.2[7fefb15f7000+17e000]
Jul 26 23:25:44 bea-pbx02 kernel: asterisk[44322]: segfault at 30 ip 00007f5128326039 sp 00007f50aedcfa20 error 4 in libasteriskpj.so.2[7f51282ab000+17e000]
Jul 26 23:25:51 bea-pbx02 kernel: asterisk[44413]: segfault at 30 ip 00007f8af078d039 sp 00007f8a77299a20 error 4 in libasteriskpj.so.2[7f8af0712000+17e000]
Jul 26 23:25:57 bea-pbx02 kernel: asterisk[44505]: segfault at 30 ip 00007f3450518039 sp 00007f33d7095a20 error 4 in libasteriskpj.so.2[7f345049d000+17e000]
Jul 26 23:26:03 bea-pbx02 kernel: asterisk[44664]: segfault at 30 ip 00007fefb7d55039 sp 00007fef3e852a20 error 4 in libasteriskpj.so.2[7fefb7cda000+17e000]
Jul 26 23:26:12 bea-pbx02 kernel: asterisk[44855]: segfault at 30 ip 00007f2ad5ae7039 sp 00007f2a5c5fba20 error 4 in libasteriskpj.so.2[7f2ad5a6c000+17e000]
Jul 26 23:27:39 bea-pbx02 kernel: asterisk[1867]: segfault at 30 ip 00007f993864b039 sp 00007f98bafe8a20 error 4 in libasteriskpj.so.2[7f99385d0000+17e000]
Jul 26 23:27:46 bea-pbx02 kernel: asterisk[2867]: segfault at 30 ip 00007f33837a1039 sp 00007f33061e4a20 error 4 in libasteriskpj.so.2[7f3383726000+17e000]
Jul 26 23:27:52 bea-pbx02 kernel: asterisk[2959]: segfault at 30 ip 00007fb6fe227039 sp 00007fb684ccea20 error 4 in libasteriskpj.so.2[7fb6fe1ac000+17e000]
Jul 26 23:27:58 bea-pbx02 kernel: asterisk[3063]: segfault at 30 ip 00007fda9db9f039 sp 00007fda78515a20 error 4 in libasteriskpj.so.2[7fda9db24000+17e000]
Jul 26 23:28:04 bea-pbx02 kernel: asterisk[3186]: segfault at 30 ip 00007fd518dd6039 sp 00007fd49b7d1a20 error 4 in libasteriskpj.so.2[7fd518d5b000+17e000]
Jul 26 23:28:12 bea-pbx02 kernel: asterisk[3278]: segfault at 30 ip 00007f31b3381039 sp 00007f3135eaaa20 error 4 in libasteriskpj.so.2[7f31b3306000+17e000]

[root@bea-pbx02 ~]# rpm -qa | egrep 'aster|pjpro’
asterisk13-core-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-bluetooth-13.10.0-1.shmz65.1.125.x86_64
asterisk13-13.10.0-1.shmz65.1.125.x86_64
asterisk13-odbc-13.10.0-1.shmz65.1.125.x86_64
pjproject-2.4-9.shmz65.8.13.x86_64
asterisk-sounds-extra-en-alaw-1.4.14-100_centos5.noarch
asterisk-sounds-extra-en-ulaw-1.4.14-100_centos5.noarch
asterisk-sounds-core-en-ulaw-1.4.25-94_centos5.noarch
asterisk13-flite-13.10.0-1.shmz65.1.37.x86_64
asterisk13-res_digium_phone-2.1.1-1.shmz65.1.29.x86_64
asterisk13-flite-debuginfo-13.10.0-1.shmz65.1.37.x86_64
asterisk13-addons-core-13.10.0-1.shmz65.1.125.x86_64
asterisk13-voicemail-13.10.0-1.shmz65.1.125.x86_64
asterisk13-doc-13.10.0-1.shmz65.1.125.x86_64
asterisk13-dahdi-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-13.10.0-1.shmz65.1.125.x86_64
asterisk13-curl-13.10.0-1.shmz65.1.125.x86_64
asterisk-version-switch-3.0.0.2-1.shmz65.1.27.noarch
asterisk-sounds-core-en-gsm-1.4.25-94_centos5.noarch
asterisk-sounds-core-en-alaw-1.4.25-94_centos5.noarch
asterisk-sounds-extra-en-gsm-1.4.14-100_centos5.noarch
asterisk13-addons-mysql-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-ooh323-13.10.0-1.shmz65.1.125.x86_64
asterisk13-resample-13.10.0-1.shmz65.1.125.x86_64

I am lost. You reproduced this where? On a system you already had fixed? Or a system that was already broken?

I reproduced this on a system that was still running .13. I ran the .14 scripts and BAM, dead.

I’m also having this exact issue on a machine that is running 10.13.66-8. I ran a slew of updates on it, rebooted it, and now it’s getting these same segfaults.

Jul 26 19:50:36 xxxxxxxxxx kernel: asterisk[37673]: segfault at 30 ip 00007fe06cd14039 sp 00007fe039854a20 error 4 in libasteriskpj.so.2[7fe06cc99000+17e000]

From the (broken) backup system:

[root@pbxbackup ~]# rpm -qa | egrep 'aster|pjpro'
asterisk-sounds-extra-en-ulaw-1.4.14-100_centos5.noarch
asterisk13-addons-mysql-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-ooh323-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-13.10.0-1.shmz65.1.125.x86_64
asterisk-version-switch-3.0.0.2-1.shmz65.1.27.noarch
pjproject-2.4-9.shmz65.8.13.x86_64
asterisk-sounds-extra-en-gsm-1.4.14-100_centos5.noarch
asterisk-sounds-core-en-alaw-1.4.25-94_centos5.noarch
asterisk13-addons-core-13.10.0-1.shmz65.1.125.x86_64
asterisk13-voicemail-13.10.0-1.shmz65.1.125.x86_64
asterisk13-doc-13.10.0-1.shmz65.1.125.x86_64
asterisk13-dahdi-13.10.0-1.shmz65.1.125.x86_64
asterisk13-flite-13.10.0-1.shmz65.1.37.x86_64
asterisk13-resample-13.10.0-1.shmz65.1.125.x86_64
asterisk13-odbc-13.10.0-1.shmz65.1.125.x86_64
asterisk13-res_digium_phone-2.1.1-1.shmz65.1.29.x86_64
asterisk-sounds-extra-en-alaw-1.4.14-100_centos5.noarch
asterisk-sounds-core-en-ulaw-1.4.25-94_centos5.noarch
asterisk-sounds-core-en-gsm-1.4.25-94_centos5.noarch
asterisk13-core-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-bluetooth-13.10.0-1.shmz65.1.125.x86_64
asterisk13-13.10.0-1.shmz65.1.125.x86_64
asterisk13-curl-13.10.0-1.shmz65.1.125.x86_64
asterisk13-flite-debuginfo-13.10.0-1.shmz65.1.37.x86_64

This is a non-production system, but I have a production system which is configured in parallel, and still running 10.13.66-13. As of now, it is running fine, and I’ve no plans to update it tonight. The same command returns:

[root@pbxprimary ~]# rpm -qa | egrep 'aster|pjpro'
asterisk-sounds-extra-en-ulaw-1.4.14-100_centos5.noarch
asterisk13-addons-bluetooth-13.10.0-1.shmz65.1.125.x86_64
asterisk13-curl-13.10.0-1.shmz65.1.125.x86_64
asterisk-sounds-extra-en-alaw-1.4.14-100_centos5.noarch
asterisk-sounds-extra-en-gsm-1.4.14-100_centos5.noarch
pjproject-2.4-9.shmz65.8.13.x86_64
asterisk13-dahdi-13.10.0-1.shmz65.1.125.x86_64
asterisk13-flite-debuginfo-13.10.0-1.shmz65.1.37.x86_64
asterisk-sounds-core-en-alaw-1.4.25-94_centos5.noarch
asterisk-sounds-core-en-ulaw-1.4.25-94_centos5.noarch
asterisk13-addons-mysql-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-ooh323-13.10.0-1.shmz65.1.125.x86_64
asterisk13-addons-13.10.0-1.shmz65.1.125.x86_64
asterisk-version-switch-3.0.0.2-1.shmz65.1.27.noarch
pjproject-devel-2.4-9.shmz65.8.13.x86_64
asterisk13-addons-core-13.10.0-1.shmz65.1.125.x86_64
asterisk13-doc-13.10.0-1.shmz65.1.125.x86_64
asterisk13-flite-13.10.0-1.shmz65.1.37.x86_64
asterisk13-odbc-13.10.0-1.shmz65.1.125.x86_64
pjproject-debuginfo-2.4-9.shmz65.8.13.x86_64
asterisk-sounds-core-en-gsm-1.4.25-94_centos5.noarch
asterisk13-core-13.10.0-1.shmz65.1.125.x86_64
asterisk13-13.10.0-1.shmz65.1.125.x86_64
asterisk13-voicemail-13.10.0-1.shmz65.1.125.x86_64
asterisk13-resample-13.10.0-1.shmz65.1.125.x86_64

I’m running the update on the backup system to 10.13.66-14. At this point, it can’t really hurt. Is there anything I can provide that might help to figure out what the issue is?

We are working remote with someone else on this but you can just do the solution on this thread to get moving.

You already have .125 on your production machine so you appear to be fine.

The problem is the asterisk13-res_digium_phone-2.1.1-1.shmz65.1.29.x86_64 module - in the interim, if you remove that module, everything is fine.

Yep.

yum remove asterisk13-res_digium_phone

Restarted, and everything is fine. That package is not installed at all on the production system, nor do we currently have any Digium phones, so there’s no need to re-add it for me.

Thanks for the prompt help!

2 Likes

just FYI from Asterisk

https://issues.asterisk.org/jira/browse/ASTERISK-26242

1 Like