Asterisk Crash - how to debug?

[PitzKey (Itzik)]

Hi guys,

FreePBX 14 Asterisk 13.22.0

The GUI shows System Last Rebooted:
2 months, 3 weeks, 16 hours, 44 minutes, 31 seconds, ago

[root@freepbx ~]# asterisk -rx"core show uptime"
System uptime: 1 hour, 12 minutes, 41 seconds
Last reload: 1 hour, 12 minutes, 41 seconds

I see in /var/log/asterisk/full

[2019-09-03 09:10:09] Asterisk 13.22.0 built by mockbuild @ jenkins7 on a x86_64 running Linux on 2018-07-25 22:30:39 UTC
[2019-09-03 09:10:12] VERBOSE[40768] asterisk.c: Asterisk Ready.

I see in /var/log/asterisk/freepbx.log

[2019-Sep-03 09:10:10] [INFO] (functions.inc/callback-daemon.php:3) - Queue callback daemon started

But when running

[root@freepbx ~]# fwconsole pm2 --list
+--------------+-------+--------+----------+-------------------+-----+---------+
| Process Name | PID   | Status | Restarts | Uptime            | CPU | Mem     |
+--------------+-------+--------+----------+-------------------+-----+---------+
| ucp          | 40798 | online | 1144     | 2 months, 21 days | 0%  | 63.61MB |
| qcallback    | 40845 | online | 124      | 2 months, 21 days | 0%  | 33.64MB |

So seems like Asterisk was restarted and from the log it seems like Queue callback daemon also stopped, but from pm2 it does not seem so.

ls -l /tmp | grep core.

Does not return anything.

What else can I look for to find what caused Asterisk to be restarted?

Thank you

[dicko]

Look in /var/log/messages for any kernel mrssages at that time

[PitzKey (Itzik)]

Spot on.

I don’t understand kernel errors much, but it looks to me like it was out of memory.

Can you please take a look? https://pastebin.freepbx.org/view/raw/25d575eb

[dicko]

Yep, oom= “Out of Memory”