Have been running FreePBX for almost a year now and it has been running perfectly until a couple weeks ago. Since then, it has failed three times now. I grabbed the below chunk from the syslog where I believe the problem may lie:
2025-07-30T09:31:01.448203-05:00 bowfin crontab[321565]: (asterisk) LIST (asterisk)
2025-07-30T09:31:01.454396-05:00 bowfin crontab[321567]: (asterisk) REPLACE (asterisk)
2025-07-30T09:31:01.456935-05:00 bowfin crontab[321569]: (asterisk) LIST (asterisk)
2025-07-30T09:31:01.677003-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (sysadmin.check_certif_validity) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:31:01.677064-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager sysadmin.check_certif_validity)
2025-07-30T09:31:01.699099-05:00 bowfin sysadmin-hook[321619]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","sysadmin.check_certif_validity"]
2025-07-30T09:31:01.703584-05:00 bowfin sysadmin-hook[321619]: Security check passed. Running '/var/www/html/admin/modules/sysadmin/hooks/check_certif_validity '
2025-07-30T09:31:02.180321-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (sysadmin.check_certif_validity) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:31:02.180478-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager sysadmin.check_certif_validity)
2025-07-30T09:31:02.215463-05:00 bowfin sysadmin-hook[321637]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","sysadmin.check_certif_validity"]
2025-07-30T09:31:02.219749-05:00 bowfin sysadmin-hook[321637]: Security check passed. Running '/var/www/html/admin/modules/sysadmin/hooks/check_certif_validity '
2025-07-30T09:32:01.722718-05:00 bowfin cron[924]: (asterisk) RELOAD (crontabs/asterisk)
2025-07-30T09:32:01.726234-05:00 bowfin CRON[321704]: (asterisk) CMD ([ -e /usr/sbin/fwconsole ] && sleep $((RANDOM%30)) && /usr/sbin/fwconsole queuestats --syncall >> /var/log/asterisk/queuestats_syncall.log 2>&1)
2025-07-30T09:32:01.726425-05:00 bowfin CRON[321705]: (grant) CMD (/work/integration/bin/scan-voicemails.sh > /dev/null 2>&1)
2025-07-30T09:32:01.726641-05:00 bowfin CRON[321706]: (asterisk) CMD ([ -e /usr/sbin/fwconsole ] && /usr/sbin/fwconsole job --run --quiet 2>&1 > /dev/null)
2025-07-30T09:32:01.910376-05:00 bowfin crontab[321736]: (asterisk) LIST (asterisk)
2025-07-30T09:32:01.911627-05:00 bowfin crontab[321738]: (asterisk) LIST (asterisk)
2025-07-30T09:32:01.912620-05:00 bowfin crontab[321740]: (asterisk) LIST (asterisk)
2025-07-30T09:32:01.931978-05:00 bowfin crontab[321742]: (asterisk) LIST (asterisk)
2025-07-30T09:32:01.933112-05:00 bowfin crontab[321744]: (asterisk) LIST (asterisk)
2025-07-30T09:32:01.934255-05:00 bowfin crontab[321746]: (asterisk) LIST (asterisk)
2025-07-30T09:32:01.942534-05:00 bowfin crontab[321748]: (asterisk) REPLACE (asterisk)
2025-07-30T09:32:01.944122-05:00 bowfin crontab[321750]: (asterisk) LIST (asterisk)
2025-07-30T09:32:01.945457-05:00 bowfin crontab[321752]: (asterisk) LIST (asterisk)
2025-07-30T09:32:01.950774-05:00 bowfin crontab[321754]: (asterisk) REPLACE (asterisk)
2025-07-30T09:32:01.952930-05:00 bowfin crontab[321756]: (asterisk) LIST (asterisk)
2025-07-30T09:32:02.172944-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (sysadmin.check_certif_validity) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:32:02.173028-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager sysadmin.check_certif_validity)
2025-07-30T09:32:02.201885-05:00 bowfin sysadmin-hook[321806]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","sysadmin.check_certif_validity"]
2025-07-30T09:32:02.205835-05:00 bowfin sysadmin-hook[321806]: Security check passed. Running '/var/www/html/admin/modules/sysadmin/hooks/check_certif_validity '
2025-07-30T09:32:02.676498-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (sysadmin.check_certif_validity) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:32:02.676641-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager sysadmin.check_certif_validity)
2025-07-30T09:32:02.702942-05:00 bowfin sysadmin-hook[321824]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","sysadmin.check_certif_validity"]
2025-07-30T09:32:02.706979-05:00 bowfin sysadmin-hook[321824]: Security check passed. Running '/var/www/html/admin/modules/sysadmin/hooks/check_certif_validity '
2025-07-30T09:32:27.318102-05:00 bowfin kernel: [92541.962646] voicemail-notif invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
2025-07-30T09:32:27.318732-05:00 bowfin kernel: [92541.962650] CPU: 12 PID: 321864 Comm: voicemail-notif Not tainted 6.1.0-23-amd64 #1 Debian 6.1.99-1
2025-07-30T09:32:27.318734-05:00 bowfin kernel: [92541.962652] Hardware name: HP HP ENVY TE01-5xxx/8B3B, BIOS F.22 03/26/2024
2025-07-30T09:32:27.318734-05:00 bowfin kernel: [92541.962653] Call Trace:
2025-07-30T09:32:27.318735-05:00 bowfin kernel: [92541.962655] <TASK>
2025-07-30T09:32:27.318735-05:00 bowfin kernel: [92541.962657] dump_stack_lvl+0x44/0x5c
2025-07-30T09:32:27.318736-05:00 bowfin kernel: [92541.962662] dump_header+0x4a/0x211
2025-07-30T09:32:27.318736-05:00 bowfin kernel: [92541.962664] oom_kill_process.cold+0xb/0x10
2025-07-30T09:32:27.318737-05:00 bowfin kernel: [92541.962666] out_of_memory+0x1fd/0x4c0
2025-07-30T09:32:27.318737-05:00 bowfin kernel: [92541.962669] __alloc_pages_slowpath.constprop.0+0xc6c/0xe30
2025-07-30T09:32:27.318737-05:00 bowfin kernel: [92541.962671] __alloc_pages+0x305/0x330
2025-07-30T09:32:27.318737-05:00 bowfin kernel: [92541.962673] folio_alloc+0x17/0x50
2025-07-30T09:32:27.318738-05:00 bowfin kernel: [92541.962675] __filemap_get_folio+0x155/0x340
2025-07-30T09:32:27.318738-05:00 bowfin kernel: [92541.962677] filemap_fault+0x139/0x910
2025-07-30T09:32:27.318739-05:00 bowfin kernel: [92541.962679] ? filemap_map_pages+0x153/0x700
2025-07-30T09:32:27.318739-05:00 bowfin kernel: [92541.962681] __do_fault+0x30/0x110
2025-07-30T09:32:27.318739-05:00 bowfin kernel: [92541.962683] do_fault+0x1b9/0x410
2025-07-30T09:32:27.318739-05:00 bowfin kernel: [92541.962684] __handle_mm_fault+0x660/0xfa0
2025-07-30T09:32:27.318740-05:00 bowfin kernel: [92541.962687] handle_mm_fault+0xdb/0x2d0
2025-07-30T09:32:27.318740-05:00 bowfin kernel: [92541.962688] do_user_addr_fault+0x191/0x550
2025-07-30T09:32:27.318740-05:00 bowfin kernel: [92541.962691] exc_page_fault+0x70/0x170
2025-07-30T09:32:27.318740-05:00 bowfin kernel: [92541.962693] asm_exc_page_fault+0x22/0x30
2025-07-30T09:32:27.318740-05:00 bowfin kernel: [92541.962694] RIP: 0033:0x56011edf9ba8
2025-07-30T09:32:27.318741-05:00 bowfin kernel: [92541.962698] Code: Unable to access opcode bytes at 0x56011edf9b7e.
2025-07-30T09:32:27.318742-05:00 bowfin kernel: [92541.962698] RSP: 002b:00007ffebd4116e0 EFLAGS: 00010202
2025-07-30T09:32:27.318742-05:00 bowfin kernel: [92541.962700] RAX: 0000560897f55a60 RBX: 00005601207ceaf0 RCX: 0000000000000000
2025-07-30T09:32:27.318742-05:00 bowfin kernel: [92541.962701] RDX: 00000000002035b8 RSI: 0000560897f55a48 RDI: 0000560898159018
2025-07-30T09:32:27.318742-05:00 bowfin kernel: [92541.962702] RBP: 0000560897f55a60 R08: 0000560897f55a60 R09: 0000000000000000
2025-07-30T09:32:27.318742-05:00 bowfin kernel: [92541.962702] R10: 0000000000000000 R11: 0000560897f76000 R12: 0000560897f55a48
2025-07-30T09:32:27.318743-05:00 bowfin kernel: [92541.962703] R13: 0000560897f55a47 R14: 00000000002035b8 R15: 00000000002035b8
2025-07-30T09:32:27.318743-05:00 bowfin kernel: [92541.962704] </TASK>
2025-07-30T09:32:27.318743-05:00 bowfin kernel: [92541.962705] Mem-Info:
2025-07-30T09:32:27.318744-05:00 bowfin kernel: [92541.962706] active_anon:36683 inactive_anon:7947142 isolated_anon:0
2025-07-30T09:32:27.318744-05:00 bowfin kernel: [92541.962706] active_file:11 inactive_file:0 isolated_file:0
2025-07-30T09:32:27.318744-05:00 bowfin kernel: [92541.962706] unevictable:2449 dirty:3 writeback:49
2025-07-30T09:32:27.318744-05:00 bowfin kernel: [92541.962706] slab_reclaimable:13877 slab_unreclaimable:28258
2025-07-30T09:32:27.318744-05:00 bowfin kernel: [92541.962706] mapped:726 shmem:3630 pagetables:19480
2025-07-30T09:32:27.318745-05:00 bowfin kernel: [92541.962706] sec_pagetables:0 bounce:0
2025-07-30T09:32:27.318745-05:00 bowfin kernel: [92541.962706] kernel_misc_reclaimable:0
2025-07-30T09:32:27.318745-05:00 bowfin kernel: [92541.962706] free:49781 free_pcp:0 free_cma:0
2025-07-30T09:32:27.318746-05:00 bowfin kernel: [92541.962708] Node 0 active_anon:146732kB inactive_anon:31788568kB active_file:44kB inactive_file:0kB unevictable:9796kB isolated(anon):0kB isolated(file):0kB mapped:2904kB dirty:12kB writeback:196kB shmem:14520kB shmem_thp: 8192kB shmem_pmdmapped: 0kB anon_thp: 3000320kB writeback_tmp:0kB kernel_stack:11216kB pagetables:77920kB sec_pagetables:0kB all_unreclaimable? yes
2025-07-30T09:32:27.318746-05:00 bowfin kernel: [92541.962711] Node 0 DMA free:11264kB boost:0kB min:28kB low:40kB high:52kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2025-07-30T09:32:27.318746-05:00 bowfin kernel: [92541.962714] lowmem_reserve[]: 0 1618 31715 31715 31715
2025-07-30T09:32:27.318746-05:00 bowfin kernel: [92541.962716] Node 0 DMA32 free:123828kB boost:0kB min:3444kB low:5100kB high:6756kB reserved_highatomic:0KB active_anon:0kB inactive_anon:1565352kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1762052kB managed:1696356kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2025-07-30T09:32:27.318747-05:00 bowfin kernel: [92541.962718] lowmem_reserve[]: 0 0 30097 30097 30097
2025-07-30T09:32:27.318748-05:00 bowfin kernel: [92541.962720] Node 0 Normal free:64032kB boost:0kB min:64104kB low:94920kB high:125736kB reserved_highatomic:0KB active_anon:147012kB inactive_anon:30223296kB active_file:228kB inactive_file:0kB unevictable:9796kB writepending:208kB present:31453184kB managed:30827520kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2025-07-30T09:32:27.318748-05:00 bowfin kernel: [92541.962722] lowmem_reserve[]: 0 0 0 0 0
2025-07-30T09:32:27.318748-05:00 bowfin kernel: [92541.962723] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB (U) 1*2048kB (M) 2*4096kB (M) = 11264kB
2025-07-30T09:32:27.318748-05:00 bowfin kernel: [92541.962728] Node 0 DMA32: 1*4kB (U) 3*8kB (UM) 4*16kB (UM) 3*32kB (UM) 4*64kB (U) 4*128kB (UM) 2*256kB (UM) 1*512kB (M) 1*1024kB (M) 1*2048kB (M) 29*4096kB (UM) = 123836kB
2025-07-30T09:32:27.318749-05:00 bowfin kernel: [92541.962734] Node 0 Normal: 1714*4kB (UME) 1662*8kB (UME) 788*16kB (UME) 506*32kB (UME) 228*64kB (UME) 3*128kB (UM) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 63928kB
2025-07-30T09:32:27.318749-05:00 bowfin kernel: [92541.962739] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2025-07-30T09:32:27.318749-05:00 bowfin kernel: [92541.962740] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2025-07-30T09:32:27.318749-05:00 bowfin kernel: [92541.962740] 19061 total pagecache pages
2025-07-30T09:32:27.318750-05:00 bowfin kernel: [92541.962741] 15211 pages in swap cache
2025-07-30T09:32:27.318750-05:00 bowfin kernel: [92541.962741] Free swap = 0kB
2025-07-30T09:32:27.318750-05:00 bowfin kernel: [92541.962742] Total swap = 1000444kB
2025-07-30T09:32:27.318751-05:00 bowfin kernel: [92541.962742] 8307807 pages RAM
2025-07-30T09:32:27.318751-05:00 bowfin kernel: [92541.962742] 0 pages HighMem/MovableOnly
2025-07-30T09:32:27.318751-05:00 bowfin kernel: [92541.962743] 172998 pages reserved
2025-07-30T09:32:27.318751-05:00 bowfin kernel: [92541.962743] 0 pages hwpoisoned
2025-07-30T09:32:27.318751-05:00 bowfin kernel: [92541.962743] Tasks state (memory values in pages):
2025-07-30T09:32:27.318752-05:00 bowfin kernel: [92541.962744] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
2025-07-30T09:32:27.318752-05:00 bowfin kernel: [92541.962752] [ 532] 0 532 27864 744 241664 122 -250 systemd-journal
2025-07-30T09:32:27.318752-05:00 bowfin kernel: [92541.962755] [ 551] 0 551 6694 497 77824 0 -1000 systemd-udevd
2025-07-30T09:32:27.318753-05:00 bowfin kernel: [92541.962756] [ 924] 0 924 2000 86 53248 0 0 cron
2025-07-30T09:32:27.318753-05:00 bowfin kernel: [92541.962757] [ 925] 100 925 2310 153 57344 0 -900 dbus-daemon
2025-07-30T09:32:27.318753-05:00 bowfin kernel: [92541.962758] [ 928] 0 928 55444 208 77824 624 0 rsyslogd
2025-07-30T09:32:27.318753-05:00 bowfin kernel: [92541.962759] [ 929] 0 929 12491 270 98304 0 0 systemd-logind
2025-07-30T09:32:27.318754-05:00 bowfin kernel: [92541.962760] [ 930] 0 930 895 35 36864 0 0 atd
2025-07-30T09:32:27.318754-05:00 bowfin kernel: [92541.962761] [ 931] 0 931 1475 15 53248 53 0 incrond
2025-07-30T09:32:27.318754-05:00 bowfin kernel: [92541.962762] [ 990] 0 990 1468 207 49152 5 0 dhclient
2025-07-30T09:32:27.318754-05:00 bowfin kernel: [92541.962763] [ 1053] 109 1053 143569 8318 741376 28367 0 mongod
2025-07-30T09:32:27.318755-05:00 bowfin kernel: [92541.962764] [ 1061] 0 1061 3331 376 69632 0 0 openvpn
2025-07-30T09:32:27.318755-05:00 bowfin kernel: [92541.962765] [ 1064] 102 1064 18109 1633 126976 337 0 redis-server
2025-07-30T09:32:27.318755-05:00 bowfin kernel: [92541.962766] [ 1084] 0 1084 5856 84 61440 11 0 apcupsd
2025-07-30T09:32:27.318755-05:00 bowfin kernel: [92541.962767] [ 1113] 0 1113 1165 65 45056 5 0 in.tftpd
2025-07-30T09:32:27.318755-05:00 bowfin kernel: [92541.962768] [ 1124] 0 1124 1468 22 53248 0 0 agetty
2025-07-30T09:32:27.318756-05:00 bowfin kernel: [92541.962769] [ 1127] 0 1127 3855 334 69632 0 -1000 sshd
2025-07-30T09:32:27.318757-05:00 bowfin kernel: [92541.962770] [ 1138] 103 1138 4715 107 61440 40 0 chronyd
2025-07-30T09:32:27.318757-05:00 bowfin kernel: [92541.962771] [ 1146] 103 1146 2633 97 57344 41 0 chronyd
2025-07-30T09:32:27.318757-05:00 bowfin kernel: [92541.962772] [ 1223] 104 1223 1429724 26634 1232896 71714 0 mariadbd
2025-07-30T09:32:27.318757-05:00 bowfin kernel: [92541.962773] [ 1236] 0 1236 2360 82 49152 3 0 xinetd
2025-07-30T09:32:27.318757-05:00 bowfin kernel: [92541.962774] [ 1240] 0 1240 71238 3697 253952 213 0 apache2
2025-07-30T09:32:27.318758-05:00 bowfin kernel: [92541.962775] [ 1673] 999 1673 6153 1558 90112 67 0 pnp_server
2025-07-30T09:32:27.318758-05:00 bowfin kernel: [92541.962776] [ 1690] 0 1690 10664 74 73728 87 0 master
2025-07-30T09:32:27.318758-05:00 bowfin kernel: [92541.962776] [ 1694] 105 1694 10811 168 73728 0 0 qmgr
2025-07-30T09:32:27.318758-05:00 bowfin kernel: [92541.962777] [ 1986] 0 1986 37758 2897 241664 234 0 php
2025-07-30T09:32:27.318759-05:00 bowfin kernel: [92541.962778] [ 2272] 0 2272 644 1 45056 31 0 safe_asterisk
2025-07-30T09:32:27.318759-05:00 bowfin kernel: [92541.962779] [ 2274] 999 2274 2406790 18016 1200128 9317 0 asterisk
2025-07-30T09:32:27.318759-05:00 bowfin kernel: [92541.962780] [ 2409] 0 2409 432275 5148 294912 627 0 fail2ban-server
2025-07-30T09:32:27.318759-05:00 bowfin kernel: [92541.962781] [ 2626] 999 2626 230777 5576 1236992 4712 0 PM2 v5.2.2: God
2025-07-30T09:32:27.318760-05:00 bowfin kernel: [92541.962782] [ 2705] 999 2705 40393 513 258048 5233 0 php
2025-07-30T09:32:27.318760-05:00 bowfin kernel: [92541.962783] [ 2801] 999 2801 164329 4656 1224704 4517 0 node /var/www/h
2025-07-30T09:32:27.318769-05:00 bowfin kernel: [92541.962784] [ 2992] 999 2992 42471 1026 278528 6810 0 php
2025-07-30T09:32:27.318769-05:00 bowfin kernel: [92541.962784] [ 3124] 999 3124 2865250 9152 3063808 10970 0 node /var/www/h
2025-07-30T09:32:27.318770-05:00 bowfin kernel: [92541.962786] [ 3241] 999 3241 208420 6252 2637824 8685 0 node /var/www/h
2025-07-30T09:32:27.318770-05:00 bowfin kernel: [92541.962787] [ 5791] 0 5791 37758 2754 188416 374 0 php
2025-07-30T09:32:27.318770-05:00 bowfin kernel: [92541.962787] [ 83584] 0 83584 4311085 31550 1966080 97027 0 java
2025-07-30T09:32:27.318770-05:00 bowfin kernel: [92541.962789] [ 83718] 105 83718 12199 356 90112 0 0 tlsmgr
2025-07-30T09:32:27.318771-05:00 bowfin kernel: [92541.962790] [ 208451] 999 208451 71434 3124 237568 213 0 apache2
2025-07-30T09:32:27.318771-05:00 bowfin kernel: [92541.962791] [ 208452] 999 208452 71434 3123 237568 213 0 apache2
2025-07-30T09:32:27.318771-05:00 bowfin kernel: [92541.962791] [ 208453] 999 208453 71438 3130 237568 213 0 apache2
2025-07-30T09:32:27.318771-05:00 bowfin kernel: [92541.962792] [ 208454] 999 208454 71434 3124 237568 213 0 apache2
2025-07-30T09:32:27.318772-05:00 bowfin kernel: [92541.962793] [ 208455] 999 208455 71436 3128 237568 213 0 apache2
2025-07-30T09:32:27.318773-05:00 bowfin kernel: [92541.962794] [ 209715] 999 209715 71436 3128 237568 213 0 apache2
2025-07-30T09:32:27.318773-05:00 bowfin kernel: [92541.962795] [ 225757] 999 225757 71434 3127 237568 213 0 apache2
2025-07-30T09:32:27.318773-05:00 bowfin kernel: [92541.962796] [ 225769] 999 225769 71434 3114 237568 213 0 apache2
2025-07-30T09:32:27.318773-05:00 bowfin kernel: [92541.962796] [ 225796] 999 225796 71436 3113 237568 213 0 apache2
2025-07-30T09:32:27.318774-05:00 bowfin kernel: [92541.962798] [ 312175] 105 312175 10764 168 73728 0 0 pickup
2025-07-30T09:32:27.318774-05:00 bowfin kernel: [92541.962799] [ 321863] 999 321863 644 16 45056 10 0 sh
2025-07-30T09:32:27.318774-05:00 bowfin kernel: [92541.962800] [ 321864] 999 321864 7832784 7831074 62828544 0 0 voicemail-notif
2025-07-30T09:32:27.318775-05:00 bowfin kernel: [92541.962801] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/freepbx.service,task=voicemail-notif,pid=321864,uid=999
2025-07-30T09:32:27.318775-05:00 bowfin kernel: [92541.962808] Out of memory: Killed process 321864 (voicemail-notif) total-vm:31331136kB, anon-rss:31324296kB, file-rss:0kB, shmem-rss:0kB, UID:999 pgtables:61356kB oom_score_adj:0
2025-07-30T09:32:27.377007-05:00 bowfin systemd[1]: freepbx.service: A process of this unit has been killed by the OOM killer.
2025-07-30T09:32:27.819975-05:00 bowfin fwconsole[321895]: Running FreePBX shutdown...
2025-07-30T09:32:27.821133-05:00 bowfin fwconsole[321895]: Running Asterisk pre from Cdrpro module
2025-07-30T09:32:27.853967-05:00 bowfin fwconsole[321895]: Stopping CDRpro Service...
2025-07-30T09:32:27.854009-05:00 bowfin fwconsole[321895]: Stopping CDRpro Service
2025-07-30T09:32:28.178542-05:00 bowfin fwconsole[321895]: cdrpro is not running
2025-07-30T09:32:28.178673-05:00 bowfin fwconsole[321895]: Running Asterisk pre from Core module
2025-07-30T09:32:28.179061-05:00 bowfin fwconsole[321895]: Stopping Call Transfer Monitoring Service
2025-07-30T09:32:29.168242-05:00 bowfin fwconsole[321895]: Stopping Core FastAGI Server
2025-07-30T09:32:30.144747-05:00 bowfin fwconsole[321895]: Stopped FastAGI Server
2025-07-30T09:32:30.144770-05:00 bowfin fwconsole[321895]: Running Asterisk pre from Restapps module
2025-07-30T09:32:30.186052-05:00 bowfin mariadbd[1223]: 2025-07-30 9:32:30 49 [Warning] Aborted connection 49 to db: 'asterisk' user: 'freepbxuser' host: 'localhost' (Got an error reading communication packets)
2025-07-30T09:32:30.350550-05:00 bowfin fwconsole[321895]: Stopping RestApps Server
2025-07-30T09:32:30.682046-05:00 bowfin mariadbd[1223]: 2025-07-30 9:32:30 14390 [Warning] Aborted connection 14390 to db: 'asterisk' user: 'freepbxuser' host: 'localhost' (Got an error reading communication packets)
2025-07-30T09:32:30.981558-05:00 bowfin fwconsole[321895]: Stopped RestApps Server
2025-07-30T09:32:30.981591-05:00 bowfin fwconsole[321895]: Running Asterisk pre from Sangomaconnect module
2025-07-30T09:32:31.345916-05:00 bowfin fwconsole[321895]: SangomaConnect Server is not running
2025-07-30T09:32:31.346496-05:00 bowfin fwconsole[321895]: Running Asterisk pre from Sangomartapi module
2025-07-30T09:32:31.520779-05:00 bowfin fwconsole[321895]: Stopping Sangoma RT API Server...
2025-07-30T09:32:31.975791-05:00 bowfin mariadbd[1223]: 2025-07-30 9:32:31 14383 [Warning] Aborted connection 14383 to db: 'asterisk' user: 'freepbxuser' host: 'localhost' (Got an error reading communication packets)
2025-07-30T09:32:32.244974-05:00 bowfin fwconsole[321895]: Stopped Sangoma RT API Server
2025-07-30T09:32:32.245015-05:00 bowfin fwconsole[321895]: Running Asterisk pre from Ucp module
2025-07-30T09:32:32.444793-05:00 bowfin fwconsole[321895]: Stopping UCP Node Server
2025-07-30T09:32:32.797079-05:00 bowfin mariadbd[1223]: 2025-07-30 9:32:32 63 [Warning] Aborted connection 63 to db: 'asterisk' user: 'freepbxuser' host: 'localhost' (Got an error reading communication packets)
2025-07-30T09:32:33.089441-05:00 bowfin fwconsole[321895]: [>---------------------------] < 1 sec
2025-07-30T09:32:33.253482-05:00 bowfin fwconsole[321895]: Stopped UCP Node Server
2025-07-30T09:32:33.253878-05:00 bowfin fwconsole[321895]: Shutting down Asterisk Gracefully. Will forcefully kill after 30 seconds.
2025-07-30T09:32:33.253905-05:00 bowfin fwconsole[321895]: Press C to Cancel
2025-07-30T09:32:33.256015-05:00 bowfin fwconsole[321895]: Press N to shut down NOW
2025-07-30T09:32:33.256075-05:00 bowfin fwconsole[322216]: stty: 'standard input': Inappropriate ioctl for device
2025-07-30T09:32:33.259353-05:00 bowfin fwconsole[322218]: stty: 'standard input': Inappropriate ioctl for device
2025-07-30T09:32:33.562017-05:00 bowfin fwconsole[321895]: [>---------------------------] < 1 sec[->--------------------------] < 1 sec
2025-07-30T09:32:33.562110-05:00 bowfin fwconsole[322235]: stty: 'standard input': Inappropriate ioctl for device
2025-07-30T09:32:33.769281-05:00 bowfin fwconsole[321895]: Advanced Recovery service is not running
2025-07-30T09:32:33.771486-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (firewall.stopfirewall) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:32:33.773384-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager firewall.stopfirewall)
2025-07-30T09:32:33.795037-05:00 bowfin sysadmin-hook[322249]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","firewall.stopfirewall"]
2025-07-30T09:32:33.805285-05:00 bowfin sysadmin-hook[322249]: Security check passed. Running '/var/www/html/admin/modules/firewall/hooks/stopfirewall '
2025-07-30T09:32:33.822885-05:00 bowfin mariadbd[1223]: 2025-07-30 9:32:33 108 [Warning] Aborted connection 108 to db: 'asterisk' user: 'freepbxuser' host: 'localhost' (Got an error reading communication packets)
2025-07-30T09:32:33.823785-05:00 bowfin mariadbd[1223]: 2025-07-30 9:32:33 34 [Warning] Aborted connection 34 to db: 'asterisk' user: 'freepbxuser' host: 'localhost' (Got an error reading communication packets)
2025-07-30T09:32:34.456692-05:00 bowfin fwconsole[321895]: Queue Callback Server is not running
2025-07-30T09:32:34.615976-05:00 bowfin fwconsole[321895]: Queue Callback Event Server is not running
2025-07-30T09:32:34.673873-05:00 bowfin systemd[1]: freepbx.service: Failed with result 'oom-kill'.
2025-07-30T09:32:34.674237-05:00 bowfin systemd[1]: freepbx.service: Consumed 41min 24.002s CPU time.
2025-07-30T09:33:01.229503-05:00 bowfin cron[924]: (asterisk) RELOAD (crontabs/asterisk)
2025-07-30T09:33:01.236642-05:00 bowfin CRON[322510]: (asterisk) CMD ([ -e /usr/sbin/fwconsole ] && sleep $((RANDOM%30)) && /usr/sbin/fwconsole queuestats --syncall >> /var/log/asterisk/queuestats_syncall.log 2>&1)
2025-07-30T09:33:01.245892-05:00 bowfin CRON[322513]: (asterisk) CMD ([ -e /usr/sbin/fwconsole ] && /usr/sbin/fwconsole job --run --quiet 2>&1 > /dev/null)
2025-07-30T09:33:01.420070-05:00 bowfin crontab[322524]: (asterisk) LIST (asterisk)
2025-07-30T09:33:01.421228-05:00 bowfin crontab[322526]: (asterisk) LIST (asterisk)
2025-07-30T09:33:01.422299-05:00 bowfin crontab[322528]: (asterisk) LIST (asterisk)
2025-07-30T09:33:01.444264-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (sysadmin.check_certif_validity) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:33:01.444858-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager sysadmin.check_certif_validity)
2025-07-30T09:33:01.471429-05:00 bowfin sysadmin-hook[322531]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","sysadmin.check_certif_validity"]
2025-07-30T09:33:01.476045-05:00 bowfin sysadmin-hook[322531]: Security check passed. Running '/var/www/html/admin/modules/sysadmin/hooks/check_certif_validity '
2025-07-30T09:33:01.951833-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (sysadmin.check_certif_validity) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:33:01.952548-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager sysadmin.check_certif_validity)
2025-07-30T09:33:01.979896-05:00 bowfin sysadmin-hook[322548]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","sysadmin.check_certif_validity"]
2025-07-30T09:33:01.984483-05:00 bowfin sysadmin-hook[322548]: Security check passed. Running '/var/www/html/admin/modules/sysadmin/hooks/check_certif_validity '
2025-07-30T09:34:01.510960-05:00 bowfin CRON[322569]: (grant) CMD (/work/integration/bin/scan-voicemails.sh > /dev/null 2>&1)
2025-07-30T09:34:01.511152-05:00 bowfin CRON[322570]: (asterisk) CMD ([ -e /usr/sbin/fwconsole ] && /usr/sbin/fwconsole job --run --quiet 2>&1 > /dev/null)
2025-07-30T09:34:01.512445-05:00 bowfin CRON[322571]: (asterisk) CMD ([ -e /usr/sbin/fwconsole ] && sleep $((RANDOM%30)) && /usr/sbin/fwconsole queuestats --syncall >> /var/log/asterisk/queuestats_syncall.log 2>&1)
2025-07-30T09:34:01.675461-05:00 bowfin crontab[322597]: (asterisk) LIST (asterisk)
2025-07-30T09:34:01.676507-05:00 bowfin crontab[322599]: (asterisk) LIST (asterisk)
2025-07-30T09:34:01.677682-05:00 bowfin crontab[322601]: (asterisk) LIST (asterisk)
2025-07-30T09:34:01.697502-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (sysadmin.check_certif_validity) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:34:01.697579-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager sysadmin.check_certif_validity)
2025-07-30T09:34:01.723906-05:00 bowfin sysadmin-hook[322604]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","sysadmin.check_certif_validity"]
2025-07-30T09:34:01.728260-05:00 bowfin sysadmin-hook[322604]: Security check passed. Running '/var/www/html/admin/modules/sysadmin/hooks/check_certif_validity '
2025-07-30T09:34:02.203745-05:00 bowfin incrond[931]: PATH (/var/spool/asterisk/incron) FILE (sysadmin.check_certif_validity) EVENT (IN_CLOSE_WRITE)
2025-07-30T09:34:02.203905-05:00 bowfin incrond[931]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager sysadmin.check_certif_validity)
2025-07-30T09:34:02.234339-05:00 bowfin sysadmin-hook[322626]: sysadmin hook started - ["\/usr\/bin\/sysadmin_manager","sysadmin.check_certif_validity"]
2025-07-30T09:34:02.238803-05:00 bowfin sysadmin-hook[322626]: Security check passed. Running '/var/www/html/admin/modules/sysadmin/hooks/check_certif_validity '
2025-07-30T09:34:04.284835-05:00 bowfin postfix/smtpd[322656]: warning: /etc/postfix/main.cf, line 56: overriding earlier entry: smtp_tls_security_level=may
2025-07-30T09:34:04.292030-05:00 bowfin postfix/proxymap[322657]: warning: /etc/postfix/main.cf, line 56: overriding earlier entry: smtp_tls_security_level=may
2025-07-30T09:34:04.306781-05:00 bowfin postfix/smtpd[322656]: connect from localhost[127.0.0.1]
2025-07-30T09:34:04.312772-05:00 bowfin postfix/trivial-rewrite[322658]: warning: /etc/postfix/main.cf, line 56: overriding earlier entry: smtp_tls_security_level=may
2025-07-30T09:34:04.320754-05:00 bowfin postfix/cleanup[322659]: warning: /etc/postfix/main.cf, line 56: overriding earlier entry: smtp_tls_security_level=may
2025-07-30T09:34:04.323183-05:00 bowfin postfix/smtpd[322656]: 4EC002348521: client=localhost[127.0.0.1]
2025-07-30T09:34:04.325602-05:00 bowfin postfix/cleanup[322659]: 4EC002348521: message-id=<422833762.7.1753886044270@bowfin.******.co>
2025-07-30T09:34:04.399693-05:00 bowfin postfix/smtpd[322656]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5
2025-07-30T09:34:04.399976-05:00 bowfin postfix/qmgr[1694]: 4EC002348521: from=<no-reply@******.co>, size=2223907, nrcpt=1 (queue active)
2025-07-30T09:34:04.403473-05:00 bowfin postfix/smtp[322661]: warning: /etc/postfix/main.cf, line 56: overriding earlier entry: smtp_tls_security_level=may
2025-07-30T09:34:05.473557-05:00 bowfin postfix/smtp[322661]: 4EC002348521: to=<[email protected]>, relay=www.myemailaccount.org[96.88.21.66]:587, delay=1.2, delays=0.09/0.01/0.43/0.63, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as D2FC120A3A19)
2025-07-30T09:34:05.484704-05:00 bowfin postfix/qmgr[1694]: 4EC002348521: removed
2025-07-30T09:35:01.750845-05:00 bowfin CRON[322667]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
2025-07-30T09:35:01.751533-05:00 bowfin CRON[322668]: (asterisk) CMD ([ -e /usr/sbin/fwconsole ] && sleep $((RANDOM%30)) && /usr/sbin/fwconsole queuestats --syncall >> /var/log/asterisk/queuestats_syncall.log 2>&1)
2025-07-30T09:35:01.751618-05:00 bowfin CRON[322669]: (asterisk) CMD ([ -e /usr/sbin/fwconsole ] && /usr/sbin/fwconsole job --run --quiet 2>&1 > /dev/null)
2025-07-30T09:35:01.971941-05:00 bowfin crontab[322685]: (asterisk) LIST (asterisk)
If I’m reading it right, it appears to be a memory issue that in turn is causing things to shut down. Is that correct? I am running a server that has 32GB RAM which is dedicated to FreePBX.
Anyone better at reading this log see anything that might better explain what is happening here?