FreePBX freeze each 5 Minutes for a short moment

Hi all

We have a strange issue. In the last days, we have some interrupts while we do calls, so while have a phone call, we can’t hear each others about 3-10 seconds. I start pinging our freepbx server and i got these while we have these interrupts:

64 bytes from 198.18.8.48: icmp_seq=2588 ttl=64 time=0.118 ms
64 bytes from 198.18.8.48: icmp_seq=2589 ttl=64 time=0.174 ms
64 bytes from 198.18.8.48: icmp_seq=2590 ttl=64 time=0.224 ms
64 bytes from 198.18.8.48: icmp_seq=2591 ttl=64 time=0.177 ms
64 bytes from 198.18.8.48: icmp_seq=2592 ttl=64 time=0.242 ms
64 bytes from 198.18.8.48: icmp_seq=2593 ttl=64 time=0.184 ms  --> here stops the console
64 bytes from 198.18.8.48: icmp_seq=2594 ttl=64 time=2544 ms
64 bytes from 198.18.8.48: icmp_seq=2595 ttl=64 time=2334 ms
64 bytes from 198.18.8.48: icmp_seq=2596 ttl=64 time=2126 ms
64 bytes from 198.18.8.48: icmp_seq=2597 ttl=64 time=1918 ms
64 bytes from 198.18.8.48: icmp_seq=2598 ttl=64 time=1710 ms
64 bytes from 198.18.8.48: icmp_seq=2599 ttl=64 time=1502 ms
64 bytes from 198.18.8.48: icmp_seq=2600 ttl=64 time=1294 ms
64 bytes from 198.18.8.48: icmp_seq=2601 ttl=64 time=1086 ms
64 bytes from 198.18.8.48: icmp_seq=2602 ttl=64 time=878 ms
64 bytes from 198.18.8.48: icmp_seq=2603 ttl=64 time=670 ms
64 bytes from 198.18.8.48: icmp_seq=2604 ttl=64 time=462 ms
64 bytes from 198.18.8.48: icmp_seq=2605 ttl=64 time=254 ms
64 bytes from 198.18.8.48: icmp_seq=2606 ttl=64 time=46.9 ms
64 bytes from 198.18.8.48: icmp_seq=2607 ttl=64 time=0.185 ms --> here everything above comes together
64 bytes from 198.18.8.48: icmp_seq=2608 ttl=64 time=0.180 ms
64 bytes from 198.18.8.48: icmp_seq=2609 ttl=64 time=0.190 ms
64 bytes from 198.18.8.48: icmp_seq=2610 ttl=64 time=0.202 ms
64 bytes from 198.18.8.48: icmp_seq=2611 ttl=64 time=0.215 ms
64 bytes from 198.18.8.48: icmp_seq=2612 ttl=64 time=0.198 ms
64 bytes from 198.18.8.48: icmp_seq=2613 ttl=64 time=0.195 ms

The system is in a virtual machine, based on qemu. We have some other machines on the same host and when i ping the freePBX VM from another VM which resists on the same host, i have the same effect.

I follow the “top” and I saw, that the wait’s going up to 100% and the system is no longer responsible for a short moment. but never with a specific process on top.

Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 95.2%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.5%us,  2.5%sy,  0.0%ni, 95.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 92.9%id,  0.0%wa,  0.0%hi,  0.0%si,  2.4%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 95.2%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 95.2%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.5%us,  0.0%sy,  0.0%ni, 97.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 95.2%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 97.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.5%us,  0.0%sy,  0.0%ni, 97.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 95.2%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 92.9%id,  7.1%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 95.2%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 85.4%id,  9.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 48.8%id, 51.2%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.9%sy,  0.0%ni, 49.1%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 46.3%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 48.8%id, 51.2%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 48.7%id, 51.3%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 47.5%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 48.7%id, 51.3%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 46.3%id, 51.2%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s): 16.7%us,  9.5%sy,  0.0%ni,  0.0%id, 73.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,  0.0%id,100.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni,  0.0%id, 97.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni,  0.0%id, 95.2%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.5%us,  0.0%sy,  0.0%ni,  0.0%id, 97.5%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  4.9%sy,  0.0%ni,  0.0%id, 95.1%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s): 61.0%us, 22.0%sy,  0.0%ni,  0.0%id, 17.1%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,  0.0%id,100.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni,  0.0%id, 97.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.7%us,  0.8%sy,  0.0%ni, 12.9%id, 85.5%wa,  0.0%hi,  0.1%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 50.0%id, 47.5%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  9.8%us,  4.9%sy,  0.0%ni, 41.5%id, 43.9%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s): 43.6%us,  7.7%sy,  0.0%ni, 23.1%id, 25.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  9.8%us,  4.9%sy,  0.0%ni, 48.8%id, 36.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 50.0%id, 47.5%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.6%us,  0.8%sy,  0.0%ni, 49.8%id, 48.7%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 50.0%id, 47.5%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 50.0%id, 47.5%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.4%us,  0.7%sy,  0.0%ni, 50.0%id, 48.9%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 48.7%id, 51.3%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 50.0%id, 47.5%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 47.5%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  4.9%sy,  0.0%ni, 48.8%id, 46.3%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 47.5%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 51.3%id, 48.7%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.6%sy,  0.0%ni, 51.3%id, 46.2%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 47.6%id, 47.6%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 50.0%id, 50.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.5%us,  0.0%sy,  0.0%ni, 50.0%id, 47.5%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 46.3%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni, 51.3%id, 48.7%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 48.8%id, 48.8%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.5%us,  0.0%sy,  0.0%ni, 50.0%id, 47.5%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 95.1%id,  0.0%wa,  0.0%hi,  2.4%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 97.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 97.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  0.0%sy,  0.0%ni,100.0%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  2.4%sy,  0.0%ni, 95.1%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.4%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  2.4%us,  0.0%sy,  0.0%ni, 97.6%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st
Cpu(s):  0.0%us,  2.5%sy,  0.0%ni, 97.5%id,  0.0%wa,  0.0%hi,  0.0%si,  0.0%st

iotop brings me not forward, there are no disk activity while the system hung in this short moment.

The interessting thing is, that this happens after 10-40 seconds every 5 minuten (xx:x0 or xx:x5)

First i expect a network issue, but i can’t find any problems and all the other VM’s runns fine. A look in the /var/log/messages give me these while the calls breaks :

Aug 22 05:25:27 pbx01 kernel: dahdi: Detected time shift.
Aug 22 05:45:12 pbx01 kernel: dahdi: Detected time shift.
Aug 22 05:50:13 pbx01 kernel: dahdi: Detected time shift.
Aug 22 06:05:12 pbx01 kernel: dahdi: Detected time shift.
Aug 22 06:25:12 pbx01 kernel: dahdi: Detected time shift.
Aug 22 06:45:27 pbx01 kernel: dahdi: Detected time shift.
Aug 22 07:10:27 pbx01 kernel: dahdi: Detected time shift.
Aug 22 07:25:28 pbx01 kernel: dahdi: Detected time shift.
Aug 22 07:30:12 pbx01 kernel: dahdi: Detected time shift.
Aug 22 07:30:27 pbx01 kernel: dahdi: Detected time shift.
Aug 22 07:50:30 pbx01 kernel: dahdi: Detected time shift.
Aug 22 07:55:28 pbx01 kernel: dahdi: Detected time shift.
Aug 22 08:00:12 pbx01 kernel: dahdi: Detected time shift.
Aug 22 08:05:12 pbx01 kernel: dahdi: Detected time shift.
Aug 22 08:10:35 pbx01 kernel: dahdi: Detected time shift.
Aug 22 08:30:19 pbx01 kernel: dahdi: Detected time shift.
Aug 22 08:40:04 pbx01 kernel: dahdi: Detected time shift.
Aug 22 08:40:39 pbx01 kernel: dahdi: Detected time shift.
Aug 22 08:45:35 pbx01 kernel: dahdi: Detected time shift.
Aug 22 09:00:19 pbx01 kernel: dahdi: Detected time shift.
Aug 22 09:00:35 pbx01 kernel: dahdi: Detected time shift.
Aug 22 09:15:34 pbx01 kernel: dahdi: Detected time shift.
Aug 22 09:20:35 pbx01 kernel: dahdi: Detected time shift.
Aug 22 09:30:11 pbx01 kernel: dahdi: Detected time shift.
Aug 22 09:35:30 pbx01 kernel: dahdi: Detected time shift.
Aug 22 10:05:13 pbx01 kernel: dahdi: Detected time shift.
Aug 22 10:15:39 pbx01 kernel: dahdi: Detected time shift.
Aug 22 10:20:40 pbx01 kernel: dahdi: Detected time shift.
Aug 22 10:30:14 pbx01 kernel: dahdi: Detected time shift.
Aug 22 10:35:12 pbx01 kernel: dahdi: Detected time shift.
Aug 22 10:55:29 pbx01 kernel: dahdi: Detected time shift.
Aug 22 11:10:15 pbx01 kernel: dahdi: Detected time shift.
Aug 22 11:20:13 pbx01 kernel: dahdi: Detected time shift.
Aug 22 11:30:29 pbx01 kernel: dahdi: Detected time shift.
Aug 22 11:50:36 pbx01 kernel: dahdi: Detected time shift.
Aug 22 12:00:13 pbx01 kernel: dahdi: Detected time shift.
Aug 22 12:15:27 pbx01 kernel: dahdi: Detected time shift.
Aug 22 12:50:13 pbx01 kernel: dahdi: Detected time shift.
Aug 22 13:05:32 pbx01 kernel: dahdi: Detected time shift.
Aug 22 13:10:28 pbx01 kernel: dahdi: Detected time shift.
Aug 22 13:40:31 pbx01 kernel: dahdi: Detected time shift.
Aug 22 13:50:39 pbx01 kernel: dahdi: Detected time shift.
Aug 22 14:05:35 pbx01 kernel: dahdi: Detected time shift.

I count this message per day since we have this message (before the 1.7.2016 we never got it, freePBX is up since one year):
2016-07-01 3
2016-07-02 1
2016-07-03 0
2016-07-04 0
2016-07-05 1
2016-07-06 0
2016-07-07 0
2016-07-08 0
2016-07-09 0
2016-07-10 0
2016-07-11 0
2016-07-12 0
2016-07-13 1
2016-07-14 0
2016-07-15 0
2016-07-16 1
2016-07-17 0
2016-07-18 0
2016-07-19 0
2016-07-20 0
2016-07-21 4
2016-07-22 13
2016-07-23 12
2016-07-24 10
2016-07-25 12
2016-07-26 2
2016-07-27 4
2016-07-28 5
2016-07-29 3
2016-07-30 3
2016-07-31 3
2016-08-01 4
2016-08-02 3
2016-08-03 2
2016-08-04 6
2016-08-05 4
2016-08-06 7
2016-08-07 26
2016-08-08 20
2016-08-09 13
2016-08-10 8
2016-08-11 10
2016-08-12 7
2016-08-13 36
2016-08-14 125
2016-08-15 160
2016-08-16 91
2016-08-17 20
2016-08-18 14
2016-08-19 68
2016-08-20 172
2016-08-21 122

So it counts up since 7.8.2016 → Could be an update?

Freepbx updates:
> [2016-Jul-03 05:10:10] [INFO] (bin/module_admin:307) - Upgrading certman…
> [2016-Jul-03 05:10:19] [INFO] (bin/module_admin:307) - Upgrading endpoint…
> [2016-Jul-03 05:10:35] [INFO] (bin/module_admin:307) - Upgrading framework…
> [2016-Jul-03 05:11:00] [INFO] (bin/module_admin:307) - Upgrading music…
> [2016-Jul-03 05:11:06] [INFO] (bin/module_admin:307) - Upgrading paging…
> [2016-Jul-03 05:11:13] [INFO] (bin/module_admin:307) - Upgrading restapps…
> [2016-Jul-03 05:11:18] [INFO] (bin/module_admin:307) - Upgrading superfecta…
> [2016-Jul-03 05:11:24] [INFO] (bin/module_admin:307) - Upgrading sysadmin…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_server”…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_voicemail_agent”…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_recording_agent”…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_email”…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_phone_number”…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_users”…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_queues”…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_conference_rooms”…
> [2016-Jul-09 10:20:32] [INFO] (lib/table.class.php:82) - Upgrading “cxpanel_managed_items”…
> [2016-Aug-07 05:10:14] [INFO] (bin/module_admin:307) - Upgrading endpoint…
> [2016-Aug-07 05:10:31] [INFO] (bin/module_admin:307) - Upgrading freepbx_ha…
> [2016-Aug-21 05:10:18] [INFO] (bin/module_admin:307) - Upgrading dahdiconfig…

CentOs Updates:

ID | Login user | Date and time | Action(s) | Altered

   58 | root <root>              | 2016-07-30 04:05 | Update         |    1   
   57 | root <root>              | 2016-07-28 04:16 | Update         |   14   
   56 | root <root>              | 2016-07-27 03:31 | Update         |    1   
   55 | root <root>              | 2016-07-26 03:59 | Update         |   14   
   54 | root <root>              | 2016-07-25 04:08 | I, U              |   18   
   53 | root <root>              | 2016-07-01 03:37 | Update         |    2 EE

“endpoint” or “freepbx_ha” was in that time, so i disable it, because we don’t need it, but nothing helps, same problem.

Anybody a hint???

Would be great to find the problem.

gruss ivo

…ah…

So long the waits are high, i can find this task active:
/var/www/html/admin/modules/dashboard/scheduler.php

But when i start it alone, nothing goes high.