Phones cutting out for about 5 seconds

So I am on FreePBX12 using a SIP trunk with about 10 GrandStream phones. The issues we have is randomly while on the phone talking to someone the voices will disappear for about 5 seconds and then come back like nothing happened. It happens everyday and randomly. Any ideas what could be causing this and how to fix it?