It is not a firewall issue. Here is the solution.
I tried this first which did not solve it because that is for sip Sessions expire after 30 minutes and drop the calls
This worked for me for pjsip (second last post) Outbound Calls Dropping after 15 minutes