You are the only one having a problem that would be manifesting itself in literally thousands of installations. It is not a problem with fail2ban, it is a problem with the way you have your system set up. You have not even begun to give us the information we need to help you, and I don’t think anyone is willing to take the responsibility for you losing thousands of dollars from fraudulent calling, so I (for one) am going to stand my ground on this and say that you really need to fix your installation.