Disable fail2ban and just use manual IPTables?

You might want to read