Fail2Ban causing high CPU usage

Has anyone run into the CPU maxing out when Fail2Ban is running? I am tailing the secure log and the only thing that is appearing is “sshd Did not receive identification string from ::1”. But, its only a few entries every few minutes. I can’t account for the high cpu usage from fail2ban if the log isn’t showing anything. Anyone have any ideas?