I changed my SSH port in the /etc/ssh/sshd_config file and then restarted the ssh service. I implemented fail2ban and updated the port to my SSH under that config. I also then implemented the UFW firewall and allowed incoming connections to my new SSH port.
However, when I try and login with my SSH key using ssh -i /Users/myuser/.ssh/vpsssh [email protected] it's trying to connect to port 22 instead of the defined port I have.