To connect to an SQL Server with a custom port, specify this port after a comma: 203.0.113.2,1433
Make sure on server the port is allowed:
Windows PowerShell
New-NetFirewallRule -DisplayName "SQL Server Remote Access" -Direction Inbound -Protocol TCP -LocalPort 1433-1434 -Action Allow