Wallet won't connect to server

[wombatlabs]

Hi I have Electrumx v1.13 installed on an Ubuntu 16.04 server that is fully synced with the blockchain and I am getting the following errors when trying to connect with it from the electrum client:

Server error:
changing task concurrency
disconnected whilst throttled

Electrum wallet error:
[get_server] [Errno 111] Connection refused
connection closed remotely

The ssl was created with letsencrypt, ports 50001 and 50002 are open and I removed previous certs from electrum's certs directory.