Failed to get info from server

Hey, I have got an dedicated root server running linux debian 10.
Some people get the following error on connecting with the server.
I dont know what I can do about this.

I dont have a firewall
The IPs arent blocked in any way.

Some people can connect some cant.
But the TeamSpeak Server on the same machine works fine every time.