Most RP servers are running unoptimized scripts and custom models(cars, housing,peds,clothes) These are all contributing factors to lower fps.
My suggestion would be to either find a server that runs well on your computer, lower your graphic settings, or upgrade your computer as it is rather lackluster in specs.
Or another option would be to start your own server and optimize it for your needs.