FPS drop when entering synchronous circle


I use a lot of replaced and addon suits and accessories and when someone enters a synchronous circle where are multiple players there is a huge FPS drop until they create the peds and load said stuff.
If I change the “PlayerCullingRadius” to a value that loads all players I don’t experience this problem, however due to the many clients I guess about 10-20 FPS minus.

Who has experience with this?

Also, why does loading a ped hundreds of meters away, which is “not even seen” by the client, cause such a big FPS drop?