Onesync - Connection interrupted past ~480 players without hitches

PichotM · September 30, 2020, 6:14pm

Server

Operating system: Windows
Artifact version: Latest + tweaks

Tested on three servers, despite apparently no hitches, no high CPU, no high bandwidth some people are getting timed out when reaching ~480 players.

Procdump + ETW: https://mega.nz/file/wsoU0bpR#9m7hg0flThvS_dtuqrShLTyMOEKMANTohrT8zB11HUM
Symbols + DLL: https://mega.nz/file/FswARaTA#sw2SelkssmC04fHsB_U_vDgFQJXw5ACh1v0OeKj-Kqc

nta · September 30, 2020, 9:53pm

Any net-metrics info from these ‘some people’?

PichotM · October 2, 2020, 10:22pm

PichotM · October 2, 2020, 10:23pm

ETW Trace during a hitching in the net thread that caused a time out / PL
https://mega.nz/file/pxwgwAgI#dq5BuLAxxMMwkp7nbuSxnbqN2syTWUs0lRsoZviZAzo
(using the same symbols and dll as above)

nta · October 3, 2020, 6:10am

Primary slowness here on svNetwork at least still appears to be extremely high amount of (resent?) network packets, but indeed some curious contention is visible for a few msec at some point which looks like some sort of host->guest preemption - are you pinning threads on the host?

PichotM · October 3, 2020, 4:18pm

are you pinning threads on the host?

I’m not

–

I don’t know if you want screenshots but here is a preview of the drilldown UI

If you want to see it yourself, just join the “Extinction” server you want

nta · October 4, 2020, 7:06am

Might be a good idea to prevent some of these odd hitches.

Right - how frequently are you changing players’ appearance after they spawn/while they’re visible to other players?

PichotM · October 4, 2020, 3:19pm

Right - how frequently are you changing players’ appearance after they spawn/while they’re visible to other players?

There is a place to change your appearance in the main “lobby”
So usually 10-20 players at least might be changing their appearance at the same time, and each change is synced. But usually, appearance is only set once.

I’ll see to change that to a local ped, so we avoid any unnecessary sync

nta · October 4, 2020, 3:20pm

That might be related, might also not be, there’s a set of underlying issues that could be related but without ability to test/diagnose live I can’t do much.