Networking ID not assigned properly

Raicyk · November 22, 2022, 9:26am

Description: Hello. We have a server with 200+ players online at peak, and A LOT of them are running into the same issue. At first when I investigated it I thought it’s something to do with our framework and the way it handles instancing. However I’ve confirmed that’s not the issue, and the issue seems to be the player doesn’t get assigned a network ID serverside. So on their screen, they don’t see any other player and they can’t interact with anyone. However, if they go to Valentine, they can see players loading in as Arthur Morgan.
There’s no errors in the server-side log and clientside as you can see NETWORK_GET_NETWORK_ID_FROM_ENTITY returns no such entity
Server artifact version: 6015
Expected behavior: Player gets assigned a network ID
Current behavior: Players load into an “alternate dimension” (despite not being instanced thru a routing bucket, which I have checked)
Error screenshot: https://cdn.discordapp.com/attachments/1037410840346894416/1044532220347559997/unknown.png https://cdn.discordapp.com/attachments/1044526528681218129/1044530717096419378/20221122213132_1.jpg
.dmp/crash files: N/A
Files/Code to reproduce bug: N/A
Extra information: This bug is hard to reproduce yourself, however I have many players on our server that experience this on a daily basis & I can extract more info from them if needed.

Disquse · November 22, 2022, 11:16am

Are you sure this is not a part of 32 players in scope limitation?

This is an interesting note, maybe related to UDP packet size limitation? Have you seen such messages in server console?

github.com

citizenfx/fivem/blob/74d7c26615996f71f1e70f4ab3a029e0982e304e/code/components/citizen-server-impl/src/state/ServerGameState.cpp#L733


      
          
          
		*(uint32_t*)(outData.data()) = msgType;
          		*(uint64_t*)(outData.data() + 4) = newFrame.full;
          
          
		int bufferLen = len + 4 + 8;
          		net::Buffer netBuffer(reinterpret_cast<uint8_t*>(outData.data()), bufferLen);
          		netBuffer.Seek(bufferLen); // since the buffer constructor doesn't actually set the offset
          
          
	    if (bufferLen >= kPacketWarnLength)
          		{
          			console::DPrintf("net", "Sending a large packet (%d compressed bytes) to client %d, report if there will be any sync issues\n", bufferLen, client->GetNetId());
          		}
          
          
		GS_LOG("flushBuffer: sending %d bytes to %d\n", bufferLen, client->GetNetId());
          
          
		client->SendPacket(1, netBuffer, NetPacketType_Unreliable);
          
          
		size_t oldCurrentBit = buffer.GetCurrentBit();
          
          
		debug::Alias(&oldCurrentBit);
          		debug::Alias(&len);

That’s the main issue with such bugs

Raicyk · November 22, 2022, 12:34pm

Hello! Appreciate the fast response. Just to be clear, I’m a fellow developer and believe me I did everything in my power to investigate this bug, but I’m almost certain its none of my scripts causing it.
It’s 100% not part of the 32 players in scope limitation - It happens when you login, and relog does NOT fix it, the only fix we found for it is a restart to your PC. The players can run around and interact with the world (our store script, etc) but they can’t summon their horse (the horse appears for a moment and then disappears instantly?) and like I said, they can’t see any players, regardless if they’re in a town or in the wilderness with just 1 player next to them.

UDP packet size limitation is an interesting idea, but I checked the server log constantly when it happens and there’s no errors whatsoever.

and yeah, it sucks that we cant reproduce it, however like I said I have many players who experience this daily and if we need to do testing they’ll gladly help out to get this resolved.

Disquse · November 22, 2022, 1:10pm

Also those warning are only shown with developer console “mode” enabled. Make sure you’re using developer 1 (server convar).

Raicyk · November 22, 2022, 2:15pm

Alright, I enabled it, I’ll let you know if I catch anything

Raicyk · November 23, 2022, 11:25am

Tried it today, nothing showed up in the logs.

Raicyk · November 23, 2022, 11:26am

Oh, another interesting thing… when I try to /tp to the player, it brings me to x0 y0 z0 and I see the player standing there. But on their screen they’re walking around elsewhere.

elmeromero13 · December 4, 2022, 8:52am

I’m one of the players experiencing this issue. Is there anything I can do to help investigate it? RedM (and the server this is occurring on) is essentially unplayable for me right now, and has been for two weeks.

Disquse · December 4, 2022, 8:12pm

Hi, I would like to see OneSync log files when this happens next time. If you personally would see this happening again on your server, please do these steps:

Teleport to this “desynced” player.
Get network id of this player. You can use this debug resource: local pedPool = {} local searchRadius = 120.0local enabled = false loc - Pastebin.com (UPD: edited to support player peds)
Record a video or make screenshots of how this looks (player + his network id should be visible).
In RedM open console (F8) and type onesync_logFile "logs_client.txt"
Do the same in your server console onesync_logFile "logs_server.txt"
Wait for 10 seconds. While logs are recordings, it would affect performance of your game and server for some time.
After 10 seconds type onesync_logFile "" in your client and server consoles to finish log recordings.
Send me here (or in DMs) recorded video/screenshot and logs (logs_client.txt and logs_server.txt). They would be stored in your RedM installation (RedM Application Data) and server installation (where FXServer.exe is located) folders.