Hey,
I’ve looked as far as I can, including in my database, to figure out the reason for a server crash.
The server logs showed this:
e[38;5;73m[ citizen-server-impl] network thread hitch warning: timer interval of 7591 milliseconds
e[38;5;73m[ citizen-server-impl] sync thread hitch warning: timer interval of 7597 milliseconds
e[38;5;73m[ citizen-server-impl] sync thread hitch warning: timer interval of 390 milliseconds
e[38;5;73m[ citizen-server-impl] network thread hitch warning: timer interval of 391 milliseconds
e[38;5;73m[ citizen-server-impl] e[0
Server dump:
https://drive.google.com/file/d/1a5-hzKZPDtFEfU780Flk-6Xc_ahtBPPl/view?usp=sharing
*******************************************************************************
* *
* Exception Analysis *
* *
*******************************************************************************
*** WARNING: Unable to verify checksum for citizen-server-main.dll
*** WARNING: Unable to verify checksum for CoreRT.dll
*** WARNING: Unable to verify checksum for libuv.dll
*** WARNING: Unable to verify checksum for net-tcp-server.dll
*** WARNING: Unable to verify checksum for node.dll
*** WARNING: Unable to verify checksum for citizen-scripting-core.dll
*** WARNING: Unable to verify checksum for citizen-scripting-lua.dll
*** WARNING: Unable to verify checksum for citizen-resources-core.dll
*** WARNING: Unable to verify checksum for citizen-server-impl.dll
*** WARNING: Unable to verify checksum for conhost-server.dll
*** WARNING: Unable to verify checksum for citizen-server-gui.dll
*** WARNING: Unable to verify checksum for voip-server-mumble.dll
KEY_VALUES_STRING: 1
Key : Analysis.CPU.mSec
Value: 8858
Key : Analysis.DebugAnalysisManager
Value: Create
Key : Analysis.Elapsed.mSec
Value: 45972
Key : Analysis.Init.CPU.mSec
Value: 359
Key : Analysis.Init.Elapsed.mSec
Value: 125094
Key : Analysis.Memory.CommitPeak.Mb
Value: 104
Key : Timeline.OS.Boot.DeltaSec
Value: 169573
Key : Timeline.Process.Start.DeltaSec
Value: 12951
Key : WER.OS.Branch
Value: 19h1_release
Key : WER.OS.Timestamp
Value: 2019-03-18T12:02:00Z
Key : WER.OS.Version
Value: 10.0.18362.1
Key : WER.Process.Version
Value: 1.0.0.0
NTGLOBALFLAG: 0
PROCESS_BAM_CURRENT_THROTTLED: 0
PROCESS_BAM_PREVIOUS_THROTTLED: 0
APPLICATION_VERIFIER_FLAGS: 0
CONTEXT: (.ecxr)
rax=0000000000000001 rbx=0000003e807fcdc0 rcx=dc79438eae760000
rdx=0000021fb2900000 rsi=0000021fb4fffa68 rdi=0000021fb4fffaa0
rip=00007ff96d52e84c rsp=0000003e807fcc50 rbp=0000000000000000
r8=0000021fb28327c0 r9=0000000000000001 r10=0000000000008000
r11=0000003e807fc700 r12=00007ff96d534010 r13=0000000000000000
r14=0000021fb4fffa68 r15=0000000000000000
iopl=0 nv up ei pl nz na po nc
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206
mono_2_0_sgen!mono_bitset_copyto+0x1a2e0b:
00007ff9`6d52e84c cc int 3
Resetting default scope
EXCEPTION_RECORD: (.exr -1)
ExceptionAddress: 00007ff96d52e84c (mono_2_0_sgen!mono_bitset_copyto+0x00000000001a2e0b)
ExceptionCode: 80000003 (Break instruction exception)
ExceptionFlags: 00000000
NumberParameters: 1
Parameter[0]: 0000000000000000
PROCESS_NAME: FXServer.exe
ERROR_CODE: (NTSTATUS) 0x80000003 - {EXCEPTION} Breakpoint A breakpoint has been reached.
EXCEPTION_CODE_STR: 80000003
EXCEPTION_PARAMETER1: 0000000000000000
STACK_TEXT:
0000003e`807fcc50 00007ff9`6d534041 : 0000003e`807fcdc0 00000000`00000018 00000000`00000020 0000021f`b4fff850 : mono_2_0_sgen!mono_bitset_copyto+0x1a2e0b
0000003e`807fccf0 00007ff9`6d7c50cf : 00000000`00000020 0000021f`b5000000 0000021f`b4fffa68 00007ff9`6d7ee3b4 : mono_2_0_sgen!mono_bitset_copyto+0x1a8600
0000003e`807fcd40 00007ff9`6d53072b : 00000000`00000000 00007ff9`81a09800 00000000`00004020 0000021f`dbb8dde3 : mono_2_0_sgen!mono_bitset_copyto+0x43968e
0000003e`807fcd90 00007ff9`819fc34e : 00007ff9`81a09878 00000000`00000000 00000000`00000000 00000000`00001200 : mono_2_0_sgen!mono_bitset_copyto+0x1a4cea
0000003e`807fd600 00007ff9`6d4ba2da : 0000021f`b449d270 00000000`00000001 0000021f`b4e76c50 00000000`00000000 : citizen_scripting_mono!MonoEnsureThreadAttached+0x6fe
0000003e`807fd640 00007ff9`6d52d699 : 0000001e`275347a3 00000000`00000000 00000000`00000000 0000021f`b4c1ee10 : mono_2_0_sgen!mono_bitset_copyto+0x12e899
0000003e`807fd670 00007ff9`6d7c530c : 0000018a`d1cd0ef9 00000000`00000001 0000001e`275347a3 00000000`00000000 : mono_2_0_sgen!mono_bitset_copyto+0x1a1c58
0000003e`807fd6d0 00007ff9`6d7c456a : 00000000`00000000 00000000`00000001 00000000`00000000 00000000`00000000 : mono_2_0_sgen!mono_bitset_copyto+0x4398cb
0000003e`807fd710 00007ff9`6d7c1ced : 00000000`00000000 00000000`00004020 0000003e`807fd950 0000021f`db8e0c73 : mono_2_0_sgen!mono_bitset_copyto+0x438b29
0000003e`807fd8f0 00007ff9`6d7c94b9 : 00000000`00000000 00000000`00000000 0000021f`b4e57250 00007ff9`6d7b2210 : mono_2_0_sgen!mono_bitset_copyto+0x4362ac
0000003e`807fd930 00007ff9`6d7b1ad8 : 0000021f`b4e573a0 0000021f`cf60063b 00000000`00000000 00000000`00004020 : mono_2_0_sgen!mono_bitset_copyto+0x43da78
0000003e`807fd970 00007ff9`6d52f21d : 0000021f`dbb16730 0000021f`b4fe1278 00000000`00000000 00000000`00004020 : mono_2_0_sgen!mono_bitset_copyto+0x426097
0000003e`807fd9e0 0000021f`b7db79a5 : 00000220`09eea140 0000003e`807fda80 00000000`00004000 00000000`00004020 : mono_2_0_sgen!mono_bitset_copyto+0x1a37dc
0000003e`807fda10 0000021f`cf602343 : 0000003e`807fdb90 0000021f`db472ff0 00000000`00000000 0000021f`b4e76dd0 : 0x0000021f`b7db79a5
0000003e`807fda90 0000021f`dbb83d8b : 0000021f`b4c32178 0000021f`b4c32418 0000021f`b4fe6b98 00000000`00000000 : 0x0000021f`cf602343
0000003e`807fdb20 0000021f`dbb83ab3 : 0000021f`b4c6ff90 0000021f`b4c32178 0000021f`b4fe6b98 00000000`00000000 : 0x0000021f`dbb83d8b
0000003e`807fdb60 0000021f`dbb838bb : 0000003e`807fdc00 0000021f`b4c321a8 00000000`00000001 0000021f`b4c32178 : 0x0000021f`dbb83ab3
0000003e`807fdbc0 0000021f`d4b960bb : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x0000021f`dbb838bb
0000003e`807fdc10 0000021f`dbb713ca : 00000000`00000001 0000021f`b4fe12e0 0000021f`b4fe6b98 0000021f`b4fe6b98 : 0x0000021f`d4b960bb
0000003e`807fe280 0000021f`d06a7d4f : 00000000`0000001e 00000000`0000003e 0000021f`c6a265d0 00007ff9`6d49e029 : 0x0000021f`dbb713ca
0000003e`807fe2c0 0000021f`d06a78eb : 0000003e`807fe4f8 0000021f`c6ad22a0 00000000`0000000c 0000021f`b4fe1160 : 0x0000021f`d06a7d4f
0000003e`807fe370 0000021f`dbb70e1b : 0000021f`b4fe6b98 0000021f`b4fe6b98 0000021f`b4fe6b98 0000021f`b4fe1160 : 0x0000021f`d06a78eb
0000003e`807fe3c0 0000021f`dbb5fe16 : 0000021f`d7a192c0 0000021f`d4aa3e49 0000021f`81f71fb0 0000021f`b4c32110 : 0x0000021f`dbb70e1b
0000003e`807fe430 0000021f`d4aa34cb : 0000021f`b4c320d8 0000021f`b4c320d8 00000000`00000010 0000021f`b4c320d8 : 0x0000021f`dbb5fe16
0000003e`807fe4c0 0000021f`d4aa32bb : 0000021f`dbb7f7a0 0000021f`00000000 00000000`00000001 0000021f`b4fe1160 : 0x0000021f`d4aa34cb
0000003e`807fe5d0 0000021f`dbb84203 : 0000021f`b4c70088 00000000`00000000 00000000`00000017 0000021f`b4c6ff90 : 0x0000021f`d4aa32bb
0000003e`807fe610 0000021f`dbb81703 : 0000021f`da9cf7b0 0000021f`b4fe0b18 0000021f`b4fe11b0 0000021f`d4b9beab : 0x0000021f`dbb84203
0000003e`807fe660 0000021f`d4b9bfbb : 00000000`00000000 00007ff9`6d3c30b5 00000000`0000027f 00000000`00000000 : 0x0000021f`dbb81703
0000003e`807fe6b0 0000021f`dbb713ca : 0000003e`807fecd0 00007ff9`6d4d45d8 00000000`00000001 0000003e`807fec98 : 0x0000021f`d4b9bfbb
0000003e`807fec20 0000021f`d06a7d4f : 0000021f`c6ad22a0 00007ff9`6d4d3bb5 00000000`00000000 0000003e`807ff520 : 0x0000021f`dbb713ca
0000003e`807fec60 0000021f`d06a78eb : 00000000`00000001 00007ff9`6d4d3172 00000000`04018664 0000021f`b4c703f8 : 0x0000021f`d06a7d4f
0000003e`807fed10 0000021f`dbb70e1b : 00000000`00000000 00000000`00000000 00000000`00000000 0000021f`b4c703f8 : 0x0000021f`d06a78eb
0000003e`807fed60 0000021f`dbb5fe16 : 0000021f`d7a192c0 0000021f`d4aa3e49 0000021f`b4903008 00007ff9`6d4eec76 : 0x0000021f`dbb70e1b
0000003e`807fedd0 0000021f`d4aa34cb : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x0000021f`dbb5fe16
0000003e`807fee60 0000021f`d4aa32bb : 0000021f`00000000 0000021f`00000000 0000021f`b4c703f8 00000000`00000000 : 0x0000021f`d4aa34cb
0000003e`807fef70 0000021f`d4aa4eeb : 00000000`00000000 0000021f`cf606e16 00007ff6`3ffd8e74 00000000`00000000 : 0x0000021f`d4aa32bb
0000003e`807fefb0 0000021f`dbb833ab : 00000000`0a1b7caa 00007ff9`a1c32d18 0000021f`b4c70578 00000000`00000000 : 0x0000021f`d4aa4eeb
0000003e`807ff000 0000021f`dbb82b83 : 0000003e`807ff350 0000003e`807ff1a0 0000003e`807ff0a0 0000021f`d7a192c0 : 0x0000021f`dbb833ab
0000003e`807ff150 0000021f`dbb82995 : 0000003e`807ff1f0 0000021f`d4b9f883 0000021f`ac63bb28 0000021f`d7a192c0 : 0x0000021f`dbb82b83
0000003e`807ff1a0 0000021f`dbb82577 : 0000003e`807ff320 0000021f`d4b2eef3 0000003e`807ff788 00000000`00000000 : 0x0000021f`dbb82995
0000003e`807ff1f0 0000021f`d4b2f0cb : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x0000021f`dbb82577
0000003e`807ff230 0000021f`d4b9fbb3 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x0000021f`d4b2f0cb
0000003e`807ff330 0000021f`d4b9fd95 : 0000021f`b28302a8 00000000`00000000 00000000`000006ef 00007ff9`a3ee0000 : 0x0000021f`d4b9fbb3
0000003e`807ff3b0 00007ff9`6d5495be : 0000003e`ecf67076 0000021f`00000000 0000021f`b4650750 00007ff9`a3f1b91f : 0x0000021f`d4b9fd95
0000003e`807ff440 00007ff9`6d49c0d2 : 0000021f`c6ad22a0 00007ff9`6d4aa3fa 00000000`00000000 00007ff9`6d3be2c0 : mono_2_0_sgen!mono_bitset_copyto+0x1bdb7d
0000003e`807ff620 00007ff9`6d4d1144 : 00000220`09eea140 0000003e`807ff719 00000000`00000000 00000000`00000000 : mono_2_0_sgen!mono_bitset_copyto+0x110691
0000003e`807ff670 00007ff9`6d4d3dee : 0000021f`00010000 00000000`00000000 00000000`00000001 00000000`0000248c : mono_2_0_sgen!mono_bitset_copyto+0x145703
0000003e`807ff780 00007ff9`6d4cc91a : 0000021f`ecbf5f50 000a0001`000000c0 00007ff9`6d4d3c30 00000000`00000000 : mono_2_0_sgen!mono_bitset_copyto+0x1483ad
0000003e`807ff7b0 00007ff9`6d4cc686 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : mono_2_0_sgen!mono_bitset_copyto+0x140ed9
0000003e`807ff880 00007ff9`a3267c24 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : mono_2_0_sgen!mono_bitset_copyto+0x140c45
0000003e`807ff8b0 00007ff9`a3f4d721 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : kernel32!BaseThreadInitThunk+0x14
0000003e`807ff8e0 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : ntdll!RtlUserThreadStart+0x21
SYMBOL_NAME: mono_2_0_sgen!mono_bitset_copyto+1a2e0b
MODULE_NAME: mono_2_0_sgen
IMAGE_NAME: mono-2.0-sgen.dll
STACK_COMMAND: ~111s ; .ecxr ; kb
FAILURE_BUCKET_ID: BREAKPOINT_80000003_mono-2.0-sgen.dll!mono_bitset_copyto
OS_VERSION: 10.0.18362.1
BUILDLAB_STR: 19h1_release
OSPLATFORM_TYPE: x64
OSNAME: Windows 10
FAILURE_ID_HASH: {a4b38921-8bf2-8022-d827-b7c73f608a55}
Followup: MachineOwner
---------
What else can I do to diagnose this further to the point of being able to implement a fix?
We’re running on windows.
Kind Regards,
Matt